Showing 101–150 of 4,231 results for author: Kim, K

Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Models

Authors: Kyuyoung Kim, Jongheon Jeong, Minyong An, Mohammad Ghavamzadeh, Krishnamurthy Dvijotham, Jinwoo Shin, Kimin Lee

Abstract: Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy objectives, can compromise the performance of fine-tuned models, a phenomenon known as reward overoptimization. To investigate this issue in depth, we introduce th… ▽ More Fine-tuning text-to-image models with reward functions trained on human feedback data has proven effective for aligning model behavior with human intent. However, excessive optimization with such reward models, which serve as mere proxy objectives, can compromise the performance of fine-tuned models, a phenomenon known as reward overoptimization. To investigate this issue in depth, we introduce the Text-Image Alignment Assessment (TIA2) benchmark, which comprises a diverse collection of text prompts, images, and human annotations. Our evaluation of several state-of-the-art reward models on this benchmark reveals their frequent misalignment with human assessment. We empirically demonstrate that overoptimization occurs notably when a poorly aligned reward model is used as the fine-tuning objective. To address this, we propose TextNorm, a simple method that enhances alignment based on a measure of reward model confidence estimated across a set of semantically contrastive text prompts. We demonstrate that incorporating the confidence-calibrated rewards in fine-tuning effectively reduces overoptimization, resulting in twice as many wins in human evaluation for text-image alignment compared against the baseline reward models. △ Less

Submitted 2 April, 2024; originally announced April 2024.

Comments: ICLR 2024

Efficient, indistinguishable telecom C-band photons using a tapered nanobeam

Authors: Mohammad Habibur Rahaman, Samuel Harper, Chang-Min Lee, Kyu-Young Kim, Mustafa Atabey Buyukkaya, Victor J. Patel, Samuel D. Hawkins, Je-Hyung Kim, Sadhvikas Addamane, Edo Waks

Abstract: Telecom C-band single photons exhibit the lowest attenuation in optical fibers, enabling long-haul quantum-secured communication. However, efficient coupling with optical fibers is crucial for these single photons to be effective carriers in long-distance transmission. In this work, we demonstrate an efficient fiber-coupled single photon source at the telecom C-band using InAs/InP quantum dots cou… ▽ More Telecom C-band single photons exhibit the lowest attenuation in optical fibers, enabling long-haul quantum-secured communication. However, efficient coupling with optical fibers is crucial for these single photons to be effective carriers in long-distance transmission. In this work, we demonstrate an efficient fiber-coupled single photon source at the telecom C-band using InAs/InP quantum dots coupled to a tapered nanobeam. The tapered nanobeam structure facilitates directional emission that is mode-matched to a lensed fiber, resulting in a collection efficiency of up to 65% from the nanobeam to a single-mode fiber. Using this approach, we demonstrate single photon count rates of 575 $\pm$ 5 Kcps and a single photon purity of $g^2$ (0) = 0.015 $\pm$ 0.003. Additionally, we demonstrate Hong-Ou Mandel interference from the emitted photons with a visibility of 0.84 $\pm$ 0.06. From these measurements, we determine a photon coherence time of 450 $\pm$ 20 ps, a factor of just 8.3 away from the lifetime limit. This work represents an important step towards the development of telecom C-band single-photon sources emitting bright, pure, and indistinguishable photons, which are necessary to realize fiber-based long-distance quantum networks △ Less

Submitted 5 April, 2024; v1 submitted 1 April, 2024; originally announced April 2024.

Addressing Heterogeneity in Federated Load Forecasting with Personalization Layers

Authors: Shourya Bose, Yu Zhang, Kibaek Kim

Abstract: The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting models. In response to privacy concerns, federated learning (FL) has been proposed as a privacy-preserving approach for training, but the quality of trained models degrades as client data becomes heterogeneous. In this paper we propose the use of personalization layers fo… ▽ More The advent of smart meters has enabled pervasive collection of energy consumption data for training short-term load forecasting models. In response to privacy concerns, federated learning (FL) has been proposed as a privacy-preserving approach for training, but the quality of trained models degrades as client data becomes heterogeneous. In this paper we propose the use of personalization layers for load forecasting in a general framework called PL-FL. We show that PL-FL outperforms FL and purely local training, while requiring lower communication bandwidth than FL. This is done through extensive simulations on three different datasets from the NREL ComStock repository. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Data-Efficient Unsupervised Interpolation Without Any Intermediate Frame for 4D Medical Images

Authors: JungEun Kim, Hangyul Yoon, Geondo Park, Kyungsu Kim, Eunho Yang

Abstract: 4D medical images, which represent 3D images with temporal information, are crucial in clinical practice for capturing dynamic changes and monitoring long-term disease progression. However, acquiring 4D medical images poses challenges due to factors such as radiation exposure and imaging duration, necessitating a balance between achieving high temporal resolution and minimizing adverse effects. Gi… ▽ More 4D medical images, which represent 3D images with temporal information, are crucial in clinical practice for capturing dynamic changes and monitoring long-term disease progression. However, acquiring 4D medical images poses challenges due to factors such as radiation exposure and imaging duration, necessitating a balance between achieving high temporal resolution and minimizing adverse effects. Given these circumstances, not only is data acquisition challenging, but increasing the frame rate for each dataset also proves difficult. To address this challenge, this paper proposes a simple yet effective Unsupervised Volumetric Interpolation framework, UVI-Net. This framework facilitates temporal interpolation without the need for any intermediate frames, distinguishing it from the majority of other existing unsupervised methods. Experiments on benchmark datasets demonstrate significant improvements across diverse evaluation metrics compared to unsupervised and supervised baselines. Remarkably, our approach achieves this superior performance even when trained with a dataset as small as one, highlighting its exceptional robustness and efficiency in scenarios with sparse supervision. This positions UVI-Net as a compelling alternative for 4D medical imaging, particularly in settings where data availability is limited. The source code is available at https://github.com/jungeun122333/UVI-Net. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: CVPR 2024

KoCoNovel: Annotated Dataset of Character Coreference in Korean Novels

Authors: Kyuhee Kim, Surin Lee, Sangah Lee

Abstract: In this paper, we present KoCoNovel, a novel character coreference dataset derived from Korean literary texts, complete with detailed annotation guidelines. Comprising 178K tokens from 50 modern and contemporary novels, KoCoNovel stands as one of the largest public coreference resolution corpora in Korean, and the first to be based on literary texts. KoCoNovel offers four distinct versions to acco… ▽ More In this paper, we present KoCoNovel, a novel character coreference dataset derived from Korean literary texts, complete with detailed annotation guidelines. Comprising 178K tokens from 50 modern and contemporary novels, KoCoNovel stands as one of the largest public coreference resolution corpora in Korean, and the first to be based on literary texts. KoCoNovel offers four distinct versions to accommodate a wide range of literary coreference analysis needs. These versions are designed to support perspectives of the omniscient author or readers, and to manage multiple entities as either separate or overlapping, thereby broadening its applicability. One of KoCoNovel's distinctive features is that 24% of all character mentions are single common nouns, lacking possessive markers or articles. This feature is particularly influenced by the nuances of Korean address term culture, which favors the use of terms denoting social relationships and kinship over personal names. In experiments with a BERT-based coreference model, we observe notable performance enhancements with KoCoNovel in character coreference tasks within literary texts, compared to a larger non-literary coreference dataset. Such findings underscore KoCoNovel's potential to significantly enhance coreference resolution models through the integration of Korean cultural and linguistic dynamics. △ Less

Submitted 11 April, 2024; v1 submitted 1 April, 2024; originally announced April 2024.

Comments: 12 pages

SentiCSE: A Sentiment-aware Contrastive Sentence Embedding Framework with Sentiment-guided Textual Similarity

Authors: Jaemin Kim, Yohan Na, Kangmin Kim, Sang Rak Lee, Dong-Kyu Chae

Abstract: Recently, sentiment-aware pre-trained language models (PLMs) demonstrate impressive results in downstream sentiment analysis tasks. However, they neglect to evaluate the quality of their constructed sentiment representations; they just focus on improving the fine-tuning performance, which overshadows the representation quality. We argue that without guaranteeing the representation quality, their d… ▽ More Recently, sentiment-aware pre-trained language models (PLMs) demonstrate impressive results in downstream sentiment analysis tasks. However, they neglect to evaluate the quality of their constructed sentiment representations; they just focus on improving the fine-tuning performance, which overshadows the representation quality. We argue that without guaranteeing the representation quality, their downstream performance can be highly dependent on the supervision of the fine-tuning data rather than representation quality. This problem would make them difficult to foray into other sentiment-related domains, especially where labeled data is scarce. We first propose Sentiment-guided Textual Similarity (SgTS), a novel metric for evaluating the quality of sentiment representations, which is designed based on the degree of equivalence in sentiment polarity between two sentences. We then propose SentiCSE, a novel Sentiment-aware Contrastive Sentence Embedding framework for constructing sentiment representations via combined word-level and sentence-level objectives, whose quality is guaranteed by SgTS. Qualitative and quantitative comparison with the previous sentiment-aware PLMs shows the superiority of our work. Our code is available at: https://github.com/nayohan/SentiCSE △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: 14 pages, 8 figures

MSC Class: 68T50 ACM Class: I.2.7

Journal ref: LREC-COLING2024

Debiased calibration estimation using generalized entropy in survey sampling

Authors: Yonghyun Kwon, Jae Kwang Kim, Yumou Qiu

Abstract: Incorporating the auxiliary information into the survey estimation is a fundamental problem in survey sampling. Calibration weighting is a popular tool for incorporating the auxiliary information. The calibration weighting method of Deville and Sarndal (1992) uses a distance measure between the design weights and the final weights to solve the optimization problem with calibration constraints. Thi… ▽ More Incorporating the auxiliary information into the survey estimation is a fundamental problem in survey sampling. Calibration weighting is a popular tool for incorporating the auxiliary information. The calibration weighting method of Deville and Sarndal (1992) uses a distance measure between the design weights and the final weights to solve the optimization problem with calibration constraints. This paper introduces a novel framework that leverages generalized entropy as the objective function for optimization, where design weights play a role in the constraints to ensure design consistency, rather than being part of the objective function. This innovative calibration framework is particularly attractive due to its generality and its ability to generate more efficient calibration weights compared to traditional methods based on Deville and Sarndal (1992). Furthermore, we identify the optimal choice of the generalized entropy function that achieves the minimum variance across various choices of the generalized entropy function under the same constraints. Asymptotic properties, such as design consistency and asymptotic normality, are presented rigorously. The results from a limited simulation study are also presented. We demonstrate a real-life application using agricultural survey data collected from Kynetec, Inc. △ Less

Submitted 2 April, 2024; v1 submitted 1 April, 2024; originally announced April 2024.

Improving Visual Recognition with Hyperbolical Visual Hierarchy Mapping

Authors: Hyeongjun Kwon, Jinhyun Jang, Jin Kim, Kwonyoung Kim, Kwanghoon Sohn

Abstract: Visual scenes are naturally organized in a hierarchy, where a coarse semantic is recursively comprised of several fine details. Exploring such a visual hierarchy is crucial to recognize the complex relations of visual elements, leading to a comprehensive scene understanding. In this paper, we propose a Visual Hierarchy Mapper (Hi-Mapper), a novel approach for enhancing the structured understanding… ▽ More Visual scenes are naturally organized in a hierarchy, where a coarse semantic is recursively comprised of several fine details. Exploring such a visual hierarchy is crucial to recognize the complex relations of visual elements, leading to a comprehensive scene understanding. In this paper, we propose a Visual Hierarchy Mapper (Hi-Mapper), a novel approach for enhancing the structured understanding of the pre-trained Deep Neural Networks (DNNs). Hi-Mapper investigates the hierarchical organization of the visual scene by 1) pre-defining a hierarchy tree through the encapsulation of probability densities; and 2) learning the hierarchical relations in hyperbolic space with a novel hierarchical contrastive loss. The pre-defined hierarchy tree recursively interacts with the visual features of the pre-trained DNNs through hierarchy decomposition and encoding procedures, thereby effectively identifying the visual hierarchy and enhancing the recognition of an entire scene. Extensive experiments demonstrate that Hi-Mapper significantly enhances the representation capability of DNNs, leading to an improved performance on various tasks, including image classification and dense prediction tasks. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: This paper is accepted to CVPR 2024. The supplementary material is included. The code is available at \url{https://github.com/kwonjunn01/Hi-Mapper}

TTD: Text-Tag Self-Distillation Enhancing Image-Text Alignment in CLIP to Alleviate Single Tag Bias

Authors: Sanghyun Jo, Soohyun Ryu, Sungyub Kim, Eunho Yang, Kyungsu Kim

Abstract: We identify a critical bias in contemporary CLIP-based models, which we denote as single tag bias. This bias manifests as a disproportionate focus on a singular tag (word) while neglecting other pertinent tags, stemming from CLIP's text embeddings that prioritize one specific tag in image-text relationships. When deconstructing text into individual tags, only one tag tends to have high relevancy w… ▽ More We identify a critical bias in contemporary CLIP-based models, which we denote as single tag bias. This bias manifests as a disproportionate focus on a singular tag (word) while neglecting other pertinent tags, stemming from CLIP's text embeddings that prioritize one specific tag in image-text relationships. When deconstructing text into individual tags, only one tag tends to have high relevancy with CLIP's image embedding, leading to biased tag relevancy. In this paper, we introduce a novel two-step fine-tuning approach, Text-Tag Self-Distillation (TTD), to address this challenge. TTD first extracts image-relevant tags from text based on their similarity to the nearest pixels then employs a self-distillation strategy to align combined masks with the text-derived mask. This approach ensures the unbiased image-text alignment of the CLIP-based models using only image-text pairs without necessitating additional supervision. Our technique demonstrates model-agnostic improvements in multi-tag classification and segmentation tasks, surpassing competing methods that rely on external resources. The code is available at https://github.com/shjo-april/TTD. △ Less

Submitted 20 May, 2024; v1 submitted 30 March, 2024; originally announced April 2024.

DHR: Dual Features-Driven Hierarchical Rebalancing in Inter- and Intra-Class Regions for Weakly-Supervised Semantic Segmentation

Authors: Sanghyun Jo, Fei Pan, In-Jae Yu, Kyungsu Kim

Abstract: Weakly-supervised semantic segmentation (WSS) ensures high-quality segmentation with limited data and excels when employed as input seed masks for large-scale vision models such as Segment Anything. However, WSS faces challenges related to minor classes since those are overlooked in images with adjacent multiple classes, a limitation originating from the overfitting of traditional expansion method… ▽ More Weakly-supervised semantic segmentation (WSS) ensures high-quality segmentation with limited data and excels when employed as input seed masks for large-scale vision models such as Segment Anything. However, WSS faces challenges related to minor classes since those are overlooked in images with adjacent multiple classes, a limitation originating from the overfitting of traditional expansion methods like Random Walk. We first address this by employing unsupervised and weakly-supervised feature maps instead of conventional methodologies, allowing for hierarchical mask enhancement. This method distinctly categorizes higher-level classes and subsequently separates their associated lower-level classes, ensuring all classes are correctly restored in the mask without losing minor ones. Our approach, validated through extensive experimentation, significantly improves WSS across five benchmarks (VOC: 79.8\%, COCO: 53.9\%, Context: 49.0\%, ADE: 32.9\%, Stuff: 37.4\%), reducing the gap with fully supervised methods by over 84\% on the VOC validation set. Code is available at https://github.com/shjo-april/DHR. △ Less

Submitted 19 May, 2024; v1 submitted 30 March, 2024; originally announced April 2024.

Angular analysis of $B \to K^* e^+ e^-$ in the low-$q^2$ region with new electron identification at Belle

Authors: Belle Collaboration, D. Ferlewicz, P. Urquijo, I. Adachi, K. Adamczyk, H. Aihara, D. M. Asner, H. Atmacan, R. Ayad, V. Babu, Sw. Banerjee, P. Behera, K. Belous, J. Bennett, M. Bessner, V. Bhardwaj, B. Bhuyan, T. Bilka, D. Biswas, D. Bodrov, M. Bračko, P. Branchini, T. E. Browder, A. Budano, M. Campajola , et al. (145 additional authors not shown)

Abstract: We perform an angular analysis of the $B\to K^* e^+ e^-$ decay for the dielectron mass squared, $q^2$, range of $0.0008$ to $1.1200 ~\text{GeV}^2 /c^4$ using the full Belle data set in the $K^{*0} \to K^+ π^-$ and $K^{*+} \to K_S^0 π^+$ channels, incorporating new methods of electron identification to improve the statistical power of the data set. This analysis is sensitive to contributions from r… ▽ More We perform an angular analysis of the $B\to K^* e^+ e^-$ decay for the dielectron mass squared, $q^2$, range of $0.0008$ to $1.1200 ~\text{GeV}^2 /c^4$ using the full Belle data set in the $K^{*0} \to K^+ π^-$ and $K^{*+} \to K_S^0 π^+$ channels, incorporating new methods of electron identification to improve the statistical power of the data set. This analysis is sensitive to contributions from right-handed currents from physics beyond the Standard Model by constraining the Wilson coefficients $\mathcal{C}_7^{(\prime)}$. We perform a fit to the $B\to K^* e^+ e^-$ differential decay rate and measure the imaginary component of the transversality amplitude to be $A_T^{\rm Im} = -1.27 \pm 0.52 \pm 0.12$, and the $K^*$ transverse asymmetry to be $A_T^{(2)} = 0.52 \pm 0.53 \pm 0.11$. The resulting constraints on the value of $\mathcal{C}_7^{\prime}$ are consistent with the Standard Model within a $2σ$ confidence interval. △ Less

Submitted 2 April, 2024; v1 submitted 29 March, 2024; originally announced April 2024.

Comments: Submitted to PRD

Report number: Belle preprint 2023-20, KEK preprint 2023-38

The Hall of Singularity: VR Experience of Prophecy by AI

Authors: Jisu Kim, Kirak Kim

Abstract: "The Hall of Singularity" is an immersive art that creates personalized experiences of receiving prophecies from an AI deity through an integration of Artificial Intelligence (AI) and Virtual Reality (VR). As a metaphor for the mythologizing of AI in our society, "The Hall of Singularity" offers an immersive quasi-religious experience where individuals can encounter an AI that has the power to mak… ▽ More "The Hall of Singularity" is an immersive art that creates personalized experiences of receiving prophecies from an AI deity through an integration of Artificial Intelligence (AI) and Virtual Reality (VR). As a metaphor for the mythologizing of AI in our society, "The Hall of Singularity" offers an immersive quasi-religious experience where individuals can encounter an AI that has the power to make prophecies. This journey enables users to experience and imagine a world with an omnipotent AI deity. △ Less

Submitted 22 March, 2024; originally announced April 2024.

Comments: 3 pages, 4 figures

MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation

Authors: Seyeon Kim, Siyoon Jin, Jihye Park, Kihong Kim, Jiyoung Kim, Jisu Nam, Seungryong Kim

Abstract: Conventional GAN-based models for talking head generation often suffer from limited quality and unstable training. Recent approaches based on diffusion models aimed to address these limitations and improve fidelity. However, they still face challenges, including extensive sampling times and difficulties in maintaining temporal consistency due to the high stochasticity of diffusion models. To overc… ▽ More Conventional GAN-based models for talking head generation often suffer from limited quality and unstable training. Recent approaches based on diffusion models aimed to address these limitations and improve fidelity. However, they still face challenges, including extensive sampling times and difficulties in maintaining temporal consistency due to the high stochasticity of diffusion models. To overcome these challenges, we propose a novel motion-disentangled diffusion model for high-quality talking head generation, dubbed MoDiTalker. We introduce the two modules: audio-to-motion (AToM), designed to generate a synchronized lip motion from audio, and motion-to-video (MToV), designed to produce high-quality head video following the generated motion. AToM excels in capturing subtle lip movements by leveraging an audio attention mechanism. In addition, MToV enhances temporal consistency by leveraging an efficient tri-plane representation. Our experiments conducted on standard benchmarks demonstrate that our model achieves superior performance compared to existing models. We also provide comprehensive ablation studies and user study results. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Role of hidden-color components in the tetraquark mixing model

Authors: Hungchong Kim, K. S. Kim

Abstract: Multiquarks can have two-hadron components and hidden-color components in their wave functions. The presence of two-hadron components in multiquarks introduces a potential source of confusion, particularly with respect to their resemblance to hadronic molecules. On the other hand, hidden-color components are essential for distinguishing between multiquarks and hadronic molecules. In this work, we… ▽ More Multiquarks can have two-hadron components and hidden-color components in their wave functions. The presence of two-hadron components in multiquarks introduces a potential source of confusion, particularly with respect to their resemblance to hadronic molecules. On the other hand, hidden-color components are essential for distinguishing between multiquarks and hadronic molecules. In this work, we study the hidden-color components in the wave functions of the tetraquark mixing model, a model that has been proposed as a suitable framework for describing the properties of two nonets in the $J^P=0^+$ channel: the light nonet [$a_0 (980)$, $K_0^* (700)$, $f_0 (500)$, $f_0 (980)$] and the heavy nonet [$a_0 (1450)$, $K_0^* (1430)$, $f_0 (1370)$, $f_0 (1500)$]. Our analysis reveals a substantial presence of hidden-color components within the tetraquark wave functions. To elucidate the impact of hidden-color components on physical quantities, we conduct computations of the hyperfine masses, $\langle V_{CS}\rangle$, for the two nonets, considering scenarios involving only the two-meson components and those incorporating the hidden-color components. We demonstrate that the hidden-color components constitute an important part of the hyperfine masses, such that the mass difference formula, $ΔM\approx Δ\langle V_{CS}\rangle$, which has been successful for the two nonets, cannot be achieved without the hidden-color contributions. This can provide another evidence supporting the tetraquark nature of the two nonets. △ Less

Submitted 29 June, 2024; v1 submitted 27 March, 2024; originally announced March 2024.

Comments: 10 pages, no figure. The version accepted for publication in EPJC

BlendX: Complex Multi-Intent Detection with Blended Patterns

Authors: Yejin Yoon, Jungyeon Lee, Kangsan Kim, Chanhee Park, Taeuk Kim

Abstract: Task-oriented dialogue (TOD) systems are commonly designed with the presumption that each utterance represents a single intent. However, this assumption may not accurately reflect real-world situations, where users frequently express multiple intents within a single utterance. While there is an emerging interest in multi-intent detection (MID), existing in-domain datasets such as MixATIS and MixSN… ▽ More Task-oriented dialogue (TOD) systems are commonly designed with the presumption that each utterance represents a single intent. However, this assumption may not accurately reflect real-world situations, where users frequently express multiple intents within a single utterance. While there is an emerging interest in multi-intent detection (MID), existing in-domain datasets such as MixATIS and MixSNIPS have limitations in their formulation. To address these issues, we present BlendX, a suite of refined datasets featuring more diverse patterns than their predecessors, elevating both its complexity and diversity. For dataset construction, we utilize both rule-based heuristics as well as a generative tool -- OpenAI's ChatGPT -- which is augmented with a similarity-driven strategy for utterance selection. To ensure the quality of the proposed datasets, we also introduce three novel metrics that assess the statistical properties of an utterance related to word count, conjunction use, and pronoun usage. Extensive experiments on BlendX reveal that state-of-the-art MID models struggle with the challenges posed by the new datasets, highlighting the need to reexamine the current state of the MID field. The dataset is available at https://github.com/HYU-NLP/BlendX. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: Accepted to LREC-COLING2024

Enhanced extracellular matrix remodeling due to embedded spheroid fluidization

Authors: Tao Zhang, Shabeeb Ameen, Sounok Ghosh, Kyungeun Kim, Minh Thanh, Alison E. Patteson, Mingming Wu, J. M. Schwarz

Abstract: Tumor spheroids are in vitro three-dimensional, cellular collectives consisting of cancerous cells. Embedding these spheroids in an in vitro fibrous environment, such as a collagen network, to mimic the extracellular matrix (ECM) provides an essential platform to quantitatively investigate the biophysical mechanisms leading to tumor invasion of the ECM. To understand the mechanical interplay betwe… ▽ More Tumor spheroids are in vitro three-dimensional, cellular collectives consisting of cancerous cells. Embedding these spheroids in an in vitro fibrous environment, such as a collagen network, to mimic the extracellular matrix (ECM) provides an essential platform to quantitatively investigate the biophysical mechanisms leading to tumor invasion of the ECM. To understand the mechanical interplay between tumor spheroids and the ECM, we computationally construct and study a three-dimensional vertex model for a tumor spheroid that is mechanically coupled to a cross-linked network of fibers. In such a vertex model, cells are represented as deformable polyhedrons that share faces. Some fraction of the boundary faces of the tumor spheroid contain linker springs connecting the center of the boundary face to the nearest node in the fiber network. As these linker springs actively contract, the fiber network remodels. By toggling between fluid-like and solid-like spheroids via changing the dimensionless cell shape index, we find that the spheroid rheology affects the remodeling of the fiber network. More precisely, fluid-like spheroids displace the fiber network more on average near the vicinity of the spheroid than solid-like spheroids. We also find more densification of the fiber network near the spheroid for the fluid-like spheroids. These spheroid rheology-dependent effects are the result of cellular motility due to active cellular rearrangements that emerge over time in the fluid-like spheroids to generate spheroid shape fluctuations. Our results uncover intricate morphological-mechanical interplay between an embedded spheroid and its surrounding fiber network with both spheroid contractile strength and spheroid shape fluctuations playing important roles in the pre-invasion stages of tumor invasion. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: 19 pages, 12 figures, 7 SI figures

ESG Classification by Implicit Rule Learning via GPT-4

Authors: Hyo Jeong Yun, Chanyoung Kim, Moonjeong Hahm, Kyuri Kim, Guijin Son

Abstract: Environmental, social, and governance (ESG) factors are widely adopted as higher investment return indicators. Accordingly, ongoing efforts are being made to automate ESG evaluation with language models to extract signals from massive web text easily. However, recent approaches suffer from a lack of training data, as rating agencies keep their evaluation metrics confidential. This paper investigat… ▽ More Environmental, social, and governance (ESG) factors are widely adopted as higher investment return indicators. Accordingly, ongoing efforts are being made to automate ESG evaluation with language models to extract signals from massive web text easily. However, recent approaches suffer from a lack of training data, as rating agencies keep their evaluation metrics confidential. This paper investigates whether state-of-the-art language models like GPT-4 can be guided to align with unknown ESG evaluation criteria through strategies such as prompting, chain-of-thought reasoning, and dynamic in-context learning. We demonstrate the efficacy of these approaches by ranking 2nd in the Shared-Task ML-ESG-3 Impact Type track for Korean without updating the model on the provided training data. We also explore how adjusting prompts impacts the ability of language models to address financial tasks leveraging smaller models with openly available weights. We observe longer general pre-training to correlate with enhanced performance in financial downstream tasks. Our findings showcase the potential of language models to navigate complex, subjective evaluation guidelines despite lacking explicit training examples, revealing opportunities for training-free solutions for financial downstream tasks. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: Accepted as Shared Track Paper at 7th FinNLP Workshop @ LREC-COLING 2024

A two-dimensional vertex model for curvy cell-cell interfaces at the subcellular scale

Authors: Kyungeun Kim, J. M. Schwarz, Martine Ben Amar

Abstract: Cross-sections of cell shapes in a tissue monolayer typically resemble a tiling of convex polygons. Yet, examples exist where the polygons are not convex with curved cell-cell interfaces, as seen in the adaxial epidermis. To date, two-dimensional vertex models predicting the structure and mechanics of cell monolayers have been mostly limited to convex polygons. To overcome this limitation, we intr… ▽ More Cross-sections of cell shapes in a tissue monolayer typically resemble a tiling of convex polygons. Yet, examples exist where the polygons are not convex with curved cell-cell interfaces, as seen in the adaxial epidermis. To date, two-dimensional vertex models predicting the structure and mechanics of cell monolayers have been mostly limited to convex polygons. To overcome this limitation, we introduce a framework to study curvy cell-cell interfaces at the subcellular scale within vertex models by using a parameterized curve between vertices that is expanded in a Fourier series and whose coefficients represent additional degrees of freedom. This extension to non-convex polygons allows for cells with same shape index, or dimensionless perimeter, to be, for example, either elongated or globular with lobes. In the presence of applied, anisotropic stresses, we find that local, subcellular curvature, or buckling, can be energetically more favorable than larger scale deformations involving groups of cells. Inspired by recent experiments, we also find that local, subcellular curvature at cell-cell interfaces emerges in a group of cells in response to the swelling of additional cells surrounding the group. Our framework, therefore, can account for a wider array of multi-cellular responses to constraints in the tissue environment. △ Less

Submitted 18 June, 2024; v1 submitted 21 March, 2024; originally announced March 2024.

Comments: 18 pages, 16 figures

K-Act2Emo: Korean Commonsense Knowledge Graph for Indirect Emotional Expression

Authors: Kyuhee Kim, Surin Lee, Sangah Lee

Abstract: In many literary texts, emotions are indirectly conveyed through descriptions of actions, facial expressions, and appearances, necessitating emotion inference for narrative understanding. In this paper, we introduce K-Act2Emo, a Korean commonsense knowledge graph (CSKG) comprising 1,900 indirect emotional expressions and the emotions inferable from them. We categorize reasoning types into inferenc… ▽ More In many literary texts, emotions are indirectly conveyed through descriptions of actions, facial expressions, and appearances, necessitating emotion inference for narrative understanding. In this paper, we introduce K-Act2Emo, a Korean commonsense knowledge graph (CSKG) comprising 1,900 indirect emotional expressions and the emotions inferable from them. We categorize reasoning types into inferences in positive situations, inferences in negative situations, and inferences when expressions do not serve as emotional cues. Unlike existing CSKGs, K-Act2Emo specializes in emotional contexts, and experimental results validate its effectiveness for training emotion inference models. Significantly, the BART-based knowledge model fine-tuned with K-Act2Emo outperforms various existing Korean large language models, achieving performance levels comparable to GPT-4 Turbo. △ Less

Submitted 23 March, 2024; v1 submitted 21 March, 2024; originally announced March 2024.

Comments: 10 pages

OTSeg: Multi-prompt Sinkhorn Attention for Zero-Shot Semantic Segmentation

Authors: Kwanyoung Kim, Yujin Oh, Jong Chul Ye

Abstract: The recent success of CLIP has demonstrated promising results in zero-shot semantic segmentation by transferring muiltimodal knowledge to pixel-level classification. However, leveraging pre-trained CLIP knowledge to closely align text embeddings with pixel embeddings still has limitations in existing approaches. To address this issue, we propose OTSeg, a novel multimodal attention mechanism aimed… ▽ More The recent success of CLIP has demonstrated promising results in zero-shot semantic segmentation by transferring muiltimodal knowledge to pixel-level classification. However, leveraging pre-trained CLIP knowledge to closely align text embeddings with pixel embeddings still has limitations in existing approaches. To address this issue, we propose OTSeg, a novel multimodal attention mechanism aimed at enhancing the potential of multiple text prompts for matching associated pixel embeddings. We first propose Multi-Prompts Sinkhorn (MPS) based on the Optimal Transport (OT) algorithm, which leads multiple text prompts to selectively focus on various semantic features within image pixels. Moreover, inspired by the success of Sinkformers in unimodal settings, we introduce the extension of MPS, called Multi-Prompts Sinkhorn Attention (MPSA) , which effectively replaces cross-attention mechanisms within Transformer framework in multimodal settings. Through extensive experiments, we demonstrate that OTSeg achieves state-of-the-art (SOTA) performance with significant gains on Zero-Shot Semantic Segmentation (ZS3) tasks across three benchmark datasets. △ Less

Submitted 11 July, 2024; v1 submitted 21 March, 2024; originally announced March 2024.

Comments: ECCV 2024; 23 pages, 8 tables, 8 figures; Project Page: https://cubeyoung.github.io/OTSeg_project/

Empowering Personalized Learning through a Conversation-based Tutoring System with Student Modeling

Authors: Minju Park, Sojung Kim, Seunghyun Lee, Soonwoo Kwon, Kyuseok Kim

Abstract: As the recent Large Language Models(LLM's) become increasingly competent in zero-shot and few-shot reasoning across various domains, educators are showing a growing interest in leveraging these LLM's in conversation-based tutoring systems. However, building a conversation-based personalized tutoring system poses considerable challenges in accurately assessing the student and strategically incorpor… ▽ More As the recent Large Language Models(LLM's) become increasingly competent in zero-shot and few-shot reasoning across various domains, educators are showing a growing interest in leveraging these LLM's in conversation-based tutoring systems. However, building a conversation-based personalized tutoring system poses considerable challenges in accurately assessing the student and strategically incorporating the assessment into teaching within the conversation. In this paper, we discuss design considerations for a personalized tutoring system that involves the following two key components: (1) a student modeling with diagnostic components, and (2) a conversation-based tutor utilizing LLM with prompt engineering that incorporates student assessment outcomes and various instructional strategies. Based on these design considerations, we created a proof-of-concept tutoring system focused on personalization and tested it with 20 participants. The results substantiate that our system's framework facilitates personalization, with particular emphasis on the elements constituting student modeling. A web demo of our system is available at http://rlearning-its.com. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: Accepted to ACM CHI 2024 LBW

Quantum Chaos on Edge

Authors: Alexander Altland, Kun Woo Kim, Tobias Micklitz, Maedeh Rezaei, Julian Sonner, Jacobus J. M. Verbaarschot

Abstract: In recent years, the physics of many-body quantum chaotic systems close to their ground states has come under intensified scrutiny. Such studies are motivated by the emergence of model systems exhibiting chaotic fluctuations throughout the entire spectrum (the Sachdev-Ye-Kitaev (SYK) model being a renowned representative) as well as by the physics of holographic principles, which likewise unfold c… ▽ More In recent years, the physics of many-body quantum chaotic systems close to their ground states has come under intensified scrutiny. Such studies are motivated by the emergence of model systems exhibiting chaotic fluctuations throughout the entire spectrum (the Sachdev-Ye-Kitaev (SYK) model being a renowned representative) as well as by the physics of holographic principles, which likewise unfold close to ground states. Interpreting the edge of the spectrum as a quantum critical point, here we combine a wide range of analytical and numerical methods to the identification and comprehensive description of two different universality classes: the near edge physics of ``sparse'' and the near edge of ``dense'' chaotic systems. The distinction lies in the ratio between the number of a system's random parameters and its Hilbert space dimension, which is exponentially small or algebraically small in the sparse and dense case, respectively. Notable representatives of the two classes are generic chaotic many-body models (sparse) and single particle systems, invariant random matrix ensembles, or chaotic gravitational systems (dense). While the two families share identical spectral correlations at energy scales comparable to the level spacing, the density of states and its fluctuations near the edge are different. Considering the SYK model as a representative of the sparse class, we apply a combination of field theory and exact diagonalization to a detailed discussion of its edge spectrum. Conversely, Jackiw-Teitelboim gravity is our reference model for the dense class, where an analysis of the gravitational path integral and random matrix theory reveal universal differences to the sparse class, whose implications for the construction of holographic principles we discuss. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: 22 pages, 11 figures

Multi-State, Ultra-thin, BEOL-Compatible AlScN Ferroelectric Diodes

Authors: Kwan-Ho Kim, Zirun Han, Yinuo Zhang, Pariasadat Musavigharavi, Jeffrey Zheng, Dhiren K. Pradhan, Eric A. Stach, Roy H. Olsson III, Deep Jariwala

Abstract: The growth in data generation necessitates efficient data processing technologies to address the von Neumann bottleneck in conventional computer architecture. Memory-driven computing, which integrates non-volatile memory (NVM) devices in a 3D stack, is gaining attention, with CMOS back-end-of-line (BEOL) compatible ferroelectric (FE) diodes being ideal due to their two-terminal design and inherent… ▽ More The growth in data generation necessitates efficient data processing technologies to address the von Neumann bottleneck in conventional computer architecture. Memory-driven computing, which integrates non-volatile memory (NVM) devices in a 3D stack, is gaining attention, with CMOS back-end-of-line (BEOL) compatible ferroelectric (FE) diodes being ideal due to their two-terminal design and inherently selector-free nature, facilitating high-density crossbar arrays. Here, we demonstrate BEOL-compatible, high-performance FE-diodes scaled to 5, 10, and 20 nm FE Al0.72Sc0.28N/Al0.64Sc0.36N films. Through interlayer (IL) engineering, we show substantial improvements in the ON/OFF ratios (>166 times) and rectification ratios (>176 times) in these scaled devices. The superlative characteristics also enables 5-bit multi-state operation with a stable retention. We also experimentally and theoretically demonstrate the counterintuitive result that the inclusion of an IL can lead to a decrease in the ferroelectric switching voltage of the device. An in-depth analysis into the device transport mechanisms is performed, and our compact model aligns seamlessly with the experimental results. Our results suggest the possibility of using scaled AlxSc1-xN FE-diodes for high performance, low-power, embedded NVM. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Reinforcement Learning from Delayed Observations via World Models

Authors: Armin Karamzade, Kyungmin Kim, Montek Kalsi, Roy Fox

Abstract: In standard reinforcement learning settings, agents typically assume immediate feedback about the effects of their actions after taking them. However, in practice, this assumption may not hold true due to physical constraints and can significantly impact the performance of learning algorithms. In this paper, we address observation delays in partially observable environments. We propose leveraging… ▽ More In standard reinforcement learning settings, agents typically assume immediate feedback about the effects of their actions after taking them. However, in practice, this assumption may not hold true due to physical constraints and can significantly impact the performance of learning algorithms. In this paper, we address observation delays in partially observable environments. We propose leveraging world models, which have shown success in integrating past observations and learning dynamics, to handle observation delays. By reducing delayed POMDPs to delayed MDPs with world models, our methods can effectively handle partial observability, where existing approaches achieve sub-optimal performance or degrade quickly as observability decreases. Experiments suggest that one of our methods can outperform a naive model-based approach by up to 250%. Moreover, we evaluate our methods on visual delayed environments, for the first time showcasing delay-aware reinforcement learning continuous control with visual observations. △ Less

Submitted 25 June, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

A clock with $8\times10^{-19}$ systematic uncertainty

Authors: Alexander Aeppli, Kyungtae Kim, William Warfield, Marianna S. Safronova, Jun Ye

Abstract: We report an optical lattice clock with a total systematic uncertainty of $8.1 \times 10^{-19}$ in fractional frequency units, representing the lowest uncertainty of any clock to date. The clock relies on interrogating the ultra-narrow ${}^1S_0 \rightarrow {}^3P_0$ transition in a dilute ensemble of fermionic strontium atoms trapped in a vertically-oriented, shallow, one-dimensional optical lattic… ▽ More We report an optical lattice clock with a total systematic uncertainty of $8.1 \times 10^{-19}$ in fractional frequency units, representing the lowest uncertainty of any clock to date. The clock relies on interrogating the ultra-narrow ${}^1S_0 \rightarrow {}^3P_0$ transition in a dilute ensemble of fermionic strontium atoms trapped in a vertically-oriented, shallow, one-dimensional optical lattice. Using imaging spectroscopy, we previously demonstrated record high atomic coherence time and measurement precision enabled by precise control of collisional shifts and the lattice light shift. In this work, we revise the black body radiation shift correction by evaluating the $5s4d$ $^3D_1$ lifetime, necessitating precise characterization and control of many body effects in the $5s4d$ $^3D_1$ decay. Lastly, we measure the second order Zeeman coefficient on the least magnetically sensitive clock transition. All other systematic effects have uncertainties below $1 \times 10^{-19}$. △ Less

Submitted 8 June, 2024; v1 submitted 15 March, 2024; originally announced March 2024.

Disordered non-Fermi liquid fixed point for two-dimensional metals at Ising-nematic quantum critical points

Authors: Kyoung-Min Kim, Ki-Seok Kim

Abstract: Understanding the influence of quenched random potential is crucial for comprehending the exotic electronic transport of non-Fermi liquid metals near metallic quantum critical points. In this study, we identify a stable fixed point governing the quantum critical behavior of two-dimensional non-Fermi liquid metals in the presence of a random potential disorder. By performing renormalization group a… ▽ More Understanding the influence of quenched random potential is crucial for comprehending the exotic electronic transport of non-Fermi liquid metals near metallic quantum critical points. In this study, we identify a stable fixed point governing the quantum critical behavior of two-dimensional non-Fermi liquid metals in the presence of a random potential disorder. By performing renormalization group analysis on a dimensional-regularized field theory for Ising-nematic quantum critical points, we systematically investigate the interplay between random potential disorder for electrons and Yukawa-type interactions between electrons and bosonic order-parameter fluctuations in a perturbative epsilon expansion. At the one-loop order, the effective field theory lacks stable fixed points, instead exhibiting a runaway flow toward infinite disorder strength. However, at the two-loop order, the effective field theory converges to a stable fixed point characterized by finite disorder strength, termed the "disordered non-Fermi liquid (DNFL) fixed point." Our investigation reveals that two-loop vertex corrections induced by Yukawa couplings are pivotal in the emergence of the DNFL fixed point, primarily through screening disorder scattering. Additionally, the DNFL fixed point is distinguished by a substantial anomalous scaling dimension of fermion fields, resulting in pseudogap-like behavior in the electron's density of states. These findings shed light on the quantum critical behavior of disordered non-Fermi liquid metals, emphasizing the indispensable role of higher-order loop corrections in such comprehension. △ Less

Submitted 8 May, 2024; v1 submitted 15 March, 2024; originally announced March 2024.

Comments: arXiv admin note: text overlap with arXiv:1905.08442

BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation

Authors: Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, Wensi Ai, Benjamin Martinez, Hang Yin, Michael Lingelbach, Minjune Hwang, Ayano Hiranaka, Sujay Garlanka, Arman Aydin, Sharon Lee, Jiankai Sun, Mona Anvari, Manasi Sharma, Dhruva Bansal, Samuel Hunter, Kyu-Young Kim, Alan Lou, Caleb R Matthews , et al. (10 additional authors not shown)

Abstract: We present BEHAVIOR-1K, a comprehensive simulation benchmark for human-centered robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an extensive survey on "what do you want robots to do for you?". The first is the definition of 1,000 everyday activities, grounded in 50 scenes (houses, gardens, restaurants, offices, etc.) with more than 9,000 objects annotated with… ▽ More We present BEHAVIOR-1K, a comprehensive simulation benchmark for human-centered robotics. BEHAVIOR-1K includes two components, guided and motivated by the results of an extensive survey on "what do you want robots to do for you?". The first is the definition of 1,000 everyday activities, grounded in 50 scenes (houses, gardens, restaurants, offices, etc.) with more than 9,000 objects annotated with rich physical and semantic properties. The second is OMNIGIBSON, a novel simulation environment that supports these activities via realistic physics simulation and rendering of rigid bodies, deformable bodies, and liquids. Our experiments indicate that the activities in BEHAVIOR-1K are long-horizon and dependent on complex manipulation skills, both of which remain a challenge for even state-of-the-art robot learning solutions. To calibrate the simulation-to-reality gap of BEHAVIOR-1K, we provide an initial study on transferring solutions learned with a mobile manipulator in a simulated apartment to its real-world counterpart. We hope that BEHAVIOR-1K's human-grounded nature, diversity, and realism make it valuable for embodied AI and robot learning research. Project website: https://behavior.stanford.edu. △ Less

Submitted 14 March, 2024; originally announced March 2024.

Comments: A preliminary version was published at 6th Conference on Robot Learning (CoRL 2022)

Influence of cholesterol on hydrogen-bond dynamics of water molecules in lipid-bilayer systems at varying temperatures

Authors: Kokoro Shikata, Kento Kasahara, Nozomi Morishita Watanabe, Hiroshi Umakoshi, Kang Kim, Nobuyuki Matubayasi

Abstract: Cholesterol (Chol) plays a crucial role in shaping the intricate physicochemical attributes of biomembranes, exerting considerable influence on water molecules proximal to the membrane interface. In this study, we conducted molecular dynamics simulations on the bilayers of two lipid species, dipalmitoyl phosphatidylcholine (DPPC) and palmitoyl sphingomyelin (PSM); they are distinct with respect to… ▽ More Cholesterol (Chol) plays a crucial role in shaping the intricate physicochemical attributes of biomembranes, exerting considerable influence on water molecules proximal to the membrane interface. In this study, we conducted molecular dynamics simulations on the bilayers of two lipid species, dipalmitoyl phosphatidylcholine (DPPC) and palmitoyl sphingomyelin (PSM); they are distinct with respect to the structures of the hydrogen-bond (H-bond) acceptors. Our investigation focuses on the dynamic properties and H-bonds of water molecules in the lipid-membrane systems, with particular emphasis on the influence of Chol at varying temperatures. Notably, in the gel phase at 303 K, the presence of Chol extends the lifetimes of H-bonds of the oxygen atoms acting as H-bond acceptors within DPPC with water molecules by a factor of 1.5 to 2.5. In the liquid-crystalline phase at 323 K, on the other hand, H-bonding dynamics with lipid membranes remain largely unaffected by Chol. This observed shift in H-bonding states serves as a crucial key to unraveling the subtle control mechanisms governing water dynamics in lipid-membrane systems. △ Less

Submitted 3 July, 2024; v1 submitted 13 March, 2024; originally announced March 2024.

Comments: 10 pages, 8 figures, 1 table for main text, 13 pages for supplementary material, to appear in J. Chem. Phys

Journal ref: J. Chem. Phys. 161, 015102 (2024)

Time Series Analysis of Key Societal Events as Reflected in Complex Social Media Data Streams

Authors: Andy Skumanich, Han Kyul Kim

Abstract: Social media platforms hold valuable insights, yet extracting essential information can be challenging. Traditional top-down approaches often struggle to capture critical signals in rapidly changing events. As global events evolve swiftly, social media narratives, including instances of disinformation, become significant sources of insights. To address the need for an inductive strategy, we explor… ▽ More Social media platforms hold valuable insights, yet extracting essential information can be challenging. Traditional top-down approaches often struggle to capture critical signals in rapidly changing events. As global events evolve swiftly, social media narratives, including instances of disinformation, become significant sources of insights. To address the need for an inductive strategy, we explore a niche social media platform GAB and an established messaging service Telegram, to develop methodologies applicable on a broader scale. This study investigates narrative evolution on these platforms using quantitative corpus-based discourse analysis techniques. Our approach is a novel mode to study multiple social media domains to distil key information which may be obscured otherwise, allowing for useful and actionable insights. The paper details the technical and methodological aspects of gathering and preprocessing GAB and Telegram data for a keyness (Log Ratio) metric analysis, identifying crucial nouns and verbs for deeper exploration. Empirically, this approach is applied to a case study of a well defined event that had global impact: the 2023 Wagner mutiny. The main findings are: (1) the time line can be deconstructed to provide useful data features allowing for improved interpretation; (2) a methodology is applied which provides a basis for generalization. The key contribution is an approach, that in some cases, provides the ability to capture the dynamic narrative shifts over time with elevated confidence. The approach can augment near-real-time assessment of key social movements, allowing for informed governance choices. This research is important because it lays out a useful methodology for time series relevant info-culling, which can enable proactive modes for positive social engagement. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: AAAI2024 Workshop on AI for Time Series Analysis (AI4TS)

Exploring the Impact of ChatGPT on Student Interactions in Computer-Supported Collaborative Learning

Authors: Han Kyul Kim, Shriniwas Nayak, Aleyeh Roknaldin, Xiaoci Zhang, Marlon Twyman, Stephen Lu

Abstract: The growing popularity of generative AI, particularly ChatGPT, has sparked both enthusiasm and caution among practitioners and researchers in education. To effectively harness the full potential of ChatGPT in educational contexts, it is crucial to analyze its impact and suitability for different educational purposes. This paper takes an initial step in exploring the applicability of ChatGPT in a c… ▽ More The growing popularity of generative AI, particularly ChatGPT, has sparked both enthusiasm and caution among practitioners and researchers in education. To effectively harness the full potential of ChatGPT in educational contexts, it is crucial to analyze its impact and suitability for different educational purposes. This paper takes an initial step in exploring the applicability of ChatGPT in a computer-supported collaborative learning (CSCL) environment. Using statistical analysis, we validate the shifts in student interactions during an asynchronous group brainstorming session by introducing ChatGPT as an instantaneous question-answering agent. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: AAAI2024 Workshop on AI for Education (AI4ED)

Unveiling the Significance of Toddler-Inspired Reward Transition in Goal-Oriented Reinforcement Learning

Authors: Junseok Park, Yoonsung Kim, Hee Bin Yoo, Min Whoo Lee, Kibeom Kim, Won-Seok Choi, Minsu Lee, Byoung-Tak Zhang

Abstract: Toddlers evolve from free exploration with sparse feedback to exploiting prior experiences for goal-directed learning with denser rewards. Drawing inspiration from this Toddler-Inspired Reward Transition, we set out to explore the implications of varying reward transitions when incorporated into Reinforcement Learning (RL) tasks. Central to our inquiry is the transition from sparse to potential-ba… ▽ More Toddlers evolve from free exploration with sparse feedback to exploiting prior experiences for goal-directed learning with denser rewards. Drawing inspiration from this Toddler-Inspired Reward Transition, we set out to explore the implications of varying reward transitions when incorporated into Reinforcement Learning (RL) tasks. Central to our inquiry is the transition from sparse to potential-based dense rewards, which share optimal strategies regardless of reward changes. Through various experiments, including those in egocentric navigation and robotic arm manipulation tasks, we found that proper reward transitions significantly influence sample efficiency and success rates. Of particular note is the efficacy of the toddler-inspired Sparse-to-Dense (S2D) transition. Beyond these performance metrics, using Cross-Density Visualizer technique, we observed that transitions, especially the S2D, smooth the policy loss landscape, promoting wide minima that enhance generalization in RL models. △ Less

Submitted 18 March, 2024; v1 submitted 11 March, 2024; originally announced March 2024.

Comments: Accepted as a full paper at AAAI 2024 (Oral presentation): 7 pages (main paper), 2 pages (references), 17 pages (appendix) each

UNICORN: Ultrasound Nakagami Imaging via Score Matching and Adaptation

Authors: Kwanyoung Kim, Jaa-Yeon Lee, Jong Chul Ye

Abstract: Nakagami imaging holds promise for visualizing and quantifying tissue scattering in ultrasound waves, with potential applications in tumor diagnosis and fat fraction estimation which are challenging to discern by conventional ultrasound B-mode images. Existing methods struggle with optimal window size selection and suffer from estimator instability, leading to degraded resolution images. To addres… ▽ More Nakagami imaging holds promise for visualizing and quantifying tissue scattering in ultrasound waves, with potential applications in tumor diagnosis and fat fraction estimation which are challenging to discern by conventional ultrasound B-mode images. Existing methods struggle with optimal window size selection and suffer from estimator instability, leading to degraded resolution images. To address this, here we propose a novel method called UNICORN (Ultrasound Nakagami Imaging via Score Matching and Adaptation), that offers an accurate, closed-form estimator for Nakagami parameter estimation in terms of the score function of ultrasonic envelope. Extensive experiments using simulation and real ultrasound RF data demonstrate UNICORN's superiority over conventional approaches in accuracy and resolution quality. △ Less

Submitted 10 March, 2024; originally announced March 2024.

Comments: 12 pages, 5 figure

Multiphysics Modeling of Surface Diffusion Coupled with Large Deformation in 3D Solids

Authors: Jaemin Kim, Keon Ho Kim, Nikolaos Bouklas

Abstract: We present a comprehensive theoretical and computational model that explores the behavior of a thin hydrated film bonded to a non-hydrated / impermeable soft substrate in the context of surface and bulk elasticity coupled with surface diffusion kinetics. This type of coupling can manifests as an integral aspect in diverse engineering processes encountered in optical interference coatings, tissue e… ▽ More We present a comprehensive theoretical and computational model that explores the behavior of a thin hydrated film bonded to a non-hydrated / impermeable soft substrate in the context of surface and bulk elasticity coupled with surface diffusion kinetics. This type of coupling can manifests as an integral aspect in diverse engineering processes encountered in optical interference coatings, tissue engineering, soft electronics, and can prove important in design process for the next generation of sensors and actuators, especially as the focus is shifted to systems in smaller lengthscales. The intricate interplay between solvent diffusion and deformation of the film is governed by surface poroelasticity, and the viscoelastic deformation of the substrate. While existing methodologies offer tools for studying coupled poroelasticity involving solvent diffusion and network deformation, there exists a gap in understanding how coupled poroelastic processes occurring in a film attached to the boundary of a highly deformable solid can influence its response. In this study, we introduce a non-equilibrium thermodynamics formulation encompassing the multiphysical processes of surface poroelasticity and bulk viscoelasticity, complemented by a corresponding finite element implementation. Our approach captures the complex dynamics between the finite deformation of the substrate and solvent diffusion on the surface. This work contributes valuable insights, particularly in scenarios where the coupling of surface diffusion kinetics and substrate elasticity is an important design factor. △ Less

Submitted 9 March, 2024; originally announced March 2024.

Comments: 20 pages, 8 figues. arXiv admin note: text overlap with arXiv:2305.08805

DeepVM: Integrating Spot and On-Demand VMs for Cost-Efficient Deep Learning Clusters in the Cloud

Authors: Yoochan Kim, Kihyun Kim, Yonghyeon Cho, Jinwoo Kim, Awais Khan, Ki-Dong Kang, Baik-Song An, Myung-Hoon Cha, Hong-Yeon Kim, Youngjae Kim

Abstract: Distributed Deep Learning (DDL), as a paradigm, dictates the use of GPU-based clusters as the optimal infrastructure for training large-scale Deep Neural Networks (DNNs). However, the high cost of such resources makes them inaccessible to many users. Public cloud services, particularly Spot Virtual Machines (VMs), offer a cost-effective alternative, but their unpredictable availability poses a sig… ▽ More Distributed Deep Learning (DDL), as a paradigm, dictates the use of GPU-based clusters as the optimal infrastructure for training large-scale Deep Neural Networks (DNNs). However, the high cost of such resources makes them inaccessible to many users. Public cloud services, particularly Spot Virtual Machines (VMs), offer a cost-effective alternative, but their unpredictable availability poses a significant challenge to the crucial checkpointing process in DDL. To address this, we introduce DeepVM, a novel solution that recommends cost-effective cluster configurations by intelligently balancing the use of Spot and On-Demand VMs. DeepVM leverages a four-stage process that analyzes instance performance using the FLOPP (FLoating-point Operations Per Price) metric, performs architecture-level analysis with linear programming, and identifies the optimal configuration for the user-specific needs. Extensive simulations and real-world deployments in the AWS environment demonstrate that DeepVM consistently outperforms other policies, reducing training costs and overall makespan. By enabling cost-effective checkpointing with Spot VMs, DeepVM opens up DDL to a wider range of users and facilitates a more efficient training of complex DNNs. △ Less

Submitted 14 March, 2024; v1 submitted 9 March, 2024; originally announced March 2024.

Comments: 14 pages, 8 figures

Paving the Way for Pass Disturb Free Vertical NAND Storage via A Dedicated and String-Compatible Pass Gate

Authors: Zijian Zhao, Sola Woo, Khandker Akif Aabrar, Sharadindu Gopal Kirtania, Zhouhang Jiang, Shan Deng, Yi Xiao, Halid Mulaosmanovic, Stefan Duenkel, Dominik Kleimaier, Steven Soss, Sven Beyer, Rajiv Joshi, Scott Meninger, Mohamed Mohamed, Kijoon Kim, Jongho Woo, Suhwan Lim, Kwangsoo Kim, Wanki Kim, Daewon Ha, Vijaykrishnan Narayanan, Suman Datta, Shimeng Yu, Kai Ni

Abstract: In this work, we propose a dual-port cell design to address the pass disturb in vertical NAND storage, which can pass signals through a dedicated and string-compatible pass gate. We demonstrate that: i) the pass disturb-free feature originates from weakening of the depolarization field by the pass bias at the high-${V}_{TH}$ (HVT) state and the screening of the applied field by channel at the low-… ▽ More In this work, we propose a dual-port cell design to address the pass disturb in vertical NAND storage, which can pass signals through a dedicated and string-compatible pass gate. We demonstrate that: i) the pass disturb-free feature originates from weakening of the depolarization field by the pass bias at the high-${V}_{TH}$ (HVT) state and the screening of the applied field by channel at the low-${V}_{TH}$ (LVT) state; ii) combined simulations and experimental demonstrations of dual-port design verify the disturb-free operation in a NAND string, overcoming a key challenge in single-port designs; iii) the proposed design can be incorporated in a highly scaled vertical NAND FeFET string and the pass gate can be incorporated into the existing 3D NAND with the negligible overhead of the pass gate interconnection through a global bottom pass gate contact in the substrate. △ Less

Submitted 7 March, 2024; originally announced March 2024.

Comments: 29 pages, 7 figures

Search for a pentaquark state decaying into $pJ/ψ$ in $Υ(1,2S)$ inclusive decays at Belle

Authors: Belle Collaboration, X. Dong, H. Y. Zhang, X. L. Wang, I. Adachi, J. K. Ahn, H. Aihara, S. Al Said, D. M. Asner, H. Atmacan, R. Ayad, S. Bahinipati, Sw. Banerjee, M. Bessner, V. Bhardwaj, D. Biswas, D. Bodrov, A. Bozek, M. Bračko, P. Branchini, T. E. Browder, A. Budano, M. Campajola, D. Červenkov, M. -C. Chang , et al. (139 additional authors not shown)

Abstract: Using the data samples of 102 million $Υ(1S)$ and 158 million $Υ(2S)$ events collected by the Belle detector, we search for a pentaquark state in the $pJ/ψ$ final state from $Υ(1,2S)$ inclusive decays. Here, the charge-conjugate $\bar{p}J/ψ$ is included. We observe clear $pJ/ψ$ production in $Υ(1,2S)$ decays and measure the branching fractions to be… ▽ More Using the data samples of 102 million $Υ(1S)$ and 158 million $Υ(2S)$ events collected by the Belle detector, we search for a pentaquark state in the $pJ/ψ$ final state from $Υ(1,2S)$ inclusive decays. Here, the charge-conjugate $\bar{p}J/ψ$ is included. We observe clear $pJ/ψ$ production in $Υ(1,2S)$ decays and measure the branching fractions to be $\mathcal{B}[Υ(1S) \to pJ/ψ+ anything] = [4.27 \pm 0.16(stat.) \pm 0.20(syst.)] \times 10^{-5}$ and $\mathcal{B}[Υ(2S) \to pJ/ψ+ anything] = [3.59 \pm 0.14(stat.) \pm 0.16(syst.)] \times 10^{-5}$. We also measure the cross section of inclusive $pJ/ψ$ production in $e^+e^-$ annihilation to be $σ(e^+e^- \to pJ/ψ+ anything) = [57.5 \pm 2.1 (stat.) \pm 2.5(syst.)]$~fb at $\sqrt{s} = 10.52~\hbox{GeV}$ using an 89.5~fb$^{-1}$ continuum data sample. There is no significant $P_c(4312)^+$, $P_c(4440)^+$ or $P_c(4457)^+$ signal found in the $pJ/ψ$ final states in $Υ(1,2S)$ inclusive decays. We determine the upper limits of $\mathcal{B}[Υ(1,2S)\to P_c^{+} + anything] \cdot \mathcal{B}(P_c^{+}\to pJ/ψ)$ to be at the $10^{-6}$ level. △ Less

Submitted 11 March, 2024; v1 submitted 7 March, 2024; originally announced March 2024.

Report number: Belle Preprint 2024-02, KEK Preprint 2023-54

Beneath the Surface: Revealing Deep-Tissue Blood Flow in Human Subjects with Massively Parallelized Diffuse Correlation Spectroscopy

Authors: Lucas Kreiss, Melissa Wu, Michael Wayne, Shiqi Xu, Paul McKee, Derrick Dwamena, Kanghyun Kim, Kyung Chul Lee, Wenhui Liu, Aarin Ulku, Mark Harfouche, Xi Yang, Clare Cook, Amey Chaware, Seung Ah Lee, Erin Buckley, Claudio Bruschini, Edoardo Charbon, Scott Huettel, Roarke Horstmeyer

Abstract: Diffuse Correlation Spectroscopy (DCS) allows the label-free investigation of microvascular dynamics deep within living tissue. However, common implementations of DCS are currently limited to measurement depths of $\sim 1-1.5cm$, which can limit the accuracy of cerebral hemodynamics measurement. Here we present massively parallelized DCS (pDCS) using novel single photon avalanche detector (SPAD) a… ▽ More Diffuse Correlation Spectroscopy (DCS) allows the label-free investigation of microvascular dynamics deep within living tissue. However, common implementations of DCS are currently limited to measurement depths of $\sim 1-1.5cm$, which can limit the accuracy of cerebral hemodynamics measurement. Here we present massively parallelized DCS (pDCS) using novel single photon avalanche detector (SPAD) arrays with up to 500x500 individual channels. The new SPAD array technology can boost the signal-to-noise ratio by a factor of up to 500 compared to single-pixel DCS, or by more than 15-fold compared to the most recent state-of-the-art pDCS demonstrations. Our results demonstrate the first in vivo use of this massively parallelized DCS system to measure cerebral blood flow changes at $\sim 2cm$ depth in human adults. We compared different modes of operation and applied a dual detection strategy, where a secondary SPAD array is used to simultaneously assess the superficial blood flow as a built-in reference measurement. While the blood flow in the superficial scalp tissue showed no significant change during cognitive activation, the deep pDCS measurement showed a statistically significant increase in the derived blood flow index of 8-12% when compared to the control rest state. △ Less

Submitted 25 June, 2024; v1 submitted 6 March, 2024; originally announced March 2024.

Operational Space and Plasma Performance with an RMP-ELM Suppressed Edge

Authors: C. Paz-Soldan, S. Gu, N. Leuthold, P. Lunia, P. Xie, M. W. Kim, S. K. Kim, N. C. Logan, J. -K. Park, W. Suttrop, Y. Sun, D. B. Weisberg, M. Willensdorfer, the ASDEX-Upgrade, DIII-D, EAST, KSTAR Teams

Abstract: The operational space and global performance of plasmas with edge-localized modes (ELMs) suppressed by resonant magnetic perturbations (RMPs) are surveyed by comparing AUG, DIII-D, EAST, and KSTAR stationary operating points. RMP-ELM suppression is achieved over a range of plasma currents, toroidal fields, and RMP toroidal mode numbers. Consistent operational windows in edge safety factor are foun… ▽ More The operational space and global performance of plasmas with edge-localized modes (ELMs) suppressed by resonant magnetic perturbations (RMPs) are surveyed by comparing AUG, DIII-D, EAST, and KSTAR stationary operating points. RMP-ELM suppression is achieved over a range of plasma currents, toroidal fields, and RMP toroidal mode numbers. Consistent operational windows in edge safety factor are found across devices, while windows in plasma shaping parameters are distinct. Accessed pedestal parameters reveal a quantitatively similar pedestal-top density limit for RMP-ELM suppression in all devices of just over 3x1019 m-3. This is surprising given the wide variance of many engineering parameters and edge collisionalities, and poses a challenge to extrapolation of the regime. Wide ranges in input power, confinement time, and stored energy are observed, with the achieved triple product found to scale like the product of current, field, and radius. Observed energy confinement scaling with engineering parameters for RMP-ELM suppressed plasmas are presented and compared with expectations from established H and L-mode scalings, including treatment of uncertainty analysis. Different scaling exponents for individual engineering parameters are found as compared to the established scalings. However, extrapolation to next-step tokamaks ITER and SPARC find overall consistency within uncertainties with the established scalings, finding no obvious performance penalty when extrapolating from the assembled multi-device RMP-ELM suppressed database. Overall this work identifies common physics for RMP-ELM suppression and highlights the need to pursue this no-ELM regime at higher magnetic field and different plasma physical size. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: 22 pages, 11 figures

Pushing single atoms near an optical cavity

Authors: Dowon Lee, Taegyu Ha, Donggeon Kim, Keumhyun Kim, Kyungwon An, Moonjoo Lee

Abstract: Optical scattering force is used to reduce the loading time of single atoms to a cavity mode. Releasing a cold atomic ensemble above the resonator, we apply a push beam along the direction of gravity, offering fast atomic transport with narrow velocity distribution. We also observe in real time that, when the push beam is illuminated against gravity, single atoms slow down and even turn around in… ▽ More Optical scattering force is used to reduce the loading time of single atoms to a cavity mode. Releasing a cold atomic ensemble above the resonator, we apply a push beam along the direction of gravity, offering fast atomic transport with narrow velocity distribution. We also observe in real time that, when the push beam is illuminated against gravity, single atoms slow down and even turn around in the mode, through the cavity-transmission measurement. Our method can be employed to make atom-cavity experiments more efficient. △ Less

Submitted 20 March, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Comments: 11 pages, 6 figures

Ultralight vector dark matter search using data from the KAGRA O3GK run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, A. G. Abac, R. Abbott, H. Abe, I. Abouelfettouh, F. Acernese, K. Ackley, C. Adamcewicz, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, I. Aguilar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi , et al. (1778 additional authors not shown)

Abstract: Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we prese… ▽ More Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we present the result of a search for $U(1)_{B-L}$ gauge boson DM using the KAGRA data from auxiliary length channels during the first joint observation run together with GEO600. By applying our search pipeline, which takes into account the stochastic nature of ultralight DM, upper bounds on the coupling strength between the $U(1)_{B-L}$ gauge boson and ordinary matter are obtained for a range of DM masses. While our constraints are less stringent than those derived from previous experiments, this study demonstrates the applicability of our method to the lower-mass vector DM search, which is made difficult in this measurement by the short observation time compared to the auto-correlation time scale of DM. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Comments: 20 pages, 5 figures

Report number: LIGO-P2300250

Search for a $μ^+μ^-$ resonance in four-muon final states at Belle II

Authors: Belle II Collaboration, I. Adachi, K. Adamczyk, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, V. Aushev, M. Aversano, R. Ayad, V. Babu, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, S. Bansal, M. Barrett, J. Baudot, A. Baur, A. Beaubien, F. Becherer , et al. (379 additional authors not shown)

Abstract: We report on a search for a resonance $X$ decaying to a pair of muons in $e^{+}e^{-}\rightarrow μ^+ μ^- X$ events in the 0.212-9.000 GeV/$c^{2}$ mass range, using 178 fb$^{-1}$ of data collected by the BelleII experiment at the SuperKEKB collider at a center of mass energy of 10.58 GeV. The analysis probes two different models of $X$ beyond the standard model: a $Z^{\prime}$ vector boson in the… ▽ More We report on a search for a resonance $X$ decaying to a pair of muons in $e^{+}e^{-}\rightarrow μ^+ μ^- X$ events in the 0.212-9.000 GeV/$c^{2}$ mass range, using 178 fb$^{-1}$ of data collected by the BelleII experiment at the SuperKEKB collider at a center of mass energy of 10.58 GeV. The analysis probes two different models of $X$ beyond the standard model: a $Z^{\prime}$ vector boson in the $L_μ-L_τ$ model and a muonphilic scalar. We observe no evidence for a signal and set exclusion limits at the 90$\%$ confidence level on the products of cross section and branching fraction for these processes, ranging from 0.046 fb to 0.97 fb for the $L_μ-L_τ$ model and from 0.055 fb to 1.3 fb for the muonphilic scalar model. For masses below 6 GeV/$c^{2}$, the corresponding constraints on the couplings of these processes to the standard model range from 0.0008 to 0.039 for the $L_μ-L_τ$ model and from 0.0018 to 0.040 for the muonphilic scalar model. These are the first constraints on the muonphilic scalar from a dedicated search. △ Less

Submitted 26 June, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Report number: 2024-007, 2023-55

Journal ref: Phys. Rev. D 109, 112015 (2024)

Strain tunable electronic ground states in two-dimensional iridate thin films

Authors: Donghan Kim, Byungmin Sohn, Yeonjae Lee, Jeongkeun Song, Mi Kyung Kim, Minjae Kim, Tae Won Noh, Changyoung Kim

Abstract: Quantum phases of matter such as superconducting, ferromagnetic and Wigner crystal states are often driven by the two-dimensionality (2D) of correlated systems. Meanwhile, spin-orbit coupling (SOC) is a fundamental element leading to nontrivial topology which gives rise to quantum phenomena such as the large anomalous Hall effect and nontrivial superconductivity. However, the search for controllab… ▽ More Quantum phases of matter such as superconducting, ferromagnetic and Wigner crystal states are often driven by the two-dimensionality (2D) of correlated systems. Meanwhile, spin-orbit coupling (SOC) is a fundamental element leading to nontrivial topology which gives rise to quantum phenomena such as the large anomalous Hall effect and nontrivial superconductivity. However, the search for controllable platforms with both 2D and SOC has been relatively overlooked so far. Here, we control and study the electronic ground states of iridate ultrathin films having both 2D and SOC by angle-resolved photoemission spectroscopy (ARPES) and dynamical mean field theory (DMFT) calculations. The metallicity of SrIrO$_3$ ultrathin films is controlled down to a monolayer by dimensional and strain manipulation. Our results suggest that the iridate ultrathin films can be a controllable 2D SOC platform exhibiting a variety of phenomena for future functional devices. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Comments: 7 pages, 4 figures

Measurement of $CP$ asymmetries in $B^0 \rightarrow K^0_S K^0_S K^0_S$ decays at Belle II

Authors: Belle II Collaboration, I. Adachi, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, T. Aushev, V. Aushev, M. Aversano, R. Ayad, V. Babu, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, S. Bansal, M. Barrett, J. Baudot, M. Bauer, A. Baur, A. Beaubien , et al. (428 additional authors not shown)

Abstract: We report a measurement of decay-time dependent charge-parity ($CP$) asymmetries in $B^0 \rightarrow K^0_S K^0_S K^0_S$ decays. We use $387 \times 10^6 B\bar{B}$ pairs collected at the $Υ(4S)$ resonance with the Belle II detector at the SuperKEKB asymmetric-energy electron-positron collider. We reconstruct 220 signal events and extract the $CP$-violating parameters $S$ and $C$ from a fit to the di… ▽ More We report a measurement of decay-time dependent charge-parity ($CP$) asymmetries in $B^0 \rightarrow K^0_S K^0_S K^0_S$ decays. We use $387 \times 10^6 B\bar{B}$ pairs collected at the $Υ(4S)$ resonance with the Belle II detector at the SuperKEKB asymmetric-energy electron-positron collider. We reconstruct 220 signal events and extract the $CP$-violating parameters $S$ and $C$ from a fit to the distribution of the decay-time difference between the two $B$ mesons. The resulting confidence region is consistent with previous measurements in $B^0 \rightarrow K^0_S K^0_S K^0_S$ and $B^0 \rightarrow (c\bar{c})K^0$ decays, and with predictions based on the standard model. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Comments: 10 pages, 5 figures

Report number: Belle II Preprint 2024-008, KEK Preprint 2023-56

Global shift symmetry on ADM hypersurface: Towards emergent "gravity"

Authors: Ki-Seok Kim, Arpita Mitra, Debangshu Mukherjee, Mitsuhiro Nishida

Abstract: Generalized symmetries and their spontaneous breakdown serve as the fundamental concept to constrain the many-body entanglement structure, which allows us to characterize quantum phases of matter and emergent collective excitations. For example, emergent photons may be understood by spontaneous 1-form symmetry breaking, which results from a long-ranged entanglement structure between UV microscopic… ▽ More Generalized symmetries and their spontaneous breakdown serve as the fundamental concept to constrain the many-body entanglement structure, which allows us to characterize quantum phases of matter and emergent collective excitations. For example, emergent photons may be understood by spontaneous 1-form symmetry breaking, which results from a long-ranged entanglement structure between UV microscopic degrees of freedom. In this study, we show that emergent ``gravity" may also arise in a similar fashion, where ``" has been used to emphasize that the symmetry-constrained gravitons show unconventional properties compared to usual gravitons. As the electric 1-form symmetry in Maxwell theory is realized as a global shift symmetry of the spatial component of the U(1) gauge field, generated by the electric field, we demonstrate that a constant shift of the ADM metric on the spatial hypersurface can be viewed as a global symmetry, generated by the ADM canonical momentum. Deriving a vector-type conserved charge from the variation of action, we construct a shift symmetry operator. Considering a Wick rotation, we demonstrate that a gravitational Wilson loop is charged under the action of this shift symmetry operator, which thus confirms the existence of a generalized global symmetry on the ADM hypersurface. Based on the Ward identity, we show that the spontaneous breaking of this global shift symmetry may give rise to a non-propagating massless symmetric gauge field at the boundary of the hypersurface. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Comments: 12 pages, no figure

Abatement of Ionizing Radiation for Superconducting Quantum Devices

Authors: B. Loer, P. M. Harrington, B. Archambault, E. Fuller, B. Pierson, I. Arnquist, K. Harouaka, T. D. Schlieder, D. K. Kim, A. J. Melville, B. M. Niedzielski, J. K. Yoder, K. Serniak, W. D. Oliver, J. L. Orrell, R. Bunker, B. A. VanDevender, M. Warner

Abstract: Ionizing radiation has been shown to reduce the performance of superconducting quantum circuits. In this report, we evaluate the expected contributions of different sources of ambient radioactivity for typical superconducting qubit experiment platforms. Our assessment of radioactivity inside a typical cryostat highlights the importance of selecting appropriate materials for the experiment componen… ▽ More Ionizing radiation has been shown to reduce the performance of superconducting quantum circuits. In this report, we evaluate the expected contributions of different sources of ambient radioactivity for typical superconducting qubit experiment platforms. Our assessment of radioactivity inside a typical cryostat highlights the importance of selecting appropriate materials for the experiment components nearest to qubit devices, such as packaging and electrical interconnects. We present a shallow underground facility (30-meter water equivalent) to reduce the flux of cosmic rays and a lead shielded cryostat to abate the naturally occurring radiogenic gamma-ray flux in the laboratory environment. We predict that superconducting qubit devices operated in this facility could experience a reduced rate of correlated multi-qubit errors by a factor of approximately 20 relative to the rate in a typical above-ground, unshielded facility. Finally, we outline overall design improvements that would be required to further reduce the residual ionizing radiation rate, down to the limit of current generation direct detection dark matter experiments. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 36 pages, 9 figures, 9 tables including appendices. To be submitted to the Journal of Instrumentation

Robust Policy Learning via Offline Skill Diffusion

Authors: Woo Kyung Kim, Minjong Yoo, Honguk Woo

Abstract: Skill-based reinforcement learning (RL) approaches have shown considerable promise, especially in solving long-horizon tasks via hierarchical structures. These skills, learned task-agnostically from offline datasets, can accelerate the policy learning process for new tasks. Yet, the application of these skills in different domains remains restricted due to their inherent dependency on the datasets… ▽ More Skill-based reinforcement learning (RL) approaches have shown considerable promise, especially in solving long-horizon tasks via hierarchical structures. These skills, learned task-agnostically from offline datasets, can accelerate the policy learning process for new tasks. Yet, the application of these skills in different domains remains restricted due to their inherent dependency on the datasets, which poses a challenge when attempting to learn a skill-based policy via RL for a target domain different from the datasets' domains. In this paper, we present a novel offline skill learning framework DuSkill which employs a guided Diffusion model to generate versatile skills extended from the limited skills in datasets, thereby enhancing the robustness of policy learning for tasks in different domains. Specifically, we devise a guided diffusion-based skill decoder in conjunction with the hierarchical encoding to disentangle the skill embedding space into two distinct representations, one for encapsulating domain-invariant behaviors and the other for delineating the factors that induce domain variations in the behaviors. Our DuSkill framework enhances the diversity of skills learned offline, thus enabling to accelerate the learning procedure of high-level policies for different domains. Through experiments, we show that DuSkill outperforms other skill-based imitation learning and RL algorithms for several long-horizon tasks, demonstrating its benefits in few-shot imitation and online RL. △ Less

Submitted 5 March, 2024; v1 submitted 29 February, 2024; originally announced March 2024.

Comments: Accepted for AAAI 2024

A Scalable and Transferable Time Series Prediction Framework for Demand Forecasting

Authors: Young-Jin Park, Donghyun Kim, Frédéric Odermatt, Juho Lee, Kyung-Min Kim

Abstract: Time series forecasting is one of the most essential and ubiquitous tasks in many business problems, including demand forecasting and logistics optimization. Traditional time series forecasting methods, however, have resulted in small models with limited expressive power because they have difficulty in scaling their model size up while maintaining high accuracy. In this paper, we propose Forecasti… ▽ More Time series forecasting is one of the most essential and ubiquitous tasks in many business problems, including demand forecasting and logistics optimization. Traditional time series forecasting methods, however, have resulted in small models with limited expressive power because they have difficulty in scaling their model size up while maintaining high accuracy. In this paper, we propose Forecasting orchestra (Forchestra), a simple but powerful framework capable of accurately predicting future demand for a diverse range of items. We empirically demonstrate that the model size is scalable to up to 0.8 billion parameters. The proposed method not only outperforms existing forecasting models with a significant margin, but it could generalize well to unseen data points when evaluated in a zero-shot fashion on downstream datasets. Last but not least, we present extensive qualitative and quantitative studies to analyze how the proposed model outperforms baseline models and differs from conventional approaches. The original paper was presented as a full paper at ICDM 2022 and is available at: https://ieeexplore.ieee.org/document/10027662. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Comments: Published as a full paper at ICDM 2022

Connections between Planetary Populations and the Chemical Characteristics of their Host Stars

Authors: Sol Yun, Young Sun Lee, Young Kwang Kim, Timothy C. Beers, Togay Berfin, Dongwook Lim

Abstract: Chemical anomalies in planet-hosting stars (PHSs) are studied in order to assess how the planetary nature and multiplicity affect the atmospheric chemical abundances of their host stars. We employ APOGEE DR17 to select thin-disk stars of the Milky Way, and cross-match them with the Kepler Input Catalog to identify confirmed PHSs, which results in 227 PHSs with available chemical-abundance ratios f… ▽ More Chemical anomalies in planet-hosting stars (PHSs) are studied in order to assess how the planetary nature and multiplicity affect the atmospheric chemical abundances of their host stars. We employ APOGEE DR17 to select thin-disk stars of the Milky Way, and cross-match them with the Kepler Input Catalog to identify confirmed PHSs, which results in 227 PHSs with available chemical-abundance ratios for six refractory elements. We also examine an ensemble of stars without planet signals, which are equivalent to the selected PHSs in terms of evolutionary stage and stellar parameters, to correct for Galactic chemical-evolution effects, and derive the abundance gradient of refractory elements over the condensation temperature for the PHSs. Using the Galactic chemical-evolution corrected abundances, we found that PHSs do not show a significant difference in abundance slope from the stars without planets. Furthermore, we examine the depletion trends of refractory elements of PHSs depending on total number of planets and their types, and find that the PHSs with giant planets are more depleted in refractory elements than those with rocky planets. Among the PHSs with rocky planets, the refractory-depletion trends are potentially correlated with the terrestrial planets' radii and multiplicity. In the cases of PHSs with giant planets, sub-Jovian PHSs demonstrated more depleted refractory trends than stars hosting Jovian-mass planets, raising questions on different planetary-formation processes for Neptune-like and Jupiter-like planets. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Comments: 14 pages, 6 figures

Multi-Fidelity Residual Neural Processes for Scalable Surrogate Modeling

Authors: Ruijia Niu, Dongxia Wu, Kai Kim, Yi-An Ma, Duncan Watson-Parris, Rose Yu

Abstract: Multi-fidelity surrogate modeling aims to learn an accurate surrogate at the highest fidelity level by combining data from multiple sources. Traditional methods relying on Gaussian processes can hardly scale to high-dimensional data. Deep learning approaches utilize neural network based encoders and decoders to improve scalability. These approaches share encoded representations across fidelities w… ▽ More Multi-fidelity surrogate modeling aims to learn an accurate surrogate at the highest fidelity level by combining data from multiple sources. Traditional methods relying on Gaussian processes can hardly scale to high-dimensional data. Deep learning approaches utilize neural network based encoders and decoders to improve scalability. These approaches share encoded representations across fidelities without including corresponding decoder parameters. This hinders inference performance, especially in out-of-distribution scenarios when the highest fidelity data has limited domain coverage. To address these limitations, we propose Multi-fidelity Residual Neural Processes (MFRNP), a novel multi-fidelity surrogate modeling framework. MFRNP explicitly models the residual between the aggregated output from lower fidelities and ground truth at the highest fidelity. The aggregation introduces decoders into the information sharing step and optimizes lower fidelity decoders to accurately capture both in-fidelity and cross-fidelity information. We show that MFRNP significantly outperforms state-of-the-art in learning partial differential equations and a real-world climate modeling task. Our code is published at: https://github.com/Rose-STL-Lab/MFRNP △ Less

Submitted 24 June, 2024; v1 submitted 28 February, 2024; originally announced February 2024.

Comments: A novel probabilistic inference approach for scalable multi-fidelity surrogate modeling

SparseLLM: Towards Global Pruning for Pre-trained Language Models

Authors: Guangji Bai, Yijiang Li, Chen Ling, Kibaek Kim, Liang Zhao

Abstract: The transformative impact of large language models (LLMs) like LLaMA and GPT on natural language processing is countered by their prohibitive computational demands. Pruning has emerged as a pivotal compression strategy, introducing sparsity to enhance both memory and computational efficiency. Yet, traditional global pruning is impractical for LLMs due to scalability issues, while local pruning, de… ▽ More The transformative impact of large language models (LLMs) like LLaMA and GPT on natural language processing is countered by their prohibitive computational demands. Pruning has emerged as a pivotal compression strategy, introducing sparsity to enhance both memory and computational efficiency. Yet, traditional global pruning is impractical for LLMs due to scalability issues, while local pruning, despite its efficiency, leads to suboptimal solutions. Addressing these challenges, we propose SparseLLM, a novel framework that redefines the global pruning process into manageable, coordinated subproblems, allowing for resource-efficient optimization with global optimality. SparseLLM's approach, which conceptualizes LLMs as a chain of modular functions and leverages auxiliary variables for problem decomposition, not only facilitates a pragmatic application on LLMs but also demonstrates significant performance improvements, particularly in high-sparsity regimes where it surpasses current state-of-the-art methods. △ Less

Submitted 23 May, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Comments: Preprint. Under review