Showing 1–50 of 608 results for author: Cha, S

CAMP: Continuous and Adaptive Learning Model in Pathology

Authors: Anh Tien Nguyen, Keunho Byeon, Kyungeun Kim, Boram Song, Seoung Wan Chae, Jin Tae Kwak

Abstract: There exist numerous diagnostic tasks in pathology. Conventional computational pathology formulates and tackles them as independent and individual image classification problems, thereby resulting in computational inefficiency and high costs. To address the challenges, we propose a generic, unified, and universal framework, called a continuous and adaptive learning model in pathology (CAMP), for pa… ▽ More There exist numerous diagnostic tasks in pathology. Conventional computational pathology formulates and tackles them as independent and individual image classification problems, thereby resulting in computational inefficiency and high costs. To address the challenges, we propose a generic, unified, and universal framework, called a continuous and adaptive learning model in pathology (CAMP), for pathology image classification. CAMP is a generative, efficient, and adaptive classification model that can continuously adapt to any classification task by leveraging pathology-specific prior knowledge and learning taskspecific knowledge with minimal computational cost and without forgetting the knowledge from the existing tasks. We evaluated CAMP on 22 datasets, including 1,171,526 patches and 11,811 pathology slides, across 17 classification tasks. CAMP achieves state-of-theart classification performance on a wide range of datasets and tasks at both patch- and slide-levels and reduces up to 94% of computation time and 85% of storage memory in comparison to the conventional classification models. Our results demonstrate that CAMP can offer a fundamental transformation in pathology image classification, paving the way for the fully digitized and computerized pathology practice. △ Less

Submitted 12 July, 2024; originally announced July 2024.

Comments: Under review

Enhancing resonant second harmonic generation in bilayer WSe2 by layer-dependent exciton-polaron effect

Authors: Soonyoung Cha, Tianyi Ouyang, Takashi Taniguchi, Kenji Watanabe, Nathaniel M. Gabor, Chun Hung Lui

Abstract: Two-dimensional (2D) materials serve as exceptional platforms for controlled second harmonic generation (SHG), an important nonlinear optical phenomenon with diverse applications. Current approaches to SHG control often depend on non-resonant conditions or symmetry breaking via single-gate control. Here, we employ dual-gate bilayer WSe2 to demonstrate a new SHG enhancement concept that leverages s… ▽ More Two-dimensional (2D) materials serve as exceptional platforms for controlled second harmonic generation (SHG), an important nonlinear optical phenomenon with diverse applications. Current approaches to SHG control often depend on non-resonant conditions or symmetry breaking via single-gate control. Here, we employ dual-gate bilayer WSe2 to demonstrate a new SHG enhancement concept that leverages strong exciton resonance and layer-dependent exciton-polaron effect. By selectively localizing injected holes within one layer, we induce exciton-polaron states in the hole-filled layer while maintaining normal exciton states in the charge-neutral layer. The distinct resonant conditions of these layers effectively break interlayer inversion symmetry, thereby promoting resonant SHG. Our method achieves a remarkable 40-fold enhancement of SHG at minimal electric field, equivalent to conditions near the dielectric-breakdown threshold but using only ~3% of the critical breakdown field. Our findings also reveal significant sensitivity of resonant SHG to carrier density and carrier type, with distinct enhancement and quenching observed across different gating regimes. This advancement offers an innovative approach to manipulating SHG in 2D excitonic materials and provides a potent spectroscopic tool for probing layer-dependent quantum states. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Four microlensing giant planets detected through signals produced by minor-image perturbations

Authors: Cheongho Han, Ian A. Bond, Chung-Uk Lee, Andrew Gould, Michael D. Albrow, Sun-Ju Chung, Kyu-Ha Hwang, Youn Kil Jung, Yoon-Hyun Ryu, Yossi Shvartzvald, In-Gu Shin, Jennifer C. Yee, Hongjing Yang, Weicheng Zang, Sang-Mok Cha, Doeon Kim, Dong-Jin Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Fumio Abe, Ken Bando, Richard Barry , et al. (41 additional authors not shown)

Abstract: We investigated the nature of the anomalies appearing in four microlensing events KMT-2020-BLG-0757, KMT-2022-BLG-0732, KMT-2022-BLG-1787, and KMT-2022-BLG-1852. The light curves of these events commonly exhibit initial bumps followed by subsequent troughs that extend across a substantial portion of the light curves. We performed thorough modeling of the anomalies to elucidate their characteristic… ▽ More We investigated the nature of the anomalies appearing in four microlensing events KMT-2020-BLG-0757, KMT-2022-BLG-0732, KMT-2022-BLG-1787, and KMT-2022-BLG-1852. The light curves of these events commonly exhibit initial bumps followed by subsequent troughs that extend across a substantial portion of the light curves. We performed thorough modeling of the anomalies to elucidate their characteristics. Despite their prolonged durations, which differ from the usual brief anomalies observed in typical planetary events, our analysis revealed that each anomaly in these events originated from a planetary companion located within the Einstein ring of the primary star. It was found that the initial bump arouse when the source star crossed one of the planetary caustics, while the subsequent trough feature occurred as the source traversed the region of minor image perturbations lying between the pair of planetary caustics. The estimated masses of the host and planet, their mass ratios, and the distance to the discovered planetary systems are $(M_{\rm host}/M_\odot, M_{\rm planet}/M_{\rm J}, q/10^{-3}, \dl/{\rm kpc}) = (0.58^{+0.33}_{-0.30}, 10.71^{+6.17}_{-5.61}, 17.61\pm 2.25,6.67^{+0.93}_{-1.30})$ for KMT-2020-BLG-0757, $(0.53^{+0.31}_{-0.31}, 1.12^{+0.65}_{-0.65}, 2.01 \pm 0.07, 6.66^{+1.19}_{-1.84})$ for KMT-2022-BLG-0732, $(0.42^{+0.32}_{-0.23}, 6.64^{+4.98}_{-3.64}, 15.07\pm 0.86, 7.55^{+0.89}_{-1.30})$ for KMT-2022-BLG-1787, and $(0.32^{+0.34}_{-0.19}, 4.98^{+5.42}_{-2.94}, 8.74\pm 0.49, 6.27^{+0.90}_{-1.15})$ for KMT-2022-BLG-1852. These parameters indicate that all the planets are giants with masses exceeding the mass of Jupiter in our solar system and the hosts are low-mass stars with masses substantially less massive than the Sun. △ Less

Submitted 15 June, 2024; originally announced June 2024.

Comments: 10 pages, 12 figures, 7 tables

What is the Best Way for ChatGPT to Translate Poetry?

Authors: Shanshan Wang, Derek F. Wong, Jingming Yao, Lidia S. Chao

Abstract: Machine translation (MT) has historically faced significant challenges when applied to literary works, particularly in the domain of poetry translation. The advent of Large Language Models such as ChatGPT holds potential for innovation in this field. This study examines ChatGPT's capabilities in English-Chinese poetry translation tasks, utilizing targeted prompts and small sample scenarios to asce… ▽ More Machine translation (MT) has historically faced significant challenges when applied to literary works, particularly in the domain of poetry translation. The advent of Large Language Models such as ChatGPT holds potential for innovation in this field. This study examines ChatGPT's capabilities in English-Chinese poetry translation tasks, utilizing targeted prompts and small sample scenarios to ascertain optimal performance. Despite promising outcomes, our analysis reveals persistent issues in the translations generated by ChatGPT that warrant attention. To address these shortcomings, we propose an Explanation-Assisted Poetry Machine Translation (EAPMT) method, which leverages monolingual poetry explanation as a guiding information for the translation process. Furthermore, we refine existing evaluation criteria to better suit the nuances of modern poetry translation. We engaged a panel of professional poets for assessments, complemented evaluations by using GPT-4. The results from both human and machine evaluations demonstrate that our EAPMT method outperforms traditional translation methods of ChatGPT and the existing online systems. This paper validates the efficacy of our method and contributes a novel perspective to machine-assisted literary translation. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 19 pages, 1 figure. The paper has been accepted by ACL 2024(Main Conference)

FOCUS: Forging Originality through Contrastive Use in Self-Plagiarism for Language Models

Authors: Kaixin Lan, Tao Fang, Derek F. Wong, Yabo Xu, Lidia S. Chao, Cecilia G. Zhao

Abstract: Pre-trained Language Models (PLMs) have shown impressive results in various Natural Language Generation (NLG) tasks, such as powering chatbots and generating stories. However, an ethical concern arises due to their potential to produce verbatim copies of paragraphs from their training data. This is problematic as PLMs are trained on corpora constructed by human authors. As such, there is a pressin… ▽ More Pre-trained Language Models (PLMs) have shown impressive results in various Natural Language Generation (NLG) tasks, such as powering chatbots and generating stories. However, an ethical concern arises due to their potential to produce verbatim copies of paragraphs from their training data. This is problematic as PLMs are trained on corpora constructed by human authors. As such, there is a pressing need for research to promote the generation of original content by these models. In this study, we introduce a unique "self-plagiarism" contrastive decoding strategy, aimed at boosting the originality of text produced by PLMs. Our method entails modifying prompts in LLMs to develop an amateur model and a professional model. Specifically, the amateur model is urged to plagiarize using three plagiarism templates we have designed, while the professional model maintains its standard language model status. This strategy employs prompts to stimulate the model's capacity to identify non-original candidate token combinations and subsequently impose penalties. The application of this strategy is integrated prior to the model's final layer, ensuring smooth integration with most existing PLMs (T5, GPT, LLaMA) without necessitating further adjustments. Implementing our strategy, we observe a significant decline in non-original sequences comprised of more than three words in the academic AASC dataset and the story-based ROCStories dataset. △ Less

Submitted 2 June, 2024; originally announced June 2024.

Comments: 16 pages, 8 figures. The paper has been accepted by ACL 2024 (Findings), with Kaixin Lan and Tao Fang contributing equally, and Derek F. Wong serving as the corresponding author

Learning Discriminative Dynamics with Label Corruption for Noisy Label Detection

Authors: Suyeon Kim, Dongha Lee, SeongKu Kang, Sukang Chae, Sanghwan Jang, Hwanjo Yu

Abstract: Label noise, commonly found in real-world datasets, has a detrimental impact on a model's generalization. To effectively detect incorrectly labeled instances, previous works have mostly relied on distinguishable training signals, such as training loss, as indicators to differentiate between clean and noisy labels. However, they have limitations in that the training signals incompletely reveal the… ▽ More Label noise, commonly found in real-world datasets, has a detrimental impact on a model's generalization. To effectively detect incorrectly labeled instances, previous works have mostly relied on distinguishable training signals, such as training loss, as indicators to differentiate between clean and noisy labels. However, they have limitations in that the training signals incompletely reveal the model's behavior and are not effectively generalized to various noise types, resulting in limited detection accuracy. In this paper, we propose DynaCor framework that distinguishes incorrectly labeled instances from correctly labeled ones based on the dynamics of the training signals. To cope with the absence of supervision for clean and noisy labels, DynaCor first introduces a label corruption strategy that augments the original dataset with intentionally corrupted labels, enabling indirect simulation of the model's behavior on noisy labels. Then, DynaCor learns to identify clean and noisy instances by inducing two clearly distinguishable clusters from the latent representations of training dynamics. Our comprehensive experiments show that DynaCor outperforms the state-of-the-art competitors and shows strong robustness to various noise types and noise rates. △ Less

Submitted 30 May, 2024; originally announced May 2024.

Comments: Accepted to CVPR 2024

KMT-2023-BLG-2669: Ninth Free-floating Planet Candidate with $θ_{\rm E}$ measurements

Authors: Youn Kil Jung, Kyu-Ha Hwang, Hongjing Yang, Andrew Gould, Jennifer C. Yee, Cheongho Han, Michael D. Albrow, Sun-Ju Chung, Yoon-Hyun Ryu, In-Gu Shin, Yossi Shvartzvald, Weicheng Zang, Sang-Mok Cha, Dong-Jin Kim, Seung-Lee Kim, Chung-Uk Lee, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge

Abstract: We report a free-floating planet (FFP) candidate identified from the analysis of the microlensing event KMT-2023-BLG-2669. The lensing light curve is characterized by a short duration $(\lesssim 3\,{\rm days})$ and a small amplitude $(\lesssim 0.7\,{\rm mag})$. From the analysis, we find the Einstein timescale of $t_{\rm E} \backsimeq 0.33\,{\rm days}$ and the Einstein radius of… ▽ More We report a free-floating planet (FFP) candidate identified from the analysis of the microlensing event KMT-2023-BLG-2669. The lensing light curve is characterized by a short duration $(\lesssim 3\,{\rm days})$ and a small amplitude $(\lesssim 0.7\,{\rm mag})$. From the analysis, we find the Einstein timescale of $t_{\rm E} \backsimeq 0.33\,{\rm days}$ and the Einstein radius of $θ_{\rm E} \backsimeq 4.41\,μ{\rm as}$. These measurements enable us to infer the lens mass as $M = 8\,M_{\oplus} (π_{\rm rel} / 0.1\,{\rm mas})^{-1}$, where $π_{\rm rel}$ is the relative lens-source parallax. The inference implies that the lens is a sub-Neptune- to Saturn-mass object depending on its unknown distance. This is the ninth isolated planetary-mass microlens with $θ_{\rm E} < 10\,μ{\rm as}$, which (as shown by \citealt{gould22}) is a useful threshold for a FFP candidate. We conduct extensive searches for possible signals of a host star in the light curve, but find no strong evidence for the host. We discuss the possibility of using late-time high-resolution imaging to probe for possible hosts. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Comments: 17 pages, 5 figures, submitted to AJ

Why In-Context Learning Transformers are Tabular Data Classifiers

Authors: Felix den Breejen, Sangmin Bae, Stephen Cha, Se-Young Yun

Abstract: The recently introduced TabPFN pretrains an In-Context Learning (ICL) transformer on synthetic data to perform tabular data classification. As synthetic data does not share features or labels with real-world data, the underlying mechanism that contributes to the success of this method remains unclear. This study provides an explanation by demonstrating that ICL-transformers acquire the ability to… ▽ More The recently introduced TabPFN pretrains an In-Context Learning (ICL) transformer on synthetic data to perform tabular data classification. As synthetic data does not share features or labels with real-world data, the underlying mechanism that contributes to the success of this method remains unclear. This study provides an explanation by demonstrating that ICL-transformers acquire the ability to create complex decision boundaries during pretraining. To validate our claim, we develop a novel forest dataset generator which creates datasets that are unrealistic, but have complex decision boundaries. Our experiments confirm the effectiveness of ICL-transformers pretrained on this data. Furthermore, we create TabForestPFN, the ICL-transformer pretrained on both the original TabPFN synthetic dataset generator and our forest dataset generator. By fine-tuning this model, we reach the current state-of-the-art on tabular data classification. Code is available at https://github.com/FelixdenBreejen/TabForestPFN. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: 9 pages main body, 22 pages total. Preprint under review

Towards Realistic Incremental Scenario in Class Incremental Semantic Segmentation

Authors: Jihwan Kwak, Sungmin Cha, Taesup Moon

Abstract: This paper addresses the unrealistic aspect of the commonly adopted Continuous Incremental Semantic Segmentation (CISS) scenario, termed overlapped. We point out that overlapped allows the same image to reappear in future tasks with different pixel labels, which is far from practical incremental learning scenarios. Moreover, we identified that this flawed scenario may lead to biased results for tw… ▽ More This paper addresses the unrealistic aspect of the commonly adopted Continuous Incremental Semantic Segmentation (CISS) scenario, termed overlapped. We point out that overlapped allows the same image to reappear in future tasks with different pixel labels, which is far from practical incremental learning scenarios. Moreover, we identified that this flawed scenario may lead to biased results for two commonly used techniques in CISS, pseudo-labeling and exemplar memory, resulting in unintended advantages or disadvantages for certain techniques. To mitigate this, a practical scenario called partitioned is proposed, in which the dataset is first divided into distinct subsets representing each class, and then the subsets are assigned to each corresponding task. This efficiently addresses the issue above while meeting the requirement of CISS scenario, such as capturing the background shifts. Furthermore, we identify and address the code implementation issues related to retrieving data from the exemplar memory, which was ignored in previous works. Lastly, we introduce a simple yet competitive memory-based baseline, MiB-AugM, that handles background shifts of current tasks in the exemplar memory. This baseline achieves state-of-the-art results across multiple tasks involving learning numerous new classes. △ Less

Submitted 11 July, 2024; v1 submitted 16 May, 2024; originally announced May 2024.

KMT-2023-BLG-1866Lb: Microlensing super-Earth around an M dwarf host

Authors: Cheongho Han, Ian A. Bond, Andrzej Udalski, Chung-Uk Lee, Andrew Gould, Michael D. Albrow, Sun-Ju Chung, Kyu-Ha Hwang, Youn Kil Jung, Yoon-Hyun Ryu, Yossi Shvartzvald, In-Gu Shin, Jennifer C. Yee, Hongjing Yang, Weicheng Zang, Sang-Mok Cha, Doeon Kim, Dong-Jin Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Fumio Abe, Ken Bando , et al. (42 additional authors not shown)

Abstract: We investigate the nature of the short-term anomaly that appears in the lensing light curve of KMT-2023-BLG-1866. The anomaly was only partly covered due to its short duration, less than a day, coupled with cloudy weather conditions and restricted nighttime duration. Considering intricacy of interpreting partially covered signals, we thoroughly explore all potential degenerate solutions. Through t… ▽ More We investigate the nature of the short-term anomaly that appears in the lensing light curve of KMT-2023-BLG-1866. The anomaly was only partly covered due to its short duration, less than a day, coupled with cloudy weather conditions and restricted nighttime duration. Considering intricacy of interpreting partially covered signals, we thoroughly explore all potential degenerate solutions. Through this process, we identify three planetary scenarios that equally well account for the observed anomaly. These scenarios are characterized by the specific planetary parameters: $(s, q)_{\rm inner} = [0.9740 \pm 0.0083, (2.46 \pm 1.07) \times 10^{-5}]$, $(s, q)_{\rm intermediate} = [0.9779 \pm 0.0017, (1.56 \pm 0.25)\times 10^{-5}]$, and $(s, q)_{\rm outer} = [0.9894 \pm 0.0107, (2.31 \pm 1.29)\times 10^{-5}]$, where $s$ and $q$ denote the projected separation (scaled to the Einstein radius) and mass ratio between the planet and its host, respectively. We identify that the ambiguity between the inner and outer solutions stems from the inner-outer degeneracy, while the similarity between the intermediate solution and the others is due to an accidental degeneracy caused by incomplete anomaly coverage. Through Bayesian analysis utilizing the constraints derived from measured lensing observables and blending flux, our estimation indicates that the lens system comprises a very low-mass planet orbiting an early M-type star situated approximately (6.2 -- 6.5)~kpc from Earth in terms of median posterior values for the different solutions. The median mass of the planet host is in the range of (0.48 -- 0.51)~$M_\odot$, and that of the planet's mass spans a range of (2.6 -- 4.0)~$M_{\rm E}$, varying across different solutions. The detection of KMT-2023-BLG-1866Lb signifies the extension of the lensing surveys to very low-mass planets that have been difficult to be detected from earlier surveys. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: 9 pages, 8 figures, 4 tables

NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Prior

Authors: Gihoon Kim, Kwanggyoon Seo, Sihun Cha, Junyong Noh

Abstract: Audio-driven talking head generation is advancing from 2D to 3D content. Notably, Neural Radiance Field (NeRF) is in the spotlight as a means to synthesize high-quality 3D talking head outputs. Unfortunately, this NeRF-based approach typically requires a large number of paired audio-visual data for each identity, thereby limiting the scalability of the method. Although there have been attempts to… ▽ More Audio-driven talking head generation is advancing from 2D to 3D content. Notably, Neural Radiance Field (NeRF) is in the spotlight as a means to synthesize high-quality 3D talking head outputs. Unfortunately, this NeRF-based approach typically requires a large number of paired audio-visual data for each identity, thereby limiting the scalability of the method. Although there have been attempts to generate audio-driven 3D talking head animations with a single image, the results are often unsatisfactory due to insufficient information on obscured regions in the image. In this paper, we mainly focus on addressing the overlooked aspect of 3D consistency in the one-shot, audio-driven domain, where facial animations are synthesized primarily in front-facing perspectives. We propose a novel method, NeRFFaceSpeech, which enables to produce high-quality 3D-aware talking head. Using prior knowledge of generative models combined with NeRF, our method can craft a 3D-consistent facial feature space corresponding to a single image. Our spatial synchronization method employs audio-correlated vertex dynamics of a parametric face model to transform static image features into dynamic visuals through ray deformation, ensuring realistic 3D facial motion. Moreover, we introduce LipaintNet that can replenish the lacking information in the inner-mouth area, which can not be obtained from a given single image. The network is trained in a self-supervised manner by utilizing the generative capabilities without additional data. The comprehensive experiments demonstrate the superiority of our method in generating audio-driven talking heads from a single image with enhanced 3D consistency compared to previous approaches. In addition, we introduce a quantitative way of measuring the robustness of a model against pose changes for the first time, which has been possible only qualitatively. △ Less

Submitted 10 May, 2024; v1 submitted 9 May, 2024; originally announced May 2024.

Comments: 11 pages, 5 figures

Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScore

Authors: Junchao Wu, Runzhe Zhan, Derek F. Wong, Shu Yang, Xuebo Liu, Lidia S. Chao, Min Zhang

Abstract: The efficacy of an large language model (LLM) generated text detector depends substantially on the availability of sizable training data. White-box zero-shot detectors, which require no such data, are nonetheless limited by the accessibility of the source model of the LLM-generated text. In this paper, we propose an simple but effective black-box zero-shot detection approach, predicated on the obs… ▽ More The efficacy of an large language model (LLM) generated text detector depends substantially on the availability of sizable training data. White-box zero-shot detectors, which require no such data, are nonetheless limited by the accessibility of the source model of the LLM-generated text. In this paper, we propose an simple but effective black-box zero-shot detection approach, predicated on the observation that human-written texts typically contain more grammatical errors than LLM-generated texts. This approach entails computing the Grammar Error Correction Score (GECScore) for the given text to distinguish between human-written and LLM-generated text. Extensive experimental results show that our method outperforms current state-of-the-art (SOTA) zero-shot and supervised methods, achieving an average AUROC of 98.7% and showing strong robustness against paraphrase and adversarial perturbation attacks. △ Less

Submitted 7 May, 2024; originally announced May 2024.

A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU

Authors: Guanhua Chen, Yutong Yao, Derek F. Wong, Lidia S. Chao

Abstract: Multi-intent natural language understanding (NLU) presents a formidable challenge due to the model confusion arising from multiple intents within a single utterance. While previous works train the model contrastively to increase the margin between different multi-intent labels, they are less suited to the nuances of multi-intent NLU. They ignore the rich information between the shared intents, whi… ▽ More Multi-intent natural language understanding (NLU) presents a formidable challenge due to the model confusion arising from multiple intents within a single utterance. While previous works train the model contrastively to increase the margin between different multi-intent labels, they are less suited to the nuances of multi-intent NLU. They ignore the rich information between the shared intents, which is beneficial to constructing a better embedding space, especially in low-data scenarios. We introduce a two-stage Prediction-Aware Contrastive Learning (PACL) framework for multi-intent NLU to harness this valuable knowledge. Our approach capitalizes on shared intent information by integrating word-level pre-training and prediction-aware contrastive fine-tuning. We construct a pre-training dataset using a word-level data augmentation strategy. Subsequently, our framework dynamically assigns roles to instances during contrastive fine-tuning while introducing a prediction-aware contrastive loss to maximize the impact of contrastive learning. We present experimental results and empirical analysis conducted on three widely used datasets, demonstrating that our method surpasses the performance of three prominent baselines on both low-data and full-data scenarios. △ Less

Submitted 5 May, 2024; originally announced May 2024.

Comments: LREC-COLING 2024

3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset

Authors: Xinyu Ma, Xuebo Liu, Derek F. Wong, Jun Rao, Bei Li, Liang Ding, Lidia S. Chao, Dacheng Tao, Min Zhang

Abstract: Multimodal machine translation (MMT) is a challenging task that seeks to improve translation quality by incorporating visual information. However, recent studies have indicated that the visual information provided by existing MMT datasets is insufficient, causing models to disregard it and overestimate their capabilities. This issue presents a significant obstacle to the development of MMT researc… ▽ More Multimodal machine translation (MMT) is a challenging task that seeks to improve translation quality by incorporating visual information. However, recent studies have indicated that the visual information provided by existing MMT datasets is insufficient, causing models to disregard it and overestimate their capabilities. This issue presents a significant obstacle to the development of MMT research. This paper presents a novel solution to this issue by introducing 3AM, an ambiguity-aware MMT dataset comprising 26,000 parallel sentence pairs in English and Chinese, each with corresponding images. Our dataset is specifically designed to include more ambiguity and a greater variety of both captions and images than other MMT datasets. We utilize a word sense disambiguation model to select ambiguous data from vision-and-language datasets, resulting in a more challenging dataset. We further benchmark several state-of-the-art MMT models on our proposed dataset. Experimental results show that MMT models trained on our dataset exhibit a greater ability to exploit visual information than those trained on other MMT datasets. Our work provides a valuable resource for researchers in the field of multimodal learning and encourages further exploration in this area. The data, code and scripts are freely available at https://github.com/MaxyLee/3AM. △ Less

Submitted 29 April, 2024; originally announced April 2024.

Prefix Text as a Yarn: Eliciting Non-English Alignment in Foundation Language Model

Authors: Runzhe Zhan, Xinyi Yang, Derek F. Wong, Lidia S. Chao, Yue Zhang

Abstract: While supervised fine-tuning (SFT) has been a straightforward approach for tailoring the output of foundation large language model (LLM) to specific preferences, concerns have been raised about the depth of this alignment, with some critiques suggesting it is merely "superficial". We critically examine this hypothesis within the scope of cross-lingual generation tasks, proposing that the effective… ▽ More While supervised fine-tuning (SFT) has been a straightforward approach for tailoring the output of foundation large language model (LLM) to specific preferences, concerns have been raised about the depth of this alignment, with some critiques suggesting it is merely "superficial". We critically examine this hypothesis within the scope of cross-lingual generation tasks, proposing that the effectiveness of SFT may be constrained by its reliance on prior tokens to guide cross-lingual generation. Based on this crucial insight, and in response to the challenges posed by the costly and limited availability of non-English data for SFT, we introduce a novel training-free alignment method named PreTTY, which employs minimal task-related prior tokens to bridge the foundation LLM and the SFT LLM, achieving comparable performance without training. Experiments on machine translation and part-of-speech tagging across eight languages demonstrate the efficacy of PreTTY in cross-lingual settings. Remarkably, by initiating the decoding process with only one or two prior tokens, foundation LLMs can achieve performance comparable to their SFT counterparts. This method presents a cost-effective alternative to SFT and advances the democratization of multilingual LLMs. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Improving Weakly-Supervised Object Localization Using Adversarial Erasing and Pseudo Label

Authors: Byeongkeun Kang, Sinhae Cha, Yeejin Lee

Abstract: Weakly-supervised learning approaches have gained significant attention due to their ability to reduce the effort required for human annotations in training neural networks. This paper investigates a framework for weakly-supervised object localization, which aims to train a neural network capable of predicting both the object class and its location using only images and their image-level class lab… ▽ More Weakly-supervised learning approaches have gained significant attention due to their ability to reduce the effort required for human annotations in training neural networks. This paper investigates a framework for weakly-supervised object localization, which aims to train a neural network capable of predicting both the object class and its location using only images and their image-level class labels. The proposed framework consists of a shared feature extractor, a classifier, and a localizer. The localizer predicts pixel-level class probabilities, while the classifier predicts the object class at the image level. Since image-level class labels are insufficient for training the localizer, weakly-supervised object localization methods often encounter challenges in accurately localizing the entire object region. To address this issue, the proposed method incorporates adversarial erasing and pseudo labels to improve localization accuracy. Specifically, novel losses are designed to utilize adversarially erased foreground features and adversarially erased feature maps, reducing dependence on the most discriminative region. Additionally, the proposed method employs pseudo labels to suppress activation values in the background while increasing them in the foreground. The proposed method is applied to two backbone networks (MobileNetV1 and InceptionV3) and is evaluated on three publicly available datasets (ILSVRC-2012, CUB-200-2011, and PASCAL VOC 2012). The experimental results demonstrate that the proposed method outperforms previous state-of-the-art methods across all evaluated metrics. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Comments: 15 pages

Journal ref: Engineering Applications of Artificial Intelligence, 2024

Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced Pre-training

Authors: Hyesong Choi, Hyejin Park, Kwang Moo Yi, Sungmin Cha, Dongbo Min

Abstract: In this paper, we introduce Saliency-Based Adaptive Masking (SBAM), a novel and cost-effective approach that significantly enhances the pre-training performance of Masked Image Modeling (MIM) approaches by prioritizing token salience. Our method provides robustness against variations in masking ratios, effectively mitigating the performance instability issues common in existing methods. This relax… ▽ More In this paper, we introduce Saliency-Based Adaptive Masking (SBAM), a novel and cost-effective approach that significantly enhances the pre-training performance of Masked Image Modeling (MIM) approaches by prioritizing token salience. Our method provides robustness against variations in masking ratios, effectively mitigating the performance instability issues common in existing methods. This relaxes the sensitivity of MIM-based pre-training to masking ratios, which in turn allows us to propose an adaptive strategy for `tailored' masking ratios for each data sample, which no existing method can provide. Toward this goal, we propose an Adaptive Masking Ratio (AMR) strategy that dynamically adjusts the proportion of masking for the unique content of each image based on token salience. We show that our method significantly improves over the state-of-the-art in mask-based pre-training on the ImageNet-1K dataset. △ Less

Submitted 12 April, 2024; originally announced April 2024.

OGLE-2018-BLG-0971, MOA-2023-BLG-065, and OGLE-2023-BLG-0136: Microlensing events with prominent orbital effects

Authors: Cheongho Han, Andrzej Udalski, Ian A. Bond, Chung-Uk Lee, Andrew Gould, Michael D. Albrow, Sun-Ju Chung, Kyu-Ha Hwang, Youn Kil Jung, Hyoun-Woo Kim, Yoon-Hyun Ryu, Yossi Shvartzvald, In-Gu Shin, Jennifer C. Yee, Hongjing Yang, Weicheng Zang, Sang-Mok Cha, Doeon Kim, Dong-Jin Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Przemek Mróz , et al. (38 additional authors not shown)

Abstract: We undertake a project to reexamine microlensing data gathered from high-cadence surveys. The aim of the project is to reinvestigate lensing events with light curves exhibiting intricate anomaly features associated with caustics, yet lacking prior proposed models to explain these features. Through detailed reanalyses considering higher-order effects, we identify that accounting for orbital motions… ▽ More We undertake a project to reexamine microlensing data gathered from high-cadence surveys. The aim of the project is to reinvestigate lensing events with light curves exhibiting intricate anomaly features associated with caustics, yet lacking prior proposed models to explain these features. Through detailed reanalyses considering higher-order effects, we identify that accounting for orbital motions of lenses is vital in accurately explaining the anomaly features observed in the light curves of the lensing events OGLE-2018-BLG-0971, MOA-2023-BLG-065, and OGLE-2023-BLG-0136. We estimate the masses and distances to the lenses by conducting Bayesian analyses using the lensing parameters of the newly found lensing solutions. From these analyses, we identify that the lenses of the events OGLE-2018-BLG-0971 and MOA-2023-BLG-065 are binaries composed of M dwarfs, while the lens of OGLE-2023-BLG-0136 is likely to be a binary composed of an early K-dwarf primary and a late M-dwarf companion. For all lensing events, the probability of the lens residing in the bulge is considerably higher than that of it being located in the disk. △ Less

Submitted 8 April, 2024; originally announced April 2024.

Comments: 11 pages, 13 figures, 6 tables

SN H0pe: The First Measurement of $H_0$ from a Multiply-Imaged Type Ia Supernova, Discovered by JWST

Authors: Massimo Pascale, Brenda L. Frye, Justin D. R. Pierel, Wenlei Chen, Patrick L. Kelly, Seth H. Cohen, Rogier A. Windhorst, Adam G. Riess, Patrick S. Kamieneski, Jose M. Diego, Ashish K. Meena, Sangjun Cha, Masamune Oguri, Adi Zitrin, M. James Jee, Nicholas Foo, Reagen Leimbach, Anton M. Koekemoer, C. J. Conselice, Liang Dai, Ariel Goobar, Matthew R. Siebert, Lou Strolger, S. P. Willner

Abstract: The first James Webb Space Telescope ({\it JWST}) Near InfraRed Camera (NIRCam) imaging in the field of the galaxy cluster PLCK G165.7+67.0 ($z=0.35$) uncovered a Type Ia supernova (SN~Ia) at $z=1.78$, called ``SN H0pe." Three different images of this one SN were detected as a result of strong gravitational lensing, each one traversing a different path in spacetime, thereby inducing a relative del… ▽ More The first James Webb Space Telescope ({\it JWST}) Near InfraRed Camera (NIRCam) imaging in the field of the galaxy cluster PLCK G165.7+67.0 ($z=0.35$) uncovered a Type Ia supernova (SN~Ia) at $z=1.78$, called ``SN H0pe." Three different images of this one SN were detected as a result of strong gravitational lensing, each one traversing a different path in spacetime, thereby inducing a relative delay in the arrival of each image. Follow-up {\it JWST} observations of all three SN images enabled photometric and rare spectroscopic measurements of the two relative time delays. Following strict blinding protocols which oversaw a live unblinding and regulated post-unblinding changes, these two measured time delays were compared to the predictions of seven independently constructed cluster lens models to measure a value for the Hubble constant, $H_0=71.8^{+9.8}_{-7.6}$~km~s$^{-1}$~Mpc$^{-1}$. The range of admissible $H_0$ values predicted across the lens models limits further precision, reflecting the well-known degeneracies between lens model constraints and time delays. It has long been theorized that a way forward is to leverage a standard candle, however this has not been realized until now. For the first time, the lens models are evaluated by their agreement with the SN absolute magnification, breaking these degeneracies and producing our best estimate, $H_0=75.4^{+8.1}_{-5.5}$~km~s$^{-1}$~Mpc$^{-1}$. This is the first precision measurement of $H_0$ from a multiply-imaged SN~Ia, and provides a measurement in a rarely utilized redshift regime. This result agrees with other local universe measurements, yet exceeds the value of $H_0$ derived from the early Universe with $\gtrsim90\%$ confidence, increasing evidence of the Hubble tension. With the precision provided by only four more events, this approach could solidify this disagreement to $>3σ$. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Comments: Submitted to ApJ. 22 pages, 7 Figures

LeGO: Leveraging a Surface Deformation Network for Animatable Stylized Face Generation with One Example

Authors: Soyeon Yoon, Kwan Yun, Kwanggyoon Seo, Sihun Cha, Jung Eun Yoo, Junyong Noh

Abstract: Recent advances in 3D face stylization have made significant strides in few to zero-shot settings. However, the degree of stylization achieved by existing methods is often not sufficient for practical applications because they are mostly based on statistical 3D Morphable Models (3DMM) with limited variations. To this end, we propose a method that can produce a highly stylized 3D face model with de… ▽ More Recent advances in 3D face stylization have made significant strides in few to zero-shot settings. However, the degree of stylization achieved by existing methods is often not sufficient for practical applications because they are mostly based on statistical 3D Morphable Models (3DMM) with limited variations. To this end, we propose a method that can produce a highly stylized 3D face model with desired topology. Our methods train a surface deformation network with 3DMM and translate its domain to the target style using a paired exemplar. The network achieves stylization of the 3D face mesh by mimicking the style of the target using a differentiable renderer and directional CLIP losses. Additionally, during the inference process, we utilize a Mesh Agnostic Encoder (MAGE) that takes deformation target, a mesh of diverse topologies as input to the stylization process and encodes its shape into our latent space. The resulting stylized face model can be animated by commonly used 3DMM blend shapes. A set of quantitative and qualitative evaluations demonstrate that our method can produce highly stylized face meshes according to a given style and output them in a desired topology. We also demonstrate example applications of our method including image-based stylized avatar generation, linear interpolation of geometric styles, and facial animation of stylized avatars. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: 8 pages

MSC Class: 68T45 ACM Class: I.4.9

Step-Calibrated Diffusion for Biomedical Optical Image Restoration

Authors: Yiwei Lyu, Sung Jik Cha, Cheng Jiang, Asadur Chowdury, Xinhai Hou, Edward Harake, Akhil Kondepudi, Christian Freudiger, Honglak Lee, Todd C. Hollon

Abstract: High-quality, high-resolution medical imaging is essential for clinical care. Raman-based biomedical optical imaging uses non-ionizing infrared radiation to evaluate human tissues in real time and is used for early cancer detection, brain tumor diagnosis, and intraoperative tissue analysis. Unfortunately, optical imaging is vulnerable to image degradation due to laser scattering and absorption, wh… ▽ More High-quality, high-resolution medical imaging is essential for clinical care. Raman-based biomedical optical imaging uses non-ionizing infrared radiation to evaluate human tissues in real time and is used for early cancer detection, brain tumor diagnosis, and intraoperative tissue analysis. Unfortunately, optical imaging is vulnerable to image degradation due to laser scattering and absorption, which can result in diagnostic errors and misguided treatment. Restoration of optical images is a challenging computer vision task because the sources of image degradation are multi-factorial, stochastic, and tissue-dependent, preventing a straightforward method to obtain paired low-quality/high-quality data. Here, we present Restorative Step-Calibrated Diffusion (RSCD), an unpaired image restoration method that views the image restoration problem as completing the finishing steps of a diffusion-based image generation task. RSCD uses a step calibrator model to dynamically determine the severity of image degradation and the number of steps required to complete the reverse diffusion process for image restoration. RSCD outperforms other widely used unpaired image restoration methods on both image quality and perceptual evaluation metrics for restoring optical images. Medical imaging experts consistently prefer images restored using RSCD in blinded comparison experiments and report minimal to no hallucinations. Finally, we show that RSCD improves performance on downstream clinical imaging tasks, including automated brain tumor diagnosis and deep tissue imaging. Our code is available at https://github.com/MLNeurosurg/restorative_step-calibrated_diffusion. △ Less

Submitted 16 May, 2024; v1 submitted 20 March, 2024; originally announced March 2024.

Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model

Authors: Haoyun Xu, Runzhe Zhan, Derek F. Wong, Lidia S. Chao

Abstract: Large Language Models (LLMs) are composed of neurons that exhibit various behaviors and roles, which become increasingly diversified as models scale. Recent studies have revealed that not all neurons are active across different datasets, and this sparsity correlates positively with the task-specific ability, leading to advancements in model pruning and training efficiency. Traditional fine-tuning… ▽ More Large Language Models (LLMs) are composed of neurons that exhibit various behaviors and roles, which become increasingly diversified as models scale. Recent studies have revealed that not all neurons are active across different datasets, and this sparsity correlates positively with the task-specific ability, leading to advancements in model pruning and training efficiency. Traditional fine-tuning methods engage all parameters of LLMs, which is computationally expensive and may not be necessary. In contrast, Parameter-Efficient Fine-Tuning (PEFT) approaches aim to minimize the number of trainable parameters, yet they still operate at a relatively macro scale (e.g., layer-level). We introduce Neuron-Level Fine-Tuning (NeFT), a novel approach that refines the granularity of parameter training down to the individual neuron, enabling more precise and computationally efficient model updates. The experimental results show that NeFT not only exceeded the performance of full-parameter fine-tuning and PEFT but also provided insights into the analysis of neurons. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Hyperparameters in Continual Learning: a Reality Check

Authors: Sungmin Cha, Kyunghyun Cho

Abstract: Various algorithms for continual learning (CL) have been designed with the goal of effectively alleviating the trade-off between stability and plasticity during the CL process. To achieve this goal, tuning appropriate hyperparameters for each algorithm is essential. As an evaluation protocol, it has been common practice to train a CL algorithm using diverse hyperparameter values on a CL scenario c… ▽ More Various algorithms for continual learning (CL) have been designed with the goal of effectively alleviating the trade-off between stability and plasticity during the CL process. To achieve this goal, tuning appropriate hyperparameters for each algorithm is essential. As an evaluation protocol, it has been common practice to train a CL algorithm using diverse hyperparameter values on a CL scenario constructed with a benchmark dataset. Subsequently, the best performance attained with the optimal hyperparameter value serves as the criterion for evaluating the CL algorithm. In this paper, we contend that this evaluation protocol is not only impractical but also incapable of effectively assessing the CL capability of a CL algorithm. Returning to the fundamental principles of model evaluation in machine learning, we propose an evaluation protocol that involves Hyperparameter Tuning and Evaluation phases. Those phases consist of different datasets but share the same CL scenario. In the Hyperparameter Tuning phase, each algorithm is iteratively trained with different hyperparameter values to find the optimal hyperparameter values. Subsequently, in the Evaluation phase, the optimal hyperparameter values is directly applied for training each algorithm, and their performance in the Evaluation phase serves as the criterion for evaluating them. Through experiments on CIFAR-100 and ImageNet-100 based on the proposed protocol in class-incremental learning, we not only observed that the existing evaluation method fail to properly assess the CL capability of each algorithm but also observe that some recently proposed state-of-the-art algorithms, which reported superior performance, actually exhibit inferior performance compared to the previous algorithm. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Comments: Preprint

Ultralight vector dark matter search using data from the KAGRA O3GK run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, A. G. Abac, R. Abbott, H. Abe, I. Abouelfettouh, F. Acernese, K. Ackley, C. Adamcewicz, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, I. Aguilar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi , et al. (1778 additional authors not shown)

Abstract: Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we prese… ▽ More Among the various candidates for dark matter (DM), ultralight vector DM can be probed by laser interferometric gravitational wave detectors through the measurement of oscillating length changes in the arm cavities. In this context, KAGRA has a unique feature due to differing compositions of its mirrors, enhancing the signal of vector DM in the length change in the auxiliary channels. Here we present the result of a search for $U(1)_{B-L}$ gauge boson DM using the KAGRA data from auxiliary length channels during the first joint observation run together with GEO600. By applying our search pipeline, which takes into account the stochastic nature of ultralight DM, upper bounds on the coupling strength between the $U(1)_{B-L}$ gauge boson and ordinary matter are obtained for a range of DM masses. While our constraints are less stringent than those derived from previous experiments, this study demonstrates the applicability of our method to the lower-mass vector DM search, which is made difficult in this measurement by the short observation time compared to the auto-correlation time scale of DM. △ Less

Submitted 5 March, 2024; originally announced March 2024.

Comments: 20 pages, 5 figures

Report number: LIGO-P2300250

Phonon-pair-driven Ferroelectricity Causes Costless Domain-walls and Bulk-boundary Duality

Authors: Hyun-Jae Lee, Kyoung-June Go, Pawan Kumar, Chang Hoon Kim, Yungyeom Kim, Kyoungjun Lee, Takao Shimizu, Seung Chul Chae, Hosub Jin, Minseong Lee, Umesh Waghmare, Si-Young Choi, Jun Hee Lee

Abstract: Ferroelectric domain walls, recognized as distinct from the bulk in terms of symmetry, structure, and electronic properties, host exotic phenomena including conductive walls, ferroelectric vortices, novel topologies, and negative capacitance. Contrary to conventional understanding, our study reveals that the structure of domain walls in HfO2 closely resembles its bulk. First, our first-principles… ▽ More Ferroelectric domain walls, recognized as distinct from the bulk in terms of symmetry, structure, and electronic properties, host exotic phenomena including conductive walls, ferroelectric vortices, novel topologies, and negative capacitance. Contrary to conventional understanding, our study reveals that the structure of domain walls in HfO2 closely resembles its bulk. First, our first-principles simulations unveil that the robust ferroelectricity is supported by bosonic pairing of all the anionic phonons in bulk HfO2. Strikingly, the paired phonons strongly bond with each other and successfully reach the center of the domain wall without losing their integrity and produce bulk-like domain walls. We then confirmed preservation of the bulk phonon displacements and consequently full revival of the bulk structure at domain walls via aberration-corrected STEM. The newly found duality between the bulk and the domain wall sheds light on previously enigmatic properties such as zero-energy domain walls, perfect Ising-type polar ordering, and exceptionally robust ferroelectricity at the sub-nm scales. The phonon-pairing discovered here is robust against physical boundaries such as domain walls and enables zero momentum and zero-energy cost local ferroelectric switching. This phenomenon demonstrated in Si-compatible ferroelectrics provides a novel technological platform where data storage on domain walls is as feasible as that within the domains, thereby expanding the potential for high-density data storage and advanced ferroelectric applications. △ Less

Submitted 3 March, 2024; originally announced March 2024.

Comments: 24 pages, 4 figures

Cluster structure of 3$α$+p states in $^{13}$N

Authors: J. Bishop, G. V. Rogachev, S. Ahn, M. Barbui, S. M. Cha, E. Harris, C. Hunt, C. H. Kim, D. Kim, S. H. Kim, E. Koshchiy, Z. Luo, C. Park, C. E. Parker, E. C. Pollacco, B. T. Roeder, M. Roosa, A. Saastamoinen, D. P. Scriven

Abstract: Background: Cluster states in $^{13}$N are extremely difficult to measure due to the unavailability of $^{9}$B+$α$ elastic scattering data. Purpose: Using $β$-delayed charged-particle spectroscopy of $^{13}$O, clustered states in $^{13}$N can be populated and measured in the 3$α$+p decay channel. Method: One-at-a-time implantation/decay of $^{13}$O was performed with the Texas Active Target Time P… ▽ More Background: Cluster states in $^{13}$N are extremely difficult to measure due to the unavailability of $^{9}$B+$α$ elastic scattering data. Purpose: Using $β$-delayed charged-particle spectroscopy of $^{13}$O, clustered states in $^{13}$N can be populated and measured in the 3$α$+p decay channel. Method: One-at-a-time implantation/decay of $^{13}$O was performed with the Texas Active Target Time Projection Chamber (TexAT TPC). 149 $β3αp$ decay events were observed and the excitation function in $^{13}$N reconstructed. Results: Four previously unknown $α$-decaying excited states were observed in $^{13}$N at an excitation energy of 11.3 MeV, 12.4 MeV, 13.1 MeV and 13.7 MeV decaying via the 3$α$+p channel. Conclusion: These states are seen to have a [$^{9}\mathrm{B}(\mathrm{g.s}) \bigotimes α$/ $p+^{12}\mathrm{C}(0_{2}^{+})$], [$^{9}\mathrm{B}(\frac{1}{2}^{+}) \bigotimes α$], [$^{9}\mathrm{B}(\frac{5}{2}^{+}) \bigotimes α$] and [$^{9}\mathrm{B}(\frac{5}{2}^{+}) \bigotimes α$] structure respectively. A previously-seen state at 11.8 MeV was also determined to have a [$p+^{12}\mathrm{C}(\mathrm{g.s.})$/ $p+^{12}\mathrm{C}(0_{2}^{+})$] structure. The overall magnitude of the clustering is not able to be extracted however due to the lack of a total width measurement. Clustered states in $^{13}$N (with unknown magnitude) seem to persist from the addition of a proton to the highly $α$-clustered $^{12}$C. Evidence of the $\frac{1}{2}^{+}$ state in $^{9}$B was also seen to be populated by decays from $^{13}$N$^{\star}$. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2302.14111

Predicting Outcomes in Video Games with Long Short Term Memory Networks

Authors: Kittimate Chulajata, Sean Wu, Fabien Scalzo, Eun Sang Cha

Abstract: Forecasting winners in E-sports with real-time analytics has the potential to further engage audiences watching major tournament events. However, making such real-time predictions is challenging due to unpredictable variables within the game involving diverse player strategies and decision-making. Our work attempts to enhance audience engagement within video game tournaments by introducing a real-… ▽ More Forecasting winners in E-sports with real-time analytics has the potential to further engage audiences watching major tournament events. However, making such real-time predictions is challenging due to unpredictable variables within the game involving diverse player strategies and decision-making. Our work attempts to enhance audience engagement within video game tournaments by introducing a real-time method of predicting wins. Our Long Short Term Memory Network (LSTMs) based approach enables efficient predictions of win-lose outcomes by only using the health indicator of each player as a time series. As a proof of concept, we evaluate our model's performance within a classic, two-player arcade game, Super Street Fighter II Turbo. We also benchmark our method against state of the art methods for time series forecasting; i.e. Transformer models found in large language models (LLMs). Finally, we open-source our data set and code in hopes of furthering work in predictive analysis for arcade games. △ Less

Submitted 24 February, 2024; originally announced February 2024.

Comments: 7 pages, 2 Figures, 2 Tables. Kittimate Chulajata and Sean Wu are considered co-first authors

Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions

Authors: Sungwoo Park, Junyeop Kwon, Byeongnoh Kim, Suhyun Chae, Jeeyong Lee, Dabeen Lee

Abstract: This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient parameter-free optimistic optimization-based methods. Our algorithms significantly improve upon the existing Lipschitz bandit-based method in many aspects. In pa… ▽ More This paper studies performative risk minimization, a formulation of stochastic optimization under decision-dependent distributions. We consider the general case where the performative risk can be non-convex, for which we develop efficient parameter-free optimistic optimization-based methods. Our algorithms significantly improve upon the existing Lipschitz bandit-based method in many aspects. In particular, our framework does not require knowledge about the sensitivity parameter of the distribution map and the Lipshitz constant of the loss function. This makes our framework practically favorable, together with the efficient optimistic optimization-based tree-search mechanism. We provide experimental results that demonstrate the numerical superiority of our algorithms over the existing method and other black-box optimistic optimization methods. △ Less

Submitted 23 February, 2024; originally announced February 2024.

Visually Dehallucinative Instruction Generation: Know What You Don't Know

Authors: Sungguk Cha, Jusung Lee, Younghyun Lee, Cheoljong Yang

Abstract: "When did the emperor Napoleon invented iPhone?" Such hallucination-inducing question is well known challenge in generative language modeling. In this study, we present an innovative concept of visual hallucination, referred to as "I Know (IK)" hallucination, to address scenarios where "I Don't Know" is the desired response. To effectively tackle this issue, we propose the VQAv2-IDK benchmark, the… ▽ More "When did the emperor Napoleon invented iPhone?" Such hallucination-inducing question is well known challenge in generative language modeling. In this study, we present an innovative concept of visual hallucination, referred to as "I Know (IK)" hallucination, to address scenarios where "I Don't Know" is the desired response. To effectively tackle this issue, we propose the VQAv2-IDK benchmark, the subset of VQAv2 comprising unanswerable image-question pairs as determined by human annotators. Stepping further, we present the visually dehallucinative instruction generation method for IK hallucination and introduce the IDK-Instructions visual instruction database. Our experiments show that current methods struggle with IK hallucination. Yet, our approach effectively reduces these hallucinations, proving its versatility across different frameworks and datasets. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Visual Question Answering Instruction: Unlocking Multimodal Large Language Model To Domain-Specific Visual Multitasks

Authors: Jusung Lee, Sungguk Cha, Younghyun Lee, Cheoljong Yang

Abstract: Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily used for vision-language tasks. Currently, MLLMs have not yet been extended for domain-specific visual tasks, which require a more explicit understanding of visua… ▽ More Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily used for vision-language tasks. Currently, MLLMs have not yet been extended for domain-specific visual tasks, which require a more explicit understanding of visual information. We developed a method to transform domain-specific visual and vision-language datasets into a unified question answering format called Visual Question Answering Instruction (VQA-IN), thereby extending MLLM to domain-specific tasks. The VQA-IN was applied to train multiple MLLM architectures using smaller versions of LLMs (sLLMs). The experimental results indicated that the proposed method achieved a high score metric on domainspecific visual tasks while also maintaining its performance on vision-language tasks in a multitask manner. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Visually Dehallucinative Instruction Generation

Authors: Sungguk Cha, Jusung Lee, Younghyun Lee, Cheoljong Yang

Abstract: In recent years, synthetic visual instructions by generative language model have demonstrated plausible text generation performance on the visual question-answering tasks. However, challenges persist in the hallucination of generative language models, i.e., the generated image-text data contains unintended contents. This paper presents a novel and scalable method for generating visually dehallucin… ▽ More In recent years, synthetic visual instructions by generative language model have demonstrated plausible text generation performance on the visual question-answering tasks. However, challenges persist in the hallucination of generative language models, i.e., the generated image-text data contains unintended contents. This paper presents a novel and scalable method for generating visually dehallucinative instructions, dubbed CAP2QA, that constrains the scope to only image contents. Our key contributions lie in introducing image-aligned instructive QA dataset CAP2QA-COCO and its scalable recipe. In our experiments, we compare synthetic visual instruction datasets that share the same source data by visual instruction tuning and conduct general visual recognition tasks. It shows that our proposed method significantly reduces visual hallucination while consistently improving visual recognition ability and expressiveness. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: Accepted in ICASSP2024

OGLE-2023-BLG-0836L: The sixth microlensing planet in a binary stellar system

Authors: Cheongho Han, Andrzej Udalski, Youn Kil Jung, Andrew Gould, Doeon Kim, Michael D. Albrow, Sun-Ju Chung, Kyu-Ha Hwang, Chung-Uk Lee, Yoon-Hyun Ryu, Yossi Shvartzvald, In-Gu Shin, Jennifer C. Yee, Hongjing Yang, Weicheng Zang, Sang-Mok Cha, Dong-Jin Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Przemek Mróz, Mateusz J. Mróz, Michał K. Szymański , et al. (10 additional authors not shown)

Abstract: Light curves of microlensing events occasionally deviate from the smooth and symmetric form of a single-lens single-source event. While most of these anomalous events can be accounted for by employing a binary-lens single-source (2L1S) or a single-lens binary-source (1L2S) framework, it is established that a small fraction of events remain unexplained by either of these interpretations. We carry o… ▽ More Light curves of microlensing events occasionally deviate from the smooth and symmetric form of a single-lens single-source event. While most of these anomalous events can be accounted for by employing a binary-lens single-source (2L1S) or a single-lens binary-source (1L2S) framework, it is established that a small fraction of events remain unexplained by either of these interpretations. We carry out a project in which data collected by high-cadence microlensing surveys were reinvestigated with the aim of uncovering the nature of anomalous lensing events with no proposed 2L1S or 1L2S models. From the project, we find that the anomaly appearing in the lensing event OGLE-2023-BLG-0836 cannot be explained by the usual interpretations and conduct a comprehensive analysis of the event. From thorough modeling of the light curve under sophisticated lens-system configurations, we have arrived at the conclusion that a triple-mass lens system is imperative to account for the anomaly features observed in the lensing light curve. From the Bayesian analysis using the measured observables of the event time scale and angular Einstein radius, we determine that the least massive component of the lens has a planetary mass of $4.36^{+2.35}_{-2.18}~M_{\rm J}$. This planet orbits within a stellar binary system composed of two stars with masses $0.71^{+0.38}_{-0.36}~M_\odot$ and $0.56^{+0.30}_{-0.28}~M_\odot$. This lensing event signifies the sixth occurrence of a planetary microlensing system in which a planet belongs to a stellar binary system. △ Less

Submitted 17 February, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

Comments: 11 pages, 12 figures

MOA-2022-BLG-563Lb, KMT-2023-BLG-0469Lb, and KMT-2023-BLG-0735Lb: Three sub-Jovian-mass microlensing planets

Authors: Cheongho Han, Youn Kil Jung, Ian A. Bond, Andrew Gould, Michael D. Albrow, Sun-Ju Chung, Kyu-Ha Hwang, Chung-Uk Lee, Yoon-Hyun Ryu, In-Gu Shin, Yossi Shvartzvald, Hongjing Yang, Jennifer C. Yee, Weicheng Zang, Sang-Mok Cha, Doeon Kim, Dong-Jin Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Fumio Abe, Richard Barry, David P. Bennett , et al. (23 additional authors not shown)

Abstract: We analyze the anomalies appearing in the light curves of the three microlensing events MOA-2022-BLG-563, KMT-2023-BLG-0469, and KMT-2023-BLG-0735. The anomalies exhibit common short-term dip features that appear near the peak. From the detailed analyses of the light curves, we find that the anomalies were produced by planets accompanied by the lenses of the events. For all three events, the estim… ▽ More We analyze the anomalies appearing in the light curves of the three microlensing events MOA-2022-BLG-563, KMT-2023-BLG-0469, and KMT-2023-BLG-0735. The anomalies exhibit common short-term dip features that appear near the peak. From the detailed analyses of the light curves, we find that the anomalies were produced by planets accompanied by the lenses of the events. For all three events, the estimated mass ratios between the planet and host are on the order of $10^{-4}$: $q\sim 8 \times 10^{-4}$ for MOA-2022-BLG-563L, $q\sim 2.5\times 10^{-4}$ for KMT-2023-BLG-0469L, and $q\sim 1.9\times 10^{-4}$ for KMT-2023-BLG-0735L. The interpretations of the anomalies are subject to a common inner-outer degeneracy, which causes ambiguity when estimating the projected planet-host separation. We estimated the planet mass, $M_{\rm p}$, host mass, $M_{\rm h}$, and distance, $D_{\rm L}$, to the planetary system by conducting Bayesian analyses using the observables of the events. The estimated physical parameters of the planetary systems are $(M_{\rm h}/M_\odot, M_{\rm p}/M_{\rm J}, D_{\rm L}/{\rm kpc}) = (0.48^{+0.36}_{-0.30}, 0.40^{+0.31}_{-0.25}, 6.53^{+1.12}_{-1.57})$ for MOA-2022-BLG-563L, $(0.47^{+0.35}_{-0.26}, 0.124^{+0.092}_{-0.067}, 7.07^{+1.03}_{-1.19})$ for KMT-2023-BLG-0469L, and $(0.62^{+0.34}_{-0.35}, 0.125^{+0.068}_{-0.070}, 6.26^{+1.27}_{-1.67})$ for KMT-2023-BLG-0735L. According to the estimated parameters, all planets are cold planets with projected separations that are greater than the snow lines of the planetary systems, they have masses that lie between the masses of Uranus and Jupiter of the Solar System, and the hosts of the planets are main-sequence stars that are less massive than the Sun. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Comments: 11 pages, 7 tables, 10 figures

KMT-2023-BLG-0416, KMT-2023-BLG-1454, KMT-2023-BLG-1642: Microlensing planets identified from partially covered signals

Authors: Cheongho Han, Andrzej Udalski, Chung-Uk Lee, Weicheng Zang, Michael D. Albrow, Sun-Ju Chung, Andrew Gould, Kyu-Ha Hwang, Youn Kil Jung, Yoon-Hyun Ryu, Yossi Shvartzvald, In-Gu Shin, Jennifer C. Yee, Hongjing Yang, Sang-Mok Cha, Doeon Kim, Dong-Jin Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Przemek Mróz, Michał K. Szymański, Jan Skowron , et al. (10 additional authors not shown)

Abstract: We investigate the 2023 season data from high-cadence microlensing surveys with the aim of detecting partially covered short-term signals and revealing their underlying astrophysical origins. Through this analysis, we ascertain that the signals observed in the lensing events KMT-2023-BLG-0416, KMT-2023-BLG-1454, and KMT-2023-BLG-1642 are of planetary origin. Considering the potential degeneracy ca… ▽ More We investigate the 2023 season data from high-cadence microlensing surveys with the aim of detecting partially covered short-term signals and revealing their underlying astrophysical origins. Through this analysis, we ascertain that the signals observed in the lensing events KMT-2023-BLG-0416, KMT-2023-BLG-1454, and KMT-2023-BLG-1642 are of planetary origin. Considering the potential degeneracy caused by the partial coverage of signals, we thoroughly investigate the lensing-parameter plane. In the case of KMT-2023-BLG-0416, we have identified two solution sets, one with a planet-to-host mass ratio of $q\sim 10^{-2}$ and the other with $q\sim 6\times 10^{-5}$, within each of which there are two local solutions emerging due to the inner-outer degeneracy. For KMT-2023-BLG-1454, we discern four local solutions featuring mass ratios of $q\sim (1.7-4.3)\times 10^{-3}$. When it comes to KMT-2023-BLG-1642, we identified two locals with $q\sim (6-10)\times 10^{-3}$ resulting from the inner-outer degeneracy. We estimate the physical lens parameters by conducting Bayesian analyses based on the event time scale and Einstein radius. For KMT-2023-BLG-0416L, the host mass is $\sim 0.6~M_\odot$, and the planet mass is $\sim (6.1-6.7)~M_{\rm J}$ according to one set of solutions and $\sim 0.04~M_{\rm J}$ according to the other set of solutions. KMT-2023-BLG-1454Lb has a mass roughly half that of Jupiter, while KMT-2023-BLG-1646Lb has a mass in the range of between 1.1 to 1.3 times that of Jupiter, classifying them both as giant planets orbiting mid M-dwarf host stars with masses ranging from 0.13 to 0.17 solar masses. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Comments: 12 pages, 16 figures, 6 tables

Systematic KMTNet Planetary Anomaly Search. XI. Complete Sample of 2016 Sub-Prime Field Planets

Authors: In-Gu Shin, Jennifer C. Yee, Weicheng Zang, Cheongho Han, Hongjing Yang, Andrew Gould, Chung-Uk Lee, Andrzej Udalski, Takahiro Sumi, Michael D. Albrow, Sun-Ju Chung, Kyu-Ha Hwang, Youn Kil Jung, Yoon-Hyun Ryu, Yossi Shvartzvald, Sang-Mok Cha, Dong-Jin Kim, Hyoun-Woo Kim, Seung-Lee Kim, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Przemek Mróz, Michał K. Szymański , et al. (41 additional authors not shown)

Abstract: Following Shin et al. (2023b), which is a part of the Systematic KMTNet Planetary Anomaly Search series (i.e., a search for planets in the 2016 KMTNet prime fields), we conduct a systematic search of the 2016 KMTNet sub-prime fields using a semi-machine-based algorithm to identify hidden anomalous events missed by the conventional by-eye search. We find four new planets and seven planet candidates… ▽ More Following Shin et al. (2023b), which is a part of the Systematic KMTNet Planetary Anomaly Search series (i.e., a search for planets in the 2016 KMTNet prime fields), we conduct a systematic search of the 2016 KMTNet sub-prime fields using a semi-machine-based algorithm to identify hidden anomalous events missed by the conventional by-eye search. We find four new planets and seven planet candidates that were buried in the KMTNet archive. The new planets are OGLE-2016-BLG-1598Lb, OGLE-2016-BLG-1800Lb, MOA-2016-BLG-526Lb, and KMT-2016-BLG-2321Lb, which show typical properties of microlensing planets, i.e., giant planets orbit M dwarf host stars beyond their snow lines. For the planet candidates, we find planet/binary or 2L1S/1L2S degeneracies, which are an obstacle to firmly claiming planet detections. By combining the results of Shin et al. (2023b) and this work, we find a total of nine hidden planets, which is about half the number of planets discovered by eye in 2016. With this work, we have met the goal of the systematic search series for 2016, which is to build a complete microlensing planet sample. We also show that our systematic searches significantly contribute to completing the planet sample, especially for planet/host mass ratios smaller than $10^{-3}$, which were incomplete in previous by-eye searches of the KMTNet archive. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Comments: 63 pages, 16 Tables, 19 Figures, Submitted in the AAS journal

Multiscale Vision Transformer With Deep Clustering-Guided Refinement for Weakly Supervised Object Localization

Authors: David Kim, Sinhae Cha, Byeongkeun Kang

Abstract: This work addresses the task of weakly-supervised object localization. The goal is to learn object localization using only image-level class labels, which are much easier to obtain compared to bounding box annotations. This task is important because it reduces the need for labor-intensive ground-truth annotations. However, methods for object localization trained using weak supervision often suffer… ▽ More This work addresses the task of weakly-supervised object localization. The goal is to learn object localization using only image-level class labels, which are much easier to obtain compared to bounding box annotations. This task is important because it reduces the need for labor-intensive ground-truth annotations. However, methods for object localization trained using weak supervision often suffer from limited accuracy in localization. To address this challenge and enhance localization accuracy, we propose a multiscale object localization transformer (MOLT). It comprises multiple object localization transformers that extract patch embeddings across various scales. Moreover, we introduce a deep clustering-guided refinement method that further enhances localization accuracy by utilizing separately extracted image segments. These segments are obtained by clustering pixels using convolutional neural networks. Finally, we demonstrate the effectiveness of our proposed method by conducting experiments on the publicly available ILSVRC-2012 dataset. △ Less

Submitted 15 December, 2023; originally announced December 2023.

Comments: 5 pages

Journal ref: IEEE International Conference on Visual Communications and Image Processing, 2023

OGLE-2017-BLG-0448Lb: A Low Mass-Ratio Wide-Orbit Microlensing Planet?

Authors: Ruocheng Zhai, Radosław Poleski, Weicheng Zang, Youn Kil Jung, Andrzej Udalski, Renkun Kuang, Michael D. Albrow, Sun-Ju Chung, Andrew Gould, Cheongho Han, Kyu-Ha Hwang, Yoon-Hyun Ryu, In-Gu Shin, Yossi Shvartzvald, Hongjing Yang, Jennifer C. Yee, Sang-Mok Cha, Dong-Jin Kim, Hyoun-Woo Kim, Seung-Lee Kim, Chung-Uk Lee, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge , et al. (16 additional authors not shown)

Abstract: The gravitational microlensing technique is most sensitive to planets in a Jupiter-like orbit and has detected more than 200 planets. However, only a few wide-orbit ($s > 2$) microlensing planets have been discovered, where $s$ is the planet-to-host separation normalized to the angular Einstein ring radius, $θ_{\rm E}$. Here we present the discovery and analysis of a strong candidate wide-orbit mi… ▽ More The gravitational microlensing technique is most sensitive to planets in a Jupiter-like orbit and has detected more than 200 planets. However, only a few wide-orbit ($s > 2$) microlensing planets have been discovered, where $s$ is the planet-to-host separation normalized to the angular Einstein ring radius, $θ_{\rm E}$. Here we present the discovery and analysis of a strong candidate wide-orbit microlensing planet in the event, OGLE-2017-BLG-0448. The whole light curve exhibits long-term residuals to the static binary-lens single-source model, so we investigate the residuals by adding the microlensing parallax, microlensing xallarap, an additional lens, or an additional source. For the first time, we observe a complex degeneracy between all four effects. The wide-orbit models with $s \sim 2.5$ and a planet-to-host mass-ratio of $q \sim 10^{-4}$ are significantly preferred, but we cannot rule out the close models with $s \sim 0.35$ and $q \sim 10^{-3}$. A Bayesian analysis based on a Galactic model indicates that, despite the complicated degeneracy, the surviving wide-orbit models all contain a super-Earth-mass to Neptune-mass planet at a projected planet-host separation of $\sim 6$ au and the surviving close-orbit models all consist of a Jovian-mass planet at $\sim 1$ au. The host star is probably an M or K dwarf. We discuss the implications of this dimension-degeneracy disaster on microlensing light-curve analysis and its potential impact on statistical studies. △ Less

Submitted 13 December, 2023; originally announced December 2023.

Comments: submitted to AJ

OGLE-2019-BLG-1180Lb: Discovery of a Wide-orbit Jupiter-mass Planet around a Late-type Star

Authors: Sun-Ju Chung, Andrzej Udalski, Jennifer C. Yee, Andrew Gould, Michael D. Albrow, Youn Kil Jung, Kyu-Ha Hwang, Cheongho Han, Yoon-Hyun Ryu, In-Gu Shin, Yossi Shvartzvald, Hongjing Yang, Weicheng Zang, Sang-Mok Cha, Dong-Jin Kim, Seung-Lee Kim, Chung-Uk Lee, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Radek Poleski, Przemek Mróz, Jan Skowron, Michał K. Szymański , et al. (8 additional authors not shown)

Abstract: We report on the discovery and analysis of the planetary microlensing event OGLE-2019-BLG-1180 with a planet-to-star mass ratio $q \sim 0.003$. The event OGLE-2019-BLG-1180 has unambiguous cusp-passing and caustic-crossing anomalies, which were caused by a wide planetary caustic with $s \simeq 2$, where $s$ is the star-planet separation in units of the angular Einstein radius $θ_{E}$. Thanks to we… ▽ More We report on the discovery and analysis of the planetary microlensing event OGLE-2019-BLG-1180 with a planet-to-star mass ratio $q \sim 0.003$. The event OGLE-2019-BLG-1180 has unambiguous cusp-passing and caustic-crossing anomalies, which were caused by a wide planetary caustic with $s \simeq 2$, where $s$ is the star-planet separation in units of the angular Einstein radius $θ_{E}$. Thanks to well-covered anomalies by the Korea Micorolensing Telescope Network (KMTNet), we measure both the angular Einstein radius and the microlens parallax in spite of a relatively short event timescale of $t_{E} = 28$ days. However, because of a weak constraint on the parallax, we conduct a Bayesian analysis to estimate the physical lens parameters. We find that the lens system is a super-Jupiter-mass planet of $M_{p} = 1.75^{+0.54}_{-0.51} M_{J}$ orbiting a late-type star of $M_{h}=0.55^{+0.27}_{-0.26} M_\odot$ at a distance of $D_{L} = 6.1^{+0.9}_{-1.3}$ kpc. The projected star-planet separation is $a_{\perp} = 5.19^{+0.90}_{-1.23}$ au, which means that the planet orbits at about four times the snow line of the host star. Considering the relative lens-source proper motion of $μ_{rel} = 6$ mas/yr, the lens will be separated from the source by 60 mas in 2029. At that time one can measure the lens flux from adaptive optics imaging of Kec or a next-generation 30 m class telescope. OGLE-2019-BLG-1180Lb represents a growing population of wide-orbit planets detected by KMTNet, so we also present a general investigation into prospects for further expanding the sample of such planets. △ Less

Submitted 2 December, 2023; originally announced December 2023.

Comments: 12 pages, 12 figures, 5 tables, published in AJ

TSDF-Sampling: Efficient Sampling for Neural Surface Field using Truncated Signed Distance Field

Authors: Chaerin Min, Sehyun Cha, Changhee Won, Jongwoo Lim

Abstract: Multi-view neural surface reconstruction has exhibited impressive results. However, a notable limitation is the prohibitively slow inference time when compared to traditional techniques, primarily attributed to the dense sampling, required to maintain the rendering quality. This paper introduces a novel approach that substantially reduces the number of samplings by incorporating the Truncated Sign… ▽ More Multi-view neural surface reconstruction has exhibited impressive results. However, a notable limitation is the prohibitively slow inference time when compared to traditional techniques, primarily attributed to the dense sampling, required to maintain the rendering quality. This paper introduces a novel approach that substantially reduces the number of samplings by incorporating the Truncated Signed Distance Field (TSDF) of the scene. While prior works have proposed importance sampling, their dependence on initial uniform samples over the entire space makes them unable to avoid performance degradation when trying to use less number of samples. In contrast, our method leverages the TSDF volume generated only by the trained views, and it proves to provide a reasonable bound on the sampling from upcoming novel views. As a result, we achieve high rendering quality by fully exploiting the continuous neural SDF estimation within the bounds given by the TSDF volume. Notably, our method is the first approach that can be robustly plug-and-play into a diverse array of neural surface field models, as long as they use the volume rendering technique. Our empirical results show an 11-fold increase in inference speed without compromising performance. The result videos are available at our project page: https://tsdf-sampling.github.io/ △ Less

Submitted 29 November, 2023; originally announced November 2023.

Model-independent extraction of form factors and $|V_{cb}|$ in $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ with hadronic tagging at BaBar

Authors: BaBar Collaboration, J. P. Lees, V. Poireau, V. Tisserand, E. Grauges, A. Palano, G. Eigen, D. N. Brown, Yu. G. Kolomensky, M. Fritsch, H. Koch, R. Cheaib, C. Hearty, T. S. Mattison, J. A. McKenna, R. Y. So, V. E. Blinov, A. R. Buzykaev, V. P. Druzhinin, E. A. Kozyrev, E. A. Kravchenko, S. I. Serednyakov, Yu. I. Skovpen, E. P. Solodov, K. Yu. Todyshev , et al. (186 additional authors not shown)

Abstract: Using the entire BaBar $Υ(4S)$ data set, the first two-dimensional unbinned angular analysis of the semileptonic decay $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ is performed, employing hadronic reconstruction of the tag-side $B$ meson from $Υ(4S)\to B\overline{B}$. Here, $\ell$ denotes the light charged leptons $e$ and $μ$. A novel data-driven signal-background separation procedure with… ▽ More Using the entire BaBar $Υ(4S)$ data set, the first two-dimensional unbinned angular analysis of the semileptonic decay $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ is performed, employing hadronic reconstruction of the tag-side $B$ meson from $Υ(4S)\to B\overline{B}$. Here, $\ell$ denotes the light charged leptons $e$ and $μ$. A novel data-driven signal-background separation procedure with minimal dependence on simulation is developed. This procedure preserves all multi-dimensional correlations present in the data. The expected $\sin^2θ_\ell$ dependence of the differential decay rate in the Standard Model is demonstrated, where $θ_\ell$ is the lepton helicity angle. Including input from the latest lattice QCD calculations and previously available experimental data, the underlying form factors are extracted using both model-independent (BGL) and dependent (CLN) methods. Comparisons with lattice calculations show flavor SU(3) symmetry to be a good approximation in the $B_{(s)}\to D_{(s)}$ sector. Using the BGL results, the CKM matrix element $|V_{cb}|=(41.09\pm 1.16)\times 10^{-3}$ and the Standard Model prediction of the lepton-flavor universality violation variable $\mathcal{R}(D)=0.300\pm 0.004$, are extracted. The value of $|V_{cb}|$ from $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ tends to be higher than that extracted using $\overline{B} \rightarrow D \ell^- \overlineν_\ell$. The Standard Model $\mathcal{R}(D)$ calculation is at a $1.97σ$ tension with the latest HFLAV experimental average. △ Less

Submitted 25 November, 2023; originally announced November 2023.

KMT-2023-BLG-1431Lb: A New $q < 10^{-4}$ Microlensing Planet from a Subtle Signature

Authors: Aislyn Bell, Jiyuan Zhang, Youn Kil Jung, Jennifer C. Yee, Hongjing Yang, Takahiro Sumi, Andrzej Udalski, Michael D. Albrow, Sun-Ju Chung, Andrew Gould, Cheongho Han, Kyu-Ha Hwang, Yoon-Hyun Ryu, In-Gu Shin, Yossi Shvartzvald, Weicheng Zang, Sang-Mok Cha, Dong-Jin Kim, Seung-Lee Kim, Chung-Uk Lee, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park, Richard W. Pogge, Yunyi Tang , et al. (48 additional authors not shown)

Abstract: The current studies of microlensing planets are limited by small number statistics. Follow-up observations of high-magnification microlensing events can efficiently form a statistical planetary sample. Since 2020, the Korea Microlensing Telescope Network (KMTNet) and the Las Cumbres Observatory (LCO) global network have been conducting a follow-up program for high-magnification KMTNet events. Here… ▽ More The current studies of microlensing planets are limited by small number statistics. Follow-up observations of high-magnification microlensing events can efficiently form a statistical planetary sample. Since 2020, the Korea Microlensing Telescope Network (KMTNet) and the Las Cumbres Observatory (LCO) global network have been conducting a follow-up program for high-magnification KMTNet events. Here, we report the detection and analysis of a microlensing planetary event, KMT-2023-BLG-1431, for which the subtle (0.05 magnitude) and short-lived (5 hours) planetary signature was characterized by the follow-up from KMTNet and LCO. A binary-lens single-source (2L1S) analysis reveals a planet/host mass ratio of $q = (0.72 \pm 0.07) \times 10^{-4}$, and the single-lens binary-source (1L2S) model is excluded by $Δχ^2 = 80$. A Bayesian analysis using a Galactic model yields estimates of the host star mass of $M_{\rm host} = 0.57^{+0.33}_{-0.29}~M_\odot$, the planetary mass of $M_{\rm planet} = 13.5_{-6.8}^{+8.1}~M_{\oplus}$, and the lens distance of $D_{\rm L} = 6.9_{-1.7}^{+0.8}$ kpc. The projected planet-host separation of $a_\perp = 2.3_{-0.5}^{+0.5}$ au or $a_\perp = 3.2_{-0.8}^{+0.7}$, subject to the close/wide degeneracy. We also find that without the follow-up data, the survey-only data cannot break the degeneracy of central/resonant caustics and the degeneracy of 2L1S/1L2S models, showing the importance of follow-up observations for current microlensing surveys. △ Less

Submitted 21 November, 2023; originally announced November 2023.

Comments: PASP submitted. arXiv admin note: text overlap with arXiv:2301.06779

Fine-Tuning the Retrieval Mechanism for Tabular Deep Learning

Authors: Felix den Breejen, Sangmin Bae, Stephen Cha, Tae-Young Kim, Seoung Hyun Koh, Se-Young Yun

Abstract: While interests in tabular deep learning has significantly grown, conventional tree-based models still outperform deep learning methods. To narrow this performance gap, we explore the innovative retrieval mechanism, a methodology that allows neural networks to refer to other data points while making predictions. Our experiments reveal that retrieval-based training, especially when fine-tuning the… ▽ More While interests in tabular deep learning has significantly grown, conventional tree-based models still outperform deep learning methods. To narrow this performance gap, we explore the innovative retrieval mechanism, a methodology that allows neural networks to refer to other data points while making predictions. Our experiments reveal that retrieval-based training, especially when fine-tuning the pretrained TabPFN model, notably surpasses existing methods. Moreover, the extensive pretraining plays a crucial role to enhance the performance of the model. These insights imply that blending the retrieval mechanism with pretraining and transfer learning schemes offers considerable potential for advancing the field of tabular deep learning. △ Less

Submitted 13 November, 2023; originally announced November 2023.

Comments: Table Representation Learning Workshop at NeurIPS 2023

Pursuing equitable access to vaccines for the next epidemic

Authors: Hsin-Ju Chou, Jing-Yuan Ko, Sung-Po Chao

Abstract: To mitigate the pandemic stemming from COVID-19, numerous nations have initiated extensive vaccination campaigns for their citizens since late 2020. While affluent countries have predominantly received vaccine allocations, fewer doses have been dispatched to nations with lower average incomes. This unequal distribution not only widens the disparity between wealthy and impoverished regions but also… ▽ More To mitigate the pandemic stemming from COVID-19, numerous nations have initiated extensive vaccination campaigns for their citizens since late 2020. While affluent countries have predominantly received vaccine allocations, fewer doses have been dispatched to nations with lower average incomes. This unequal distribution not only widens the disparity between wealthy and impoverished regions but also prolongs the pandemic, evident in the emergence of new viral variants. Our research delves into the correlation between the duration of the pandemic and the timing of vaccine distribution between two countries with migratory ties. By using a pair of coupled Susceptible- Infected-Recovered-Deceased (SIRD) models incorporating vaccination data, we demonstrate that timely sharing of vaccines benefits both nations, regardless of the presence of viral variants. This underscores that in the realm of vaccine distribution, self-interest and altruism are not mutually exclusive. △ Less

Submitted 28 March, 2024; v1 submitted 10 November, 2023; originally announced November 2023.

Comments: v.2: 14 pages, 7 sets of figures (English rephrasing, figures reploting, refrerence added)

Systematic Reanalysis of KMTNet microlensing events, Paper I: Updates of the Photometry Pipeline and a New Planet Candidate

Authors: Hongjing Yang, Jennifer C. Yee, Kyu-Ha Hwang, Qiyue Qian, Ian A. Bond, Andrew Gould, Zhecheng Hu, Jiyuan Zhang, Shude Mao, Wei Zhu, Michael D. Albrow, Sun-Ju Chung, Cheongho Han, Youn Kil Jung, Yoon-Hyun Ryu, In-Gu Shin, Yossi Shvartzvald, Sang-Mok Cha, Dong-Jin Kim, Hyoun-Woo Kim, Seung-Lee Kim, Chung-Uk Lee, Dong-Joo Lee, Yongseok Lee, Byeong-Gon Park , et al. (30 additional authors not shown)

Abstract: In this work, we update and develop algorithms for KMTNet tender-love care (TLC) photometry in order to create an new, mostly automated, TLC pipeline. We then start a project to systematically apply the new TLC pipeline to the historic KMTNet microlensing events, and search for buried planetary signals. We report the discovery of such a planet candidate in the microlensing event MOA-2019-BLG-421/K… ▽ More In this work, we update and develop algorithms for KMTNet tender-love care (TLC) photometry in order to create an new, mostly automated, TLC pipeline. We then start a project to systematically apply the new TLC pipeline to the historic KMTNet microlensing events, and search for buried planetary signals. We report the discovery of such a planet candidate in the microlensing event MOA-2019-BLG-421/KMT-2019-BLG-2991. The anomalous signal can be explained by either a planet around the lens star or the orbital motion of the source star. For the planetary interpretation, despite many degenerate solutions, the planet is most likely to be a Jovian planet orbiting an M or K dwarf, which is a typical microlensing planet. The discovery proves that the project can indeed increase the sensitivity of historic events and find previously undiscovered signals. △ Less

Submitted 8 November, 2023; originally announced November 2023.

Comments: 19 pages, 13 figures, 7 tables. Submitted to MNRAS

Weak-Lensing Analysis of the Complex Cluster Merger Abell 746 with Subaru/Hyper Suprime-Cam

Authors: Kim HyeongHan, Hyejeon Cho, M. James Jee, David Wittman, Sangjun Cha, Wonki Lee, Kyle Finner, Kamlesh Rajpurohit, Marcus Brüggen, William Forman, Christine Jones, Reinout van Weeren, Andrea Botteon, Lorenzo Lovisari, Andra Stroe, Paola Domínguez-Fernández, Ewan O'Sullivan, Jan Vrtilek

Abstract: The galaxy cluster Abell 746 (A746; $z$=0.214), featuring a double radio relic system, two isolated radio relics, a possible radio halo, disturbed V-shaped X-ray emission, and intricate galaxy distributions, is a unique and complex merging system. We present a weak-lensing analysis of A746 based on wide-field imaging data from Subaru/Hyper Suprime-Cam observations. The mass distribution is charact… ▽ More The galaxy cluster Abell 746 (A746; $z$=0.214), featuring a double radio relic system, two isolated radio relics, a possible radio halo, disturbed V-shaped X-ray emission, and intricate galaxy distributions, is a unique and complex merging system. We present a weak-lensing analysis of A746 based on wide-field imaging data from Subaru/Hyper Suprime-Cam observations. The mass distribution is characterized by a main peak which coincides with the center of the X-ray emission. At this main peak, we detect two extensions toward the north and west, tracing the cluster galaxy and X-ray distributions. Despite the ongoing merger, our estimate of the A746 global mass $M_{500}=4.4\pm1.0\times10^{14}~M_{\odot}$ is consistent with the previous results from SZ and X-ray observations. We conclude that reconciling the distributions of mass, galaxies, and intracluster medium with the double radio relic system and other radio features remains challenging. △ Less

Submitted 14 February, 2024; v1 submitted 1 November, 2023; originally announced November 2023.

Comments: Published in ApJ

Journal ref: 2024 ApJ 962 100

A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions

Authors: Junchao Wu, Shu Yang, Runzhe Zhan, Yulin Yuan, Derek F. Wong, Lidia S. Chao

Abstract: The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As LLMs continue to expand, there is an imperative need to develop detectors that can detect LLM-generated text. This is crucial to mitigate potential misuse of LLMs… ▽ More The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As LLMs continue to expand, there is an imperative need to develop detectors that can detect LLM-generated text. This is crucial to mitigate potential misuse of LLMs and safeguard realms like artistic expression and social networks from harmful influence of LLM-generated content. The LLM-generated text detection aims to discern if a piece of text was produced by an LLM, which is essentially a binary classification task. The detector techniques have witnessed notable advancements recently, propelled by innovations in watermarking techniques, statistics-based detectors, neural-base detectors, and human-assisted methods. In this survey, we collate recent research breakthroughs in this area and underscore the pressing need to bolster detector research. We also delve into prevalent datasets, elucidating their limitations and developmental requirements. Furthermore, we analyze various LLM-generated text detection paradigms, shedding light on challenges like out-of-distribution problems, potential attacks, real-world data issues and the lack of effective evaluation framework. Conclusively, we highlight interesting directions for future research in LLM-generated text detection to advance the implementation of responsible artificial intelligence (AI). Our aim with this survey is to provide a clear and comprehensive introduction for newcomers while also offering seasoned researchers a valuable update in the field of LLM-generated text detection. The useful resources are publicly available at: https://github.com/NLP2CT/LLM-generated-Text-Detection. △ Less

Submitted 19 April, 2024; v1 submitted 23 October, 2023; originally announced October 2023.

On the Temperature of Bayesian Graph Neural Networks for Conformal Prediction

Authors: Seohyeon Cha, Honggu Kang, Joonhyuk Kang

Abstract: Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifying uncertainty by providing $\textit{valid}$ prediction sets for any black-box model. CP ensures formal probabilistic guarantees that a prediction set contains a true label with a… ▽ More Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifying uncertainty by providing $\textit{valid}$ prediction sets for any black-box model. CP ensures formal probabilistic guarantees that a prediction set contains a true label with a desired probability. However, the size of prediction sets, known as $\textit{inefficiency}$, is influenced by the underlying model and data generating process. On the other hand, Bayesian learning also provides a credible region based on the estimated posterior distribution, but this region is $\textit{well-calibrated}$ only when the model is correctly specified. Building on a recent work that introduced a scaling parameter for constructing valid credible regions from posterior estimate, our study explores the advantages of incorporating a temperature parameter into Bayesian GNNs within CP framework. We empirically demonstrate the existence of temperatures that result in more efficient prediction sets. Furthermore, we conduct an analysis to identify the factors contributing to inefficiency and offer valuable insights into the relationship between CP performance and model calibration. △ Less

Submitted 3 December, 2023; v1 submitted 17 October, 2023; originally announced October 2023.

Human-in-the-loop Machine Translation with Large Language Model

Authors: Xinyi Yang, Runzhe Zhan, Derek F. Wong, Junchao Wu, Lidia S. Chao

Abstract: The large language model (LLM) has garnered significant attention due to its in-context learning mechanisms and emergent capabilities. The research community has conducted several pilot studies to apply LLMs to machine translation tasks and evaluate their performance from diverse perspectives. However, previous research has primarily focused on the LLM itself and has not explored human interventio… ▽ More The large language model (LLM) has garnered significant attention due to its in-context learning mechanisms and emergent capabilities. The research community has conducted several pilot studies to apply LLMs to machine translation tasks and evaluate their performance from diverse perspectives. However, previous research has primarily focused on the LLM itself and has not explored human intervention in the inference process of LLM. The characteristics of LLM, such as in-context learning and prompt engineering, closely mirror human cognitive abilities in language tasks, offering an intuitive solution for human-in-the-loop generation. In this study, we propose a human-in-the-loop pipeline that guides LLMs to produce customized outputs with revision instructions. The pipeline initiates by prompting the LLM to produce a draft translation, followed by the utilization of automatic retrieval or human feedback as supervision signals to enhance the LLM's translation through in-context learning. The human-machine interactions generated in this pipeline are also stored in an external database to expand the in-context retrieval database, enabling us to leverage human supervision in an offline setting. We evaluate the proposed pipeline using GPT-3.5-turbo API on five domain-specific benchmarks for German-English translation. The results demonstrate the effectiveness of the pipeline in tailoring in-domain translations and improving translation performance compared to direct translation. Additionally, we discuss the results from the following perspectives: 1) the effectiveness of different in-context retrieval methods; 2) the construction of a retrieval database under low-resource scenarios; 3) the observed domains differences; 4) the quantitative analysis of linguistic statistics; and 5) the qualitative analysis of translation cases. The code and data are available at https://github.com/NLP2CT/HIL-MT/. △ Less

Submitted 13 October, 2023; originally announced October 2023.

Comments: Accepted to MT Summit 2023

Demonstration of chronometric leveling using transportable optical clocks beyond laser coherence limit

Authors: Yi Yuan, Kaifeng Cui, Daoxin Liu, Jinbo Yuan, Jian Cao, Dehao Wang, Sijia Chao, Hualin Shu, Xueren Haung

Abstract: Optical clock network requires the establishment of optical frequency transmission link between multiple optical clocks, utilizing narrow linewidth lasers. Despite achieving link noise levels of 10${^{-20}}$, the final accuracy is limited by the phase noise of the clock laser. Correlation spectroscopy is developed to transmit frequency information between two optical clocks directly, enabling opti… ▽ More Optical clock network requires the establishment of optical frequency transmission link between multiple optical clocks, utilizing narrow linewidth lasers. Despite achieving link noise levels of 10${^{-20}}$, the final accuracy is limited by the phase noise of the clock laser. Correlation spectroscopy is developed to transmit frequency information between two optical clocks directly, enabling optical clock comparison beyond the phase noise limit of clock lasers, and significantly enhancing the measurement accuracy or shorten the measurement time. In this letter, two compact transportable ${^{40}}$Ca${^+}$ clocks are employed to accomplish the correlation spectroscopy comparison, demonstrating an 10 cm level measurement accuracy of chronometric leveling using a mediocre clock laser with linewidth of 200 Hz. The relative frequency instability reaches $6.0\times10{^{-15}}/\sqrt{τ/s}$, which is about 20 times better than the result with Rabi spectroscopy using the same clock laser. This research greatly reduces the harsh requirements on the performance of the clock laser, so that an ordinary stable-laser can also be employed in the construction of optical clock network, which is essential for the field applications, especially for the chronometric leveling. △ Less

Submitted 12 October, 2023; originally announced October 2023.

Weak-Lensing Detection of Intracluster Filaments in the Coma Cluster

Authors: Kim HyeongHan, M. James Jee, Sangjun Cha, Hyejeon Cho

Abstract: Our concordance cosmological model predicts that galaxy clusters grow at the intersection of filaments structuring the cosmic web stretching tens of Mega parsecs. Although this hypothesis has been supported by the baryonic components, no observational study has detected the dark matter component of the intracluster filaments (ICFs), the terminal segment of the large-scale cosmic filaments at their… ▽ More Our concordance cosmological model predicts that galaxy clusters grow at the intersection of filaments structuring the cosmic web stretching tens of Mega parsecs. Although this hypothesis has been supported by the baryonic components, no observational study has detected the dark matter component of the intracluster filaments (ICFs), the terminal segment of the large-scale cosmic filaments at their conjunction with individual clusters. We report weak-lensing detection of ICFs in the Coma cluster field from the ~12 sq. deg Hyper Suprime-Cam imaging data. The detection is based on two methods: matched-filter technique and shear-peak statistic. The matched-filter technique (shear-peak statistic) yields detection significances of 6.6- (3.1) $σ$ and 3.6- (2.8) $σ$ for the northern and western ICFs at 110$^{\circ}$ and 340$^{\circ}$, respectively. Both ICFs are highly correlated with the overdensities in the WL mass reconstruction and are well-aligned with the known large-scale ($>10$ Mpc) cosmic filaments comprising the Coma supercluster. △ Less

Submitted 4 October, 2023; originally announced October 2023.

Comments: Accepted for publication by Nature Astronomy (2024). The current submission will differ from the published one