Showing 1–50 of 194 results for author: John, S

Towards Unlocking Insights from Logbooks Using AI

Authors: Antonin Sulc, Alex Bien, Annika Eichler, Daniel Ratner, Florian Rehm, Frank Mayet, Gregor Hartmann, Hayden Hoschouer, Henrik Tuennermann, Jan Kaiser, Jason St. John, Jennefer Maldonado, Kyle Hazelwood, Raimund Kammering, Thorsten Hellert, Tim Wilksen, Verena Kain, Wan-Lin Hu

Abstract: Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly t… ▽ More Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly testing a tailored Retrieval Augmented Generation (RAG) model for enhancing the usability of particle accelerator logbooks at institutes like DESY, BESSY, Fermilab, BNL, SLAC, LBNL, and CERN. The RAG model uses a corpus built on logbook contributions and aims to unlock insights from these logbooks by leveraging retrieval over facility datasets, including discussion about potential multimodal sources. Our goals are to increase the FAIR-ness (findability, accessibility, interoperability, and reusability) of logbooks by exploiting their information content to streamline everyday use, enable macro-analysis for root cause analysis, and facilitate problem-solving automation. △ Less

Submitted 25 May, 2024; originally announced June 2024.

Comments: 5 pages, 1 figure, 15th International Particle Accelerator Conference

Demonstration of neutron identification in neutrino interactions in the MicroBooNE liquid argon time projection chamber

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, A. Barnard, G. Barr, D. Barrow, J. Barrow, V. Basque, J. Bateman, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book , et al. (165 additional authors not shown)

Abstract: A significant challenge in measurements of neutrino oscillations is reconstructing the incoming neutrino energies. While modern fully-active tracking calorimeters such as liquid argon time projection chambers in principle allow the measurement of all final state particles above some detection threshold, undetected neutrons remain a considerable source of missing energy with little to no data const… ▽ More A significant challenge in measurements of neutrino oscillations is reconstructing the incoming neutrino energies. While modern fully-active tracking calorimeters such as liquid argon time projection chambers in principle allow the measurement of all final state particles above some detection threshold, undetected neutrons remain a considerable source of missing energy with little to no data constraining their production rates and kinematics. We present the first demonstration of tagging neutrino-induced neutrons in liquid argon time projection chambers using secondary protons emitted from neutron-argon interactions in the MicroBooNE detector. We describe the method developed to identify neutrino-induced neutrons and demonstrate its performance using neutrons produced in muon-neutrino charged current interactions. The method is validated using a small subset of MicroBooNE's total dataset. The selection yields a sample with $60\%$ of selected tracks corresponding to neutron-induced secondary protons. △ Less

Submitted 15 June, 2024; originally announced June 2024.

Report number: FERMILAB-PUB-24-0301

Improving neutrino energy estimation of charged-current interaction events with recurrent neural networks in MicroBooNE

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, A. Barnard, G. Barr, D. Barrow, J. Barrow, V. Basque, J. Bateman, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book , et al. (164 additional authors not shown)

Abstract: We present a deep learning-based method for estimating the neutrino energy of charged-current neutrino-argon interactions. We employ a recurrent neural network (RNN) architecture for neutrino energy estimation in the MicroBooNE experiment, utilizing liquid argon time projection chamber (LArTPC) detector technology. Traditional energy estimation approaches in LArTPCs, which largely rely on reconstr… ▽ More We present a deep learning-based method for estimating the neutrino energy of charged-current neutrino-argon interactions. We employ a recurrent neural network (RNN) architecture for neutrino energy estimation in the MicroBooNE experiment, utilizing liquid argon time projection chamber (LArTPC) detector technology. Traditional energy estimation approaches in LArTPCs, which largely rely on reconstructing and summing visible energies, often experience sizable biases and resolution smearing because of the complex nature of neutrino interactions and the detector response. The estimation of neutrino energy can be improved after considering the kinematics information of reconstructed final-state particles. Utilizing kinematic information of reconstructed particles, the deep learning-based approach shows improved resolution and reduced bias for the muon neutrino Monte Carlo simulation sample compared to the traditional approach. In order to address the common concern about the effectiveness of this method on experimental data, the RNN-based energy estimator is further examined and validated with dedicated data-simulation consistency tests using MicroBooNE data. We also assess its potential impact on a neutrino oscillation study after accounting for all statistical and systematic uncertainties and show that it enhances physics sensitivity. This method has good potential to improve the performance of other physics analyses. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Report number: FERMILAB-PUB-24-0287

Identifying latent state transition in non-linear dynamical systems

Authors: Çağlar Hızlı, Çağatay Yıldız, Matthias Bethge, ST John, Pekka Marttinen

Abstract: This work aims to improve generalization and interpretability of dynamical systems by recovering the underlying lower-dimensional latent states and their time evolutions. Previous work on disentangled representation learning within the realm of dynamical systems focused on the latent states, possibly with linear transition approximations. As such, they cannot identify nonlinear transition dynamics… ▽ More This work aims to improve generalization and interpretability of dynamical systems by recovering the underlying lower-dimensional latent states and their time evolutions. Previous work on disentangled representation learning within the realm of dynamical systems focused on the latent states, possibly with linear transition approximations. As such, they cannot identify nonlinear transition dynamics, and hence fail to reliably predict complex future behavior. Inspired by the advances in nonlinear ICA, we propose a state-space modeling framework in which we can identify not just the latent states but also the unknown transition function that maps the past states to the present. We introduce a practical algorithm based on variational auto-encoders and empirically demonstrate in realistic synthetic settings that we can (i) recover latent state dynamics with high accuracy, (ii) correspondingly achieve high future prediction accuracy, and (iii) adapt fast to new environments. △ Less

Submitted 6 June, 2024; v1 submitted 5 June, 2024; originally announced June 2024.

The Canadian VirusSeq Data Portal & Duotang: open resources for SARS-CoV-2 viral sequences and genomic epidemiology

Authors: Erin E. Gill, Baofeng Jia, Carmen Lia Murall, Raphaël Poujol, Muhammad Zohaib Anwar, Nithu Sara John, Justin Richardsson, Ashley Hobb, Abayomi S. Olabode, Alexandru Lepsa, Ana T. Duggan, Andrea D. Tyler, Arnaud N'Guessan, Atul Kachru, Brandon Chan, Catherine Yoshida, Christina K. Yung, David Bujold, Dusan Andric, Edmund Su, Emma J. Griffiths, Gary Van Domselaar, Gordon W. Jolly, Heather K. E. Ward, Henrich Feher , et al. (45 additional authors not shown)

Abstract: The COVID-19 pandemic led to a large global effort to sequence SARS-CoV-2 genomes from patient samples to track viral evolution and inform public health response. Millions of SARS-CoV-2 genome sequences have been deposited in global public repositories. The Canadian COVID-19 Genomics Network (CanCOGeN - VirusSeq), a consortium tasked with coordinating expanded sequencing of SARS-CoV-2 genomes acro… ▽ More The COVID-19 pandemic led to a large global effort to sequence SARS-CoV-2 genomes from patient samples to track viral evolution and inform public health response. Millions of SARS-CoV-2 genome sequences have been deposited in global public repositories. The Canadian COVID-19 Genomics Network (CanCOGeN - VirusSeq), a consortium tasked with coordinating expanded sequencing of SARS-CoV-2 genomes across Canada early in the pandemic, created the Canadian VirusSeq Data Portal, with associated data pipelines and procedures, to support these efforts. The goal of VirusSeq was to allow open access to Canadian SARS-CoV-2 genomic sequences and enhanced, standardized contextual data that were unavailable in other repositories and that meet FAIR standards (Findable, Accessible, Interoperable and Reusable). The Portal data submission pipeline contains data quality checking procedures and appropriate acknowledgement of data generators that encourages collaboration. Here we also highlight Duotang, a web platform that presents genomic epidemiology and modeling analyses on circulating and emerging SARS-CoV-2 variants in Canada. Duotang presents dynamic changes in variant composition of SARS-CoV-2 in Canada and by province, estimates variant growth, and displays complementary interactive visualizations, with a text overview of the current situation. The VirusSeq Data Portal and Duotang resources, alongside additional analyses and resources computed from the Portal (COVID-MVP, CoVizu), are all open-source and freely available. Together, they provide an updated picture of SARS-CoV-2 evolution to spur scientific discussions, inform public discourse, and support communication with and within public health authorities. They also serve as a framework for other jurisdictions interested in open, collaborative sequence data sharing and analyses. △ Less

Submitted 7 May, 2024; originally announced May 2024.

First double-differential cross section measurement of neutral-current $π^0$ production in neutrino-argon scattering in the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, A. Barnard, G. Barr, D. Barrow, J. Barrow, V. Basque, J. Bateman, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book , et al. (166 additional authors not shown)

Abstract: We report the first double-differential cross section measurement of neutral-current neutral pion (NC$π^0$) production in neutrino-argon scattering, as well as single-differential measurements of the same channel in terms of final states with and without protons. The kinematic variables of interest for these measurements are the $π^0$ momentum and the $π^0$ scattering angle with respect to the neu… ▽ More We report the first double-differential cross section measurement of neutral-current neutral pion (NC$π^0$) production in neutrino-argon scattering, as well as single-differential measurements of the same channel in terms of final states with and without protons. The kinematic variables of interest for these measurements are the $π^0$ momentum and the $π^0$ scattering angle with respect to the neutrino beam. A total of 4971 candidate NC$π^0$ events fully-contained within the MicroBooNE detector are selected using data collected at a mean neutrino energy of $\sim 0.8$ GeV from $6.4\times10^{20}$ protons on target from the Booster Neutrino Beam at the Fermi National Accelerator Laboratory. After extensive data-driven model validation to ensure unbiased unfolding, the Wiener-SVD method is used to extract nominal flux-averaged cross sections. The results are compared to predictions from commonly used neutrino event generators, which tend to overpredict the measured NC$π^0$ cross section, especially in the 0.2-0.5 GeV/c $π^0$ momentum range, at forward scattering angles, and when at least one proton is present in the final state. These measurements show sensitivity to a variety of features that complicate the description of NC$π^0$ production including the form factors describing the elementary neutrino interaction and the final state interactions of the outgoing particles in the residual argon nucleus. This data will help improve the modeling of NC$π^0$ production, which represents a major background in measurements of charge-parity violation in the neutrino sector and in searches for new physics beyond the Standard Model. △ Less

Submitted 16 April, 2024; originally announced April 2024.

Report number: FERMILAB-PUB-24-0125

Measurement of the differential cross section for neutral pion production in charged-current muon neutrino interactions on argon with the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (163 additional authors not shown)

Abstract: We present a measurement of neutral pion production in charged-current interactions using data recorded with the MicroBooNE detector exposed to Fermilab's booster neutrino beam. The signal comprises one muon, one neutral pion, any number of nucleons, and no charged pions. Studying neutral pion production in the MicroBooNE detector provides an opportunity to better understand neutrino-argon interac… ▽ More We present a measurement of neutral pion production in charged-current interactions using data recorded with the MicroBooNE detector exposed to Fermilab's booster neutrino beam. The signal comprises one muon, one neutral pion, any number of nucleons, and no charged pions. Studying neutral pion production in the MicroBooNE detector provides an opportunity to better understand neutrino-argon interactions, and is crucial for future accelerator-based neutrino oscillation experiments. Using a dataset corresponding to $6.86 \times 10^{20}$ protons on target, we present single-differential cross sections in muon and neutral pion momenta, scattering angles with respect to the beam for the outgoing muon and neutral pion, as well as the opening angle between the muon and neutral pion. Data extracted cross sections are compared to generator predictions. We report good agreement between the data and the models for scattering angles, except for an over-prediction by generators at muon forward angles. Similarly, the agreement between data and the models as a function of momentum is good, except for an underprediction by generators in the medium momentum ranges, $200-400$ MeV for muons and $100-200$ MeV for pions. △ Less

Submitted 6 May, 2024; v1 submitted 15 April, 2024; originally announced April 2024.

Report number: FERMILAB-PUB-24-0142-CSAID-PPD

Towards Developing Brain-Computer Interfaces for People with Multiple Sclerosis

Authors: John S. Russo, Tim Mahoney, Kirill Kokorin, Ashley Reynolds, Chin-Hsuan Sophie Lin, Sam E. John, David B. Grayden

Abstract: Multiple Sclerosis (MS) is a severely disabling condition that leads to various neurological symptoms. A Brain-Computer Interface (BCI) may substitute some lost function; however, there is a lack of BCI research in people with MS. To progress this research area effectively and efficiently, we aimed to evaluate user needs and assess the feasibility and user-centric requirements of a BCI for people… ▽ More Multiple Sclerosis (MS) is a severely disabling condition that leads to various neurological symptoms. A Brain-Computer Interface (BCI) may substitute some lost function; however, there is a lack of BCI research in people with MS. To progress this research area effectively and efficiently, we aimed to evaluate user needs and assess the feasibility and user-centric requirements of a BCI for people with MS. We conducted an online survey of 34 people with MS to qualitatively assess user preferences and establish the initial steps of user-centred design. The survey aimed to understand their interest and preferences in BCI and bionic applications. We demonstrated widespread interest for BCI applications in all stages of MS, with a preference for a non-invasive (n = 12) or minimally invasive (n = 15) BCI over carer assistance (n = 6). Qualitative assessment indicated that this preference was not influenced by level of independence. Additionally, strong interest was noted in bionic technology for sensory and autonomic functions. Considering the potential to enhance independence and quality of life for people living with MS, the results emphasise the importance of user-centred design for future advancement of BCIs that account for the unique pathological changes associated with MS. △ Less

Submitted 8 April, 2024; v1 submitted 7 April, 2024; originally announced April 2024.

Comments: 18 pages, 9 figures, 1 table. For supplementary material, please contact the corresponding author; corrected ordering of figures 6 and 7

Measurement of double-differential cross sections for mesonless charged-current muon neutrino interactions on argon with final-state protons using the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (163 additional authors not shown)

Abstract: Charged-current neutrino interactions with final states containing zero mesons and at least one proton are of high interest for current and future accelerator-based neutrino oscillation experiments. Using the Booster Neutrino Beam and the MicroBooNE detector at Fermi National Accelerator Laboratory, we have obtained the first double-differential cross section measurements of this channel for muon… ▽ More Charged-current neutrino interactions with final states containing zero mesons and at least one proton are of high interest for current and future accelerator-based neutrino oscillation experiments. Using the Booster Neutrino Beam and the MicroBooNE detector at Fermi National Accelerator Laboratory, we have obtained the first double-differential cross section measurements of this channel for muon neutrino scattering on an argon target with a proton momentum threshold of 0.25 GeV/c. We also report a flux-averaged total cross section of $σ= (11.8 \pm 1.2) \times 10^{-38}$ cm$^2$ / Ar and several single-differential measurements which extend and improve upon previous results. Statistical and systematic uncertainties are quantified with a full treatment of correlations across 359 kinematic bins, including correlations between distributions describing different observables. The resulting data set provides the most detailed information obtained to date for testing models of mesonless neutrino-argon scattering. △ Less

Submitted 16 April, 2024; v1 submitted 28 March, 2024; originally announced March 2024.

Comments: 83 pages, 67 figures (including supplemental material). For v2, added oversized files in extended data release

Report number: FERMILAB-PUB-24-0120-AD-CSAID-LBNF-PPD-TD

Bessel-beam direct-write of the etch-mask in a nano-film of alumina for high-efficiency Si solar cells

Authors: Tomas Katkus, Soon Hock Ng, Haoran Mu, Nguyen Hoai An Le, Dominyka Stonyte, Zahra Khajehsaeidimahabadi, Gediminas Seniutinas, Justas Baltrukonis, Orestas Ulcinas, Mindaugas Mikutis, Vytautas Sabonis, Yoshiaki Nishijima, Michael Rienacker, Jan Krugener, Robby Peibst, Sajeev John, Saulius Juodkazis

Abstract: Large surface area applications such as high-efficiency > 26% solar cells require surface patterning with 1-10 micrometers periodic patterns at high fidelity over 1-10 cm^2 areas (before up scaling to 1 m^2) to perform at, or exceed, the Lambertian (ray optics) limit of light trapping. Here we show a pathway to high-resolution sub-1 micrometer etch mask patterning by ablation using direct femtosec… ▽ More Large surface area applications such as high-efficiency > 26% solar cells require surface patterning with 1-10 micrometers periodic patterns at high fidelity over 1-10 cm^2 areas (before up scaling to 1 m^2) to perform at, or exceed, the Lambertian (ray optics) limit of light trapping. Here we show a pathway to high-resolution sub-1 micrometer etch mask patterning by ablation using direct femtosecond laser writing performed at room conditions (without the need for a vacuum-based lithography approach). A Bessel beam was used to alleviate the required high surface tracking tolerance for ablation of 0.3-0.8 micrometer diameter holes in ~40 nm alumina Al2O3-mask at high writing speed, 7.5 cm/s; a patterning rate 1 cm^2 per 20 min. The plasma etching protocol was optimised for a zero-mesa formation of photonic crystal (PhC) trapping structures and smooth surfaces at the nanoscale level. Scaling up in area and throughput of the demonstrated approach is outlined. △ Less

Submitted 21 March, 2024; originally announced March 2024.

Comments: 12 pages, 7 figures and 8 figures in appendix

First simultaneous measurement of differential muon-neutrino charged-current cross sections on argon for final states with and without protons using MicroBooNE data

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (163 additional authors not shown)

Abstract: We report the first double-differential neutrino-argon cross section measurement made simultaneously for final states with and without protons for the inclusive muon neutrino charged-current interaction channel. The proton kinematics of this channel are further explored with a differential cross section measurement as a function of the leading proton's kinetic energy that extends across the detect… ▽ More We report the first double-differential neutrino-argon cross section measurement made simultaneously for final states with and without protons for the inclusive muon neutrino charged-current interaction channel. The proton kinematics of this channel are further explored with a differential cross section measurement as a function of the leading proton's kinetic energy that extends across the detection threshold. These measurements utilize data collected using the MicroBooNE detector from 6.4$\times10^{20}$ protons on target from the Fermilab Booster Neutrino Beam with a mean neutrino energy of $\sim$0.8 GeV. Extensive data-driven model validation utilizing the conditional constraint formalism is employed. This motivates enlarging the uncertainties with an empirical reweighting approach to minimize the possibility of extracting biased cross section results. The extracted nominal flux-averaged cross sections are compared to widely used event generator predictions revealing severe mismodeling of final states without protons for muon neutrino charged-current interactions, possibly from insufficient treatment of final state interactions. These measurements provide a wealth of new information useful for improving event generators which will enhance the sensitivity of precision measurements in neutrino experiments. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Report number: FERMILAB-PUB-24-0045

Inclusive cross section measurements in final states with and without protons for charged-current $ν_μ$-Ar scattering in MicroBooNE

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (164 additional authors not shown)

Abstract: A detailed understanding of inclusive muon neutrino charged-current interactions on argon is crucial to the study of neutrino oscillations in current and future experiments using liquid argon time projection chambers. To that end, we report a comprehensive set of differential cross section measurements for this channel that simultaneously probe the leptonic and hadronic systems by dividing the cha… ▽ More A detailed understanding of inclusive muon neutrino charged-current interactions on argon is crucial to the study of neutrino oscillations in current and future experiments using liquid argon time projection chambers. To that end, we report a comprehensive set of differential cross section measurements for this channel that simultaneously probe the leptonic and hadronic systems by dividing the channel into final states with and without protons. Measurements of the proton kinematics and proton multiplicity of the final state are also presented. For these measurements, we utilize data collected with the MicroBooNE detector from 6.4$\times10^{20}$ protons on target from the Fermilab Booster Neutrino Beam at a mean neutrino energy of approximately 0.8 GeV. We present in detail the cross section extraction procedure, including the unfolding, and model validation that uses data to model comparisons and the conditional constraint formalism to detect mismodeling that may introduce biases to extracted cross sections that are larger than their uncertainties. The validation exposes insufficiencies in the overall model, motivating the inclusion of an additional data-driven reweighting systematic to ensure the accuracy of the unfolding. The extracted results are compared to a number of event generators and their performance is discussed with a focus on the regions of phase-space that indicate the greatest need for modeling improvements. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Report number: FERMILAB-PUB-24-0044

Beyond PID Controllers: PPO with Neuralized PID Policy for Proton Beam Intensity Control in Mu2e

Authors: Chenwei Xu, Jerry Yao-Chieh Hu, Aakaash Narayanan, Mattson Thieme, Vladimir Nagaslaev, Mark Austin, Jeremy Arnold, Jose Berlioz, Pierrick Hanlet, Aisha Ibrahim, Dennis Nicklaus, Jovan Mitrevski, Jason Michael St. John, Gauri Pradhan, Andrea Saewert, Kiyomi Seiya, Brian Schupbach, Randy Thurman-Keup, Nhan Tran, Rui Shi, Seda Ogrenci, Alexis Maya-Isabelle Shuping, Kyle Hazelwood, Han Liu

Abstract: We introduce a novel Proximal Policy Optimization (PPO) algorithm aimed at addressing the challenge of maintaining a uniform proton beam intensity delivery in the Muon to Electron Conversion Experiment (Mu2e) at Fermi National Accelerator Laboratory (Fermilab). Our primary objective is to regulate the spill process to ensure a consistent intensity profile, with the ultimate goal of creating an aut… ▽ More We introduce a novel Proximal Policy Optimization (PPO) algorithm aimed at addressing the challenge of maintaining a uniform proton beam intensity delivery in the Muon to Electron Conversion Experiment (Mu2e) at Fermi National Accelerator Laboratory (Fermilab). Our primary objective is to regulate the spill process to ensure a consistent intensity profile, with the ultimate goal of creating an automated controller capable of providing real-time feedback and calibration of the Spill Regulation System (SRS) parameters on a millisecond timescale. We treat the Mu2e accelerator system as a Markov Decision Process suitable for Reinforcement Learning (RL), utilizing PPO to reduce bias and enhance training stability. A key innovation in our approach is the integration of a neuralized Proportional-Integral-Derivative (PID) controller into the policy function, resulting in a significant improvement in the Spill Duty Factor (SDF) by 13.6%, surpassing the performance of the current PID controller baseline by an additional 1.6%. This paper presents the preliminary offline results based on a differentiable simulator of the Mu2e accelerator. It paves the groundwork for real-time implementations and applications, representing a crucial step towards automated proton beam intensity control for the Mu2e experiment. △ Less

Submitted 28 December, 2023; originally announced December 2023.

Comments: 10 pages, accepted at NeurIPS 2023 ML4Phy Workshop

First search for dark-trident processes using the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (163 additional authors not shown)

Abstract: We present a first search for dark-trident scattering in a neutrino beam using a data set corresponding to $7.2 \times 10^{20}$ protons on target taken with the MicroBooNE detector at Fermilab. Proton interactions in the neutrino target at the Main Injector produce $π^0$ and $η$ mesons, which could decay into dark-matter (DM) particles mediated via a dark photon $A^\prime$. A convolutional neural… ▽ More We present a first search for dark-trident scattering in a neutrino beam using a data set corresponding to $7.2 \times 10^{20}$ protons on target taken with the MicroBooNE detector at Fermilab. Proton interactions in the neutrino target at the Main Injector produce $π^0$ and $η$ mesons, which could decay into dark-matter (DM) particles mediated via a dark photon $A^\prime$. A convolutional neural network is trained to identify interactions of the DM particles in the liquid-argon time projection chamber (LArTPC) exploiting its image-like reconstruction capability. In the absence of a DM signal, we provide limits at the $90\%$ confidence level on the squared kinematic mixing parameter $\varepsilon^2$ as a function of the dark-photon mass in the range $10\le M_{A^\prime}\le 400$ MeV. The limits cover previously unconstrained parameter space for the production of fermion or scalar DM particles $χ$ for two benchmark models with mass ratios $M_χ/M_{A^\prime}=0.6$ and $2$ and for dark fine-structure constants $0.1\leα_D\le 1$. △ Less

Submitted 16 May, 2024; v1 submitted 21 December, 2023; originally announced December 2023.

Bayesian Optimization Algorithms for Accelerator Physics

Authors: Ryan Roussel, Auralee L. Edelen, Tobias Boltz, Dylan Kennedy, Zhe Zhang, Fuhao Ji, Xiaobiao Huang, Daniel Ratner, Andrea Santamaria Garcia, Chenran Xu, Jan Kaiser, Angel Ferran Pousa, Annika Eichler, Jannis O. Lubsen, Natalie M. Isenberg, Yuan Gao, Nikita Kuklev, Jose Martinez, Brahim Mustapha, Verena Kain, Weijian Lin, Simone Maria Liuzzo, Jason St. John, Matthew J. V. Streeter, Remi Lehe , et al. (1 additional authors not shown)

Abstract: Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics… ▽ More Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics community has recognized the advantages of Bayesian optimization algorithms, which leverage statistical surrogate models of objective functions to effectively address complex optimization challenges, especially in the presence of noise during accelerator operation and in resource-intensive physics simulations. In this review article, we offer a conceptual overview of applying Bayesian optimization techniques towards solving optimization problems in accelerator physics. We begin by providing a straightforward explanation of the essential components that make up Bayesian optimization techniques. We then give an overview of current and previous work applying and modifying these techniques to solve accelerator physics challenges. Finally, we explore practical implementation strategies for Bayesian optimization algorithms to maximize their performance, enabling users to effectively address complex optimization challenges in real-time beam control and accelerator design. △ Less

Submitted 5 April, 2024; v1 submitted 9 December, 2023; originally announced December 2023.

Nonparametric modeling of the composite effect of multiple nutrients on blood glucose dynamics

Authors: Arina Odnoblyudova, Çağlar Hizli, ST John, Andrea Cognolato, Anne Juuti, Simo Särkkä, Kirsi Pietiläinen, Pekka Marttinen

Abstract: In biomedical applications it is often necessary to estimate a physiological response to a treatment consisting of multiple components, and learn the separate effects of the components in addition to the joint effect. Here, we extend existing probabilistic nonparametric approaches to explicitly address this problem. We also develop a new convolution-based model for composite treatment-response cur… ▽ More In biomedical applications it is often necessary to estimate a physiological response to a treatment consisting of multiple components, and learn the separate effects of the components in addition to the joint effect. Here, we extend existing probabilistic nonparametric approaches to explicitly address this problem. We also develop a new convolution-based model for composite treatment-response curves that is more biologically interpretable. We validate our models by estimating the impact of carbohydrate and fat in meals on blood glucose. By differentiating treatment components, incorporating their dosages, and sharing statistical information across patients via a hierarchical multi-output Gaussian process, our method improves prediction accuracy over existing approaches, and allows us to interpret the different effects of carbohydrates and fat on the overall glucose response. △ Less

Submitted 6 November, 2023; originally announced November 2023.

Thin and Deep Gaussian Processes

Authors: Daniel Augusto de Souza, Alexander Nikitin, ST John, Magnus Ross, Mauricio A. Álvarez, Marc Peter Deisenroth, João P. P. Gomes, Diego Mesquita, César Lincoln C. Mattos

Abstract: Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting an appropriate kernel can be challenging. Deep GPs avoid manual kernel engineering by successively parameterizing kernels with GP layers, allowing them to learn… ▽ More Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting an appropriate kernel can be challenging. Deep GPs avoid manual kernel engineering by successively parameterizing kernels with GP layers, allowing them to learn low-dimensional embeddings of the inputs that explain the output data. Following the architecture of deep neural networks, the most common deep GPs warp the input space layer-by-layer but lose all the interpretability of shallow GPs. An alternative construction is to successively parameterize the lengthscale of a kernel, improving the interpretability but ultimately giving away the notion of learning lower-dimensional embeddings. Unfortunately, both methods are susceptible to particular pathologies which may hinder fitting and limit their interpretability. This work proposes a novel synthesis of both previous approaches: Thin and Deep GP (TDGP). Each TDGP layer defines locally linear transformations of the original input data maintaining the concept of latent embeddings while also retaining the interpretation of lengthscales of a kernel. Moreover, unlike the prior solutions, TDGP induces non-pathological manifolds that admit learning lower-dimensional representations. We show with theoretical and experimental results that i) TDGP is, unlike previous models, tailored to specifically discover lower-dimensional manifolds in the input data, ii) TDGP behaves well when increasing the number of layers, and iii) TDGP performs well in standard benchmark datasets. △ Less

Submitted 17 October, 2023; originally announced October 2023.

Comments: Accepted at the Conference on Neural Information Processing Systems (NeurIPS) 2023

Search for heavy neutral leptons in electron-positron and neutral-pion final states with the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (163 additional authors not shown)

Abstract: We present the first search for heavy neutral leptons (HNL) decaying into $νe^+e^-$ or $νπ^0$ final states in a liquid-argon time projection chamber using data collected with the MicroBooNE detector. The data were recorded synchronously with the NuMI neutrino beam from Fermilab's Main Injector corresponding to a total exposure of $7.01 \times 10^{20}$ protons on target. We set upper limits at the… ▽ More We present the first search for heavy neutral leptons (HNL) decaying into $νe^+e^-$ or $νπ^0$ final states in a liquid-argon time projection chamber using data collected with the MicroBooNE detector. The data were recorded synchronously with the NuMI neutrino beam from Fermilab's Main Injector corresponding to a total exposure of $7.01 \times 10^{20}$ protons on target. We set upper limits at the $90\%$ confidence level on the mixing parameter $\lvert U_{μ4}\rvert^2$ in the mass ranges $10\le m_{\rm HNL}\le 150$ MeV for the $νe^+e^-$ channel and $150\le m_{\rm HNL}\le 245$ MeV for the $νπ^0$ channel, assuming $\lvert U_{e 4}\rvert^2 = \lvert U_{τ4}\rvert^2 = 0$. These limits represent the most stringent constraints in the mass range $35<m_{\rm HNL}<175$ MeV and the first constraints from a direct search for $νπ^0$ decays. △ Less

Submitted 12 January, 2024; v1 submitted 11 October, 2023; originally announced October 2023.

Comments: Version as accepted by Physical Review Letters, some presentational changes and updated references, no changes to results

Report number: FERMILAB-PUB-23-574-ND

Measurement of nuclear effects in neutrino-argon interactions using generalized kinematic imbalance variables with the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, M. B. Brunetti, L. Camilleri , et al. (163 additional authors not shown)

Abstract: We present a set of new generalized kinematic imbalance variables that can be measured in neutrino scattering. These variables extend previous measurements of kinematic imbalance on the transverse plane, and are more sensitive to modeling of nuclear effects. We demonstrate the enhanced power of these variables using simulation, and then use the MicroBooNE detector to measure them for the first tim… ▽ More We present a set of new generalized kinematic imbalance variables that can be measured in neutrino scattering. These variables extend previous measurements of kinematic imbalance on the transverse plane, and are more sensitive to modeling of nuclear effects. We demonstrate the enhanced power of these variables using simulation, and then use the MicroBooNE detector to measure them for the first time. We report flux-integrated single- and double-differential measurements of charged-current muon neutrino scattering on argon using a topolgy with one muon and one proton in the final state as a function of these novel kinematic imbalance variables. These measurements allow us to demonstrate that the treatment of charged current quasielastic interactions in GENIE version 2 is inadequate to describe data. Further, they reveal tensions with more modern generator predictions particularly in regions of phase space where final state interactions are important. △ Less

Submitted 16 May, 2024; v1 submitted 9 October, 2023; originally announced October 2023.

Journal ref: Phys. Rev. D 109, 092007 (2024)

First application of a liquid argon time projection chamber for the search for intranuclear neutron-antineutron transitions and annihilation in $^{40}$Ar using the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, Y. Cao , et al. (164 additional authors not shown)

Abstract: We present a novel methodology to search for intranuclear neutron-antineutron transition ($n\rightarrow\bar{n}$) followed by $\bar{n}$-nucleon annihilation within an $^{40}$Ar nucleus, using the MicroBooNE liquid argon time projection chamber (LArTPC) detector. A discovery of $n\rightarrow\bar{n}$ transition or a new best limit on the lifetime of this process would either constitute physics beyond… ▽ More We present a novel methodology to search for intranuclear neutron-antineutron transition ($n\rightarrow\bar{n}$) followed by $\bar{n}$-nucleon annihilation within an $^{40}$Ar nucleus, using the MicroBooNE liquid argon time projection chamber (LArTPC) detector. A discovery of $n\rightarrow\bar{n}$ transition or a new best limit on the lifetime of this process would either constitute physics beyond the Standard Model or greatly constrain theories of baryogenesis, respectively. The approach presented in this paper makes use of deep learning methods to select $n\rightarrow\bar{n}$ events based on their unique features and differentiate them from cosmogenic backgrounds. The achieved signal and background efficiencies are (70.22$\pm$6.04)\% and (0.0020$\pm$0.0003)\%, respectively. A demonstration of a search is performed with a data set corresponding to an exposure of $3.32 \times10^{26}\,$neutron-years, and where the background rate is constrained through direct measurement, assuming the presence of a negligible signal. With this approach, no excess of events over the background prediction is observed, setting a demonstrative lower bound on the $n\rightarrow\bar{n}$ lifetime in $^{40}$Ar of $τ_{\textrm{m}} \gtrsim 1.1\times10^{26}\,$years, and on the free $n\rightarrow\bar{n}$ transition time of $τ_{\textrm{\nnbar}} \gtrsim 2.6\times10^{5}\,$s, each at the $90\%$ confidence level. This analysis represents a first-ever proof-of-principle demonstration of the ability to search for this rare process in LArTPCs with high efficiency and low background. △ Less

Submitted 27 June, 2024; v1 submitted 7 August, 2023; originally announced August 2023.

Comments: 22 pages, 7 figures, 6 tables

Report number: FERMILAB-PUB-23-410-ND

Measurement of triple-differential inclusive muon-neutrino charged-current cross section on argon with the MicroBooNE detector

Authors: MicroBooNE Collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, Y. Cao , et al. (165 additional authors not shown)

Abstract: We report the first measurement of the differential cross section $d^{2}σ(E_ν)/ d\cos(θ_μ) dP_μ$ for inclusive muon-neutrino charged-current scattering on argon. This measurement utilizes data from 6.4$\times10^{20}$ protons on target of exposure collected using the MicroBooNE liquid argon time projection chamber located along the Fermilab Booster Neutrino Beam with a mean neutrino energy of appro… ▽ More We report the first measurement of the differential cross section $d^{2}σ(E_ν)/ d\cos(θ_μ) dP_μ$ for inclusive muon-neutrino charged-current scattering on argon. This measurement utilizes data from 6.4$\times10^{20}$ protons on target of exposure collected using the MicroBooNE liquid argon time projection chamber located along the Fermilab Booster Neutrino Beam with a mean neutrino energy of approximately 0.8~GeV. The mapping from reconstructed kinematics to truth quantities, particularly from reconstructed to true neutrino energy, is validated by comparing the distribution of reconstructed hadronic energy in data to that of the model prediction in different muon scattering angle bins after conditional constraint from the muon momentum distribution in data. The success of this validation gives confidence that the missing energy in the MicroBooNE detector is well-modeled in simulation, enabling the unfolding to a triple-differential measurement over muon momentum, muon scattering angle, and neutrino energy. The unfolded measurement covers an extensive phase space, providing a wealth of information useful for future liquid argon time projection chamber experiments measuring neutrino oscillations. Comparisons against a number of commonly used model predictions are included and their performance in different parts of the available phase-space is discussed. △ Less

Submitted 10 December, 2023; v1 submitted 12 July, 2023; originally announced July 2023.

Report number: FERMILAB-PUB-23-368-ND

Measurement of ambient radon progeny decay rates and energy spectra in liquid argon using the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, D. Barrow, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, Y. Cao , et al. (166 additional authors not shown)

Abstract: We report measurements of radon progeny in liquid argon within the MicroBooNE time projection chamber (LArTPC). The presence of specific radon daughters in MicroBooNE's 85 metric tons of active liquid argon bulk is probed with newly developed charge-based low-energy reconstruction tools and analysis techniques to detect correlated $^{214}$Bi-$^{214}$Po radioactive decays. Special datasets taken du… ▽ More We report measurements of radon progeny in liquid argon within the MicroBooNE time projection chamber (LArTPC). The presence of specific radon daughters in MicroBooNE's 85 metric tons of active liquid argon bulk is probed with newly developed charge-based low-energy reconstruction tools and analysis techniques to detect correlated $^{214}$Bi-$^{214}$Po radioactive decays. Special datasets taken during periods of active radon doping enable new demonstrations of the calorimetric capabilities of single-phase neutrino LArTPCs for $β$ and $α$ particles with electron-equivalent energies ranging from 0.1 to 3.0 MeV. By applying $^{214}$Bi-$^{214}$Po detection algorithms to data recorded over a 46-day period, no statistically significant presence of radioactive $^{214}$Bi is detected, and a limit on the activity is placed at $<0.35$ mBq/kg at the 95% confidence level. This bulk $^{214}$Bi radiopurity limit -- the first ever reported for a liquid argon detector incorporating liquid-phase purification -- is then further discussed in relation to the targeted upper limit of 1 mBq/kg on bulk $^{222}$Rn activity for the DUNE neutrino detector. △ Less

Submitted 22 March, 2024; v1 submitted 6 July, 2023; originally announced July 2023.

Report number: FERMILAB-PUB-23-352-ND

Journal ref: Phys. Rev. D 109, 052007 (2024)

Beyond Intuition, a Framework for Applying GPs to Real-World Data

Authors: Kenza Tazi, Jihao Andreas Lin, Ross Viljoen, Alex Gardner, ST John, Hong Ge, Richard E. Turner

Abstract: Gaussian Processes (GPs) offer an attractive method for regression over small, structured and correlated datasets. However, their deployment is hindered by computational costs and limited guidelines on how to apply GPs beyond simple low-dimensional datasets. We propose a framework to identify the suitability of GPs to a given problem and how to set up a robust and well-specified GP model. The guid… ▽ More Gaussian Processes (GPs) offer an attractive method for regression over small, structured and correlated datasets. However, their deployment is hindered by computational costs and limited guidelines on how to apply GPs beyond simple low-dimensional datasets. We propose a framework to identify the suitability of GPs to a given problem and how to set up a robust and well-specified GP model. The guidelines formalise the decisions of experienced GP practitioners, with an emphasis on kernel design and options for computational scalability. The framework is then applied to a case study of glacier elevation change yielding more accurate results at test time. △ Less

Submitted 17 July, 2023; v1 submitted 6 July, 2023; originally announced July 2023.

Comments: Accepted at the ICML Workshop on Structured Probabilistic Inference and Generative Modelling (2023)

Practical Equivariances via Relational Conditional Neural Processes

Authors: Daolang Huang, Manuel Haussmann, Ulpu Remes, ST John, Grégoire Clarté, Kevin Sebastian Luck, Samuel Kaski, Luigi Acerbi

Abstract: Conditional Neural Processes (CNPs) are a class of metalearning models popular for combining the runtime efficiency of amortized inference with reliable uncertainty quantification. Many relevant machine learning tasks, such as in spatio-temporal modeling, Bayesian Optimization and continuous control, inherently contain equivariances -- for example to translation -- which the model can exploit for… ▽ More Conditional Neural Processes (CNPs) are a class of metalearning models popular for combining the runtime efficiency of amortized inference with reliable uncertainty quantification. Many relevant machine learning tasks, such as in spatio-temporal modeling, Bayesian Optimization and continuous control, inherently contain equivariances -- for example to translation -- which the model can exploit for maximal performance. However, prior attempts to include equivariances in CNPs do not scale effectively beyond two input dimensions. In this work, we propose Relational Conditional Neural Processes (RCNPs), an effective approach to incorporate equivariances into any neural process model. Our proposed method extends the applicability and impact of equivariant neural processes to higher dimensions. We empirically demonstrate the competitive performance of RCNPs on a large array of tasks naturally containing equivariances. △ Less

Submitted 5 November, 2023; v1 submitted 19 June, 2023; originally announced June 2023.

Comments: 38 pages, 8 figures. Accepted at the 37th Conference on Neural Information Processing Systems (NeurIPS 2023)

Temporal Causal Mediation through a Point Process: Direct and Indirect Effects of Healthcare Interventions

Authors: Çağlar Hızlı, ST John, Anne Juuti, Tuure Saarinen, Kirsi Pietiläinen, Pekka Marttinen

Abstract: Deciding on an appropriate intervention requires a causal model of a treatment, the outcome, and potential mediators. Causal mediation analysis lets us distinguish between direct and indirect effects of the intervention, but has mostly been studied in a static setting. In healthcare, data come in the form of complex, irregularly sampled time-series, with dynamic interdependencies between a treatme… ▽ More Deciding on an appropriate intervention requires a causal model of a treatment, the outcome, and potential mediators. Causal mediation analysis lets us distinguish between direct and indirect effects of the intervention, but has mostly been studied in a static setting. In healthcare, data come in the form of complex, irregularly sampled time-series, with dynamic interdependencies between a treatment, outcomes, and mediators across time. Existing approaches to dynamic causal mediation analysis are limited to regular measurement intervals, simple parametric models, and disregard long-range mediator--outcome interactions. To address these limitations, we propose a non-parametric mediator--outcome model where the mediator is assumed to be a temporal point process that interacts with the outcome process. With this model, we estimate the direct and indirect effects of an external intervention on the outcome, showing how each of these affects the whole future trajectory. We demonstrate on semi-synthetic data that our method can accurately estimate direct and indirect effects. On real-world healthcare data, our model infers clinically meaningful direct and indirect effect trajectories for blood glucose after a surgery. △ Less

Submitted 16 June, 2023; originally announced June 2023.

Improving Hyperparameter Learning under Approximate Inference in Gaussian Process Models

Authors: Rui Li, ST John, Arno Solin

Abstract: Approximate inference in Gaussian process (GP) models with non-conjugate likelihoods gets entangled with the learning of the model hyperparameters. We improve hyperparameter learning in GP models and focus on the interplay between variational inference (VI) and the learning target. While VI's lower bound to the marginal likelihood is a suitable objective for inferring the approximate posterior, we… ▽ More Approximate inference in Gaussian process (GP) models with non-conjugate likelihoods gets entangled with the learning of the model hyperparameters. We improve hyperparameter learning in GP models and focus on the interplay between variational inference (VI) and the learning target. While VI's lower bound to the marginal likelihood is a suitable objective for inferring the approximate posterior, we show that a direct approximation of the marginal likelihood as in Expectation Propagation (EP) is a better learning objective for hyperparameter optimization. We design a hybrid training procedure to bring the best of both worlds: it leverages conjugate-computation VI for inference and uses an EP-like marginal likelihood approximation for hyperparameter learning. We compare VI, EP, Laplace approximation, and our proposed training procedure and empirically demonstrate the effectiveness of our proposal across a wide range of data sets. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Comments: International Conference on Machine Learning (ICML) 2023

Memory-Based Dual Gaussian Processes for Sequential Learning

Authors: Paul E. Chang, Prakhar Verma, S. T. John, Arno Solin, Mohammad Emtiyaz Khan

Abstract: Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior, hyperparameters, and inducing points, making accurate learning challenging. Here, we present a method to keep all such errors in check using the recently proposed dua… ▽ More Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior, hyperparameters, and inducing points, making accurate learning challenging. Here, we present a method to keep all such errors in check using the recently proposed dual sparse variational GP. Our method enables accurate inference for generic likelihoods and improves learning by actively building and updating a memory of past data. We demonstrate its effectiveness in several applications involving Bayesian optimization, active learning, and continual learning. △ Less

Submitted 6 June, 2023; originally announced June 2023.

Comments: International Conference on Machine Learning (ICML) 2023

First measurement of $η$ production in neutrino interactions on argon with MicroBooNE

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, Y. Cao , et al. (164 additional authors not shown)

Abstract: We present a measurement of $η$ production from neutrino interactions on argon with the MicroBooNE detector. The modeling of resonant neutrino interactions on argon is a critical aspect of the neutrino oscillation physics program being carried out by the DUNE and Short Baseline Neutrino programs. $η$ production in neutrino interactions provides a powerful new probe of resonant interactions, comple… ▽ More We present a measurement of $η$ production from neutrino interactions on argon with the MicroBooNE detector. The modeling of resonant neutrino interactions on argon is a critical aspect of the neutrino oscillation physics program being carried out by the DUNE and Short Baseline Neutrino programs. $η$ production in neutrino interactions provides a powerful new probe of resonant interactions, complementary to pion channels, and is particularly suited to the study of higher-order resonances beyond the $Δ(1232)$. We measure a flux-integrated cross section for neutrino-induced $η$ production on argon of $3.22 \pm 0.84 \; \textrm{(stat.)} \pm 0.86 \; \textrm{(syst.)}$ $10^{-41}{\textrm{cm}}^{2}$/nucleon. By demonstrating the successful reconstruction of the two photons resulting from $η$ production, this analysis enables a novel calibration technique for electromagnetic showers in GeV accelerator neutrino experiments. △ Less

Submitted 4 May, 2024; v1 submitted 25 May, 2023; originally announced May 2023.

Report number: FERMILAB-PUB-23-249-ND

Journal ref: Phys. Rev. Lett. 132, 151801 Published 10 April 2024

Learning Relevant Contextual Variables Within Bayesian Optimization

Authors: Julien Martinelli, Ayush Bharti, Armi Tiihonen, S. T. John, Louis Filstroff, Sabina J. Sloman, Patrick Rinke, Samuel Kaski

Abstract: Contextual Bayesian Optimization (CBO) efficiently optimizes black-box functions with respect to design variables, while simultaneously integrating contextual information regarding the environment, such as experimental conditions. However, the relevance of contextual variables is not necessarily known beforehand. Moreover, contextual variables can sometimes be optimized themselves at an additional… ▽ More Contextual Bayesian Optimization (CBO) efficiently optimizes black-box functions with respect to design variables, while simultaneously integrating contextual information regarding the environment, such as experimental conditions. However, the relevance of contextual variables is not necessarily known beforehand. Moreover, contextual variables can sometimes be optimized themselves at an additional cost, a setting overlooked by current CBO algorithms. Cost-sensitive CBO would simply include optimizable contextual variables as part of the design variables based on their cost. Instead, we adaptively select a subset of contextual variables to include in the optimization, based on the trade-off between their relevance and the additional cost incurred by optimizing them compared to leaving them to be determined by the environment. We learn the relevance of contextual variables by sensitivity analysis of the posterior surrogate model while minimizing the cost of optimization by leveraging recent developments on early stopping for BO. We empirically evaluate our proposed Sensitivity-Analysis-Driven Contextual BO (SADCBO) method against alternatives on both synthetic and real-world experiments, together with extensive ablation studies, and demonstrate a consistent improvement across examples. △ Less

Submitted 24 May, 2024; v1 submitted 23 May, 2023; originally announced May 2023.

Comparison of Sub-Scalp EEG and Endovascular Stent-Electrode Array for Visual Evoked Potential Brain-Computer Interface

Authors: Timothy B. Mahoney, Po-Chen Liu, David B Grayden, Sam E. John

Abstract: Brain-computer interfaces (BCI) have the potential to improve the quality of life for persons with paralysis. Sub-scalp EEG provides an alternative BCI signal acquisition method that compromises between the limitations of traditional EEG systems and the risks associated with intracranial electrodes, and has shown promise in long-term seizure monitoring. However, sub-scalp EEG has not yet been asse… ▽ More Brain-computer interfaces (BCI) have the potential to improve the quality of life for persons with paralysis. Sub-scalp EEG provides an alternative BCI signal acquisition method that compromises between the limitations of traditional EEG systems and the risks associated with intracranial electrodes, and has shown promise in long-term seizure monitoring. However, sub-scalp EEG has not yet been assessed for suitability in BCI applications. This study presents a preliminary comparison of visual evoked potentials (VEPs) recorded using subscalp and endovascular stent electrodes in a sheep. Sub-scalp electrodes recorded comparable VEP amplitude, signal-to-noise ratio and bandwidth to the stent electrodes. △ Less

Submitted 7 May, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

Comments: Copyright 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

First demonstration of $\mathcal{O}(1\,\text{ns})$ timing resolution in the MicroBooNE liquid argon time projection chamber

Authors: MicroBooNE collaboration, P. Abratenko, O. Alterkait, D. Andrade Aldana, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, Y. Cao, D. Caratelli , et al. (163 additional authors not shown)

Abstract: MicroBooNE is a neutrino experiment located in the Booster Neutrino Beamline (BNB) at Fermilab, which collected data from 2015 to 2021. MicroBooNE's liquid argon time projection chamber (LArTPC) is accompanied by a photon detection system consisting of 32 photomultiplier tubes used to measure the argon scintillation light and determine the timing of neutrino interactions. Analysis techniques combi… ▽ More MicroBooNE is a neutrino experiment located in the Booster Neutrino Beamline (BNB) at Fermilab, which collected data from 2015 to 2021. MicroBooNE's liquid argon time projection chamber (LArTPC) is accompanied by a photon detection system consisting of 32 photomultiplier tubes used to measure the argon scintillation light and determine the timing of neutrino interactions. Analysis techniques combining light signals and reconstructed tracks are applied to achieve a neutrino interaction time resolution of $\mathcal{O}(1\,\text{ns})$. The result obtained allows MicroBooNE to access the ns neutrino pulse structure of the BNB for the first time. The timing resolution achieved will enable significant enhancement of cosmic background rejection for all neutrino analyses. Furthermore, the ns timing resolution opens new avenues to search for long-lived-particles such as heavy neutral leptons in MicroBooNE, as well as in future large LArTPC experiments, namely the SBN program and DUNE. △ Less

Submitted 29 August, 2023; v1 submitted 4 April, 2023; originally announced April 2023.

Queer In AI: A Case Study in Community-Led Participatory AI

Authors: Organizers Of QueerInAI, :, Anaelia Ovalle, Arjun Subramonian, Ashwin Singh, Claas Voelcker, Danica J. Sutherland, Davide Locatelli, Eva Breznik, Filip Klubička, Hang Yuan, Hetvi J, Huan Zhang, Jaidev Shriram, Kruno Lehman, Luca Soldaini, Maarten Sap, Marc Peter Deisenroth, Maria Leonor Pacheco, Maria Ryskina, Martin Mundt, Milind Agarwal, Nyx McLean, Pan Xu, A Pranav , et al. (26 additional authors not shown)

Abstract: We present Queer in AI as a case study for community-led participatory design in AI. We examine how participatory design and intersectional tenets started and shaped this community's programs over the years. We discuss different challenges that emerged in the process, look at ways this organization has fallen short of operationalizing participatory and intersectional principles, and then assess th… ▽ More We present Queer in AI as a case study for community-led participatory design in AI. We examine how participatory design and intersectional tenets started and shaped this community's programs over the years. We discuss different challenges that emerged in the process, look at ways this organization has fallen short of operationalizing participatory and intersectional principles, and then assess the organization's impact. Queer in AI provides important lessons and insights for practitioners and theorists of participatory methods broadly through its rejection of hierarchy in favor of decentralization, success at building aid and programs by and for the queer community, and effort to change actors and institutions outside of the queer community. Finally, we theorize how communities like Queer in AI contribute to the participatory design in AI more broadly by fostering cultures of participation in AI, welcoming and empowering marginalized participants, critiquing poor or exploitative participatory practices, and bringing participation to institutions outside of individual research projects. Queer in AI's work serves as a case study of grassroots activism and participatory methods within AI, demonstrating the potential of community-led participatory methods and intersectional praxis, while also providing challenges, case studies, and nuanced insights to researchers developing and using participatory methods. △ Less

Submitted 8 June, 2023; v1 submitted 29 March, 2023; originally announced March 2023.

Comments: To appear at FAccT 2023

Journal ref: 2023 ACM Conference on Fairness, Accountability, and Transparency

Longwave infrared multispectral image sensor system using aluminum-germanium plasmonic filter arrays

Authors: Noor E Karishma Shaik, Bryce Widdicombe, Dechuan Sun, Sam E John, Dongryeol Ryu, Ampalavanapillai Nirmalathas, Ranjith R Unnithan

Abstract: A multispectral camera records image data in various wavelengths across the electromagnetic spectrum to acquire additional information that a conventional camera fails to capture. With the advent of high-resolution image sensors and colour filter technologies, multispectral imagers in the visible wavelengths have become popular with increasing commercial viability in the last decade. However, mult… ▽ More A multispectral camera records image data in various wavelengths across the electromagnetic spectrum to acquire additional information that a conventional camera fails to capture. With the advent of high-resolution image sensors and colour filter technologies, multispectral imagers in the visible wavelengths have become popular with increasing commercial viability in the last decade. However, multispectral imaging in longwave infrared (LWIR: 8 to 14 microns) is still an emerging area due to the limited availability of optical materials, filter technologies, and high-resolution sensors. Images from LWIR multispectral cameras can capture emission spectra of objects to extract additional information that a human eye fails to capture and thus have important applications in precision agriculture, forestry, medicine, and object identification. In this work, we experimentally demonstrate an LWIR multispectral image sensor with three wavelength bands using optical elements made of an aluminum-based plasmonic filter array sandwiched in germanium. To realize the multispectral sensor, the filter arrays are then integrated into a 3D printed wheel stacked on a low-resolution monochrome thermal sensor. Our prototype device is calibrated using a blackbody and its thermal output has been enhanced with computer vision methods. By applying a state-of-the-art deep learning method, we have also reconstructed multispectral images to a better spatial resolution. Scientifically, our work demonstrates a versatile spectral thermography technique for detecting target signatures in the LWIR range and other advanced spectral analyses. △ Less

Submitted 2 March, 2023; originally announced March 2023.

Real-World Deployment and Evaluation of Kwame for Science, An AI Teaching Assistant for Science Education in West Africa

Authors: George Boateng, Samuel John, Samuel Boateng, Philemon Badu, Patrick Agyeman-Budu, Victor Kumbol

Abstract: Africa has a high student-to-teacher ratio which limits students' access to teachers for learning support such as educational question answering. In this work, we extended Kwame, a bilingual AI teaching assistant for coding education, adapted it for science education, and deployed it as a web app. Kwame for Science provides passages from well-curated knowledge sources and related past national exa… ▽ More Africa has a high student-to-teacher ratio which limits students' access to teachers for learning support such as educational question answering. In this work, we extended Kwame, a bilingual AI teaching assistant for coding education, adapted it for science education, and deployed it as a web app. Kwame for Science provides passages from well-curated knowledge sources and related past national exam questions as answers to questions from students based on the Integrated Science subject of the West African Senior Secondary Certificate Examination (WASSCE). Furthermore, students can view past national exam questions along with their answers and filter by year, question type, and topics that were automatically categorized by a topic detection model which we developed (91% unweighted average recall). We deployed Kwame for Science in the real world over 8 months and had 750 users across 32 countries (15 in Africa) and 1.5K questions asked. Our evaluation showed an 87.2% top 3 accuracy (n=109 questions) implying that Kwame for Science has a high chance of giving at least one useful answer among the 3 displayed. We categorized the reasons the model incorrectly answered questions to provide insights for future improvements. We also share challenges and lessons with the development, deployment, and human-computer interaction component of such a tool to enable other researchers to deploy similar tools. With a first-of-its-kind tool within the African context, Kwame for Science has the potential to enable the delivery of scalable, cost-effective, and quality remote education to millions of people across Africa. △ Less

Submitted 26 April, 2024; v1 submitted 21 February, 2023; originally announced February 2023.

Comments: 14 pages, Accepted for publication at the 25th International Conference on Artificial Intelligence in Education (AIED 2024)

Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMC

Authors: Patrick Emami, Aidan Perreault, Jeffrey Law, David Biagioni, Peter C. St. John

Abstract: A long-standing goal of machine-learning-based protein engineering is to accelerate the discovery of novel mutations that improve the function of a known protein. We introduce a sampling framework for evolving proteins in silico that supports mixing and matching a variety of unsupervised models, such as protein language models, and supervised models that predict protein function from sequence. By… ▽ More A long-standing goal of machine-learning-based protein engineering is to accelerate the discovery of novel mutations that improve the function of a known protein. We introduce a sampling framework for evolving proteins in silico that supports mixing and matching a variety of unsupervised models, such as protein language models, and supervised models that predict protein function from sequence. By composing these models, we aim to improve our ability to evaluate unseen mutations and constrain search to regions of sequence space likely to contain functional proteins. Our framework achieves this without any model fine-tuning or re-training by constructing a product of experts distribution directly in discrete protein space. Instead of resorting to brute force search or random sampling, which is typical of classic directed evolution, we introduce a fast MCMC sampler that uses gradients to propose promising mutations. We conduct in silico directed evolution experiments on wide fitness landscapes and across a range of different pre-trained unsupervised models, including a 650M parameter protein language model. Our results demonstrate an ability to efficiently discover variants with high evolutionary likelihood as well as estimated activity multiple mutations away from a wild type protein, suggesting our sampler provides a practical and effective new paradigm for machine-learning-based protein engineering. △ Less

Submitted 6 April, 2023; v1 submitted 19 December, 2022; originally announced December 2022.

Comments: 31 pages, 8 figures. To appear in the Machine Learning: Science & Technology (ML:S&T) journal. Code is available at https://github.com/pemami4911/ppde. A short version of this work appeared at the NeurIPS 2022 Machine Learning in Structural Biology Workshop

Age structure, replicator equation, and the prisoner's dilemma

Authors: Sona John, Johannes Müller

Abstract: We investigate the evolutionary dynamics of an age-structured population under weak frequency-dependent selection. It turns out that the weak selection is affected in a non-trivial way by the life-history trait. We can disentangle the dynamics, based on the appearance of different time scales. These time scales, which seem to form a universal structure in the interplay of weak selection and life-h… ▽ More We investigate the evolutionary dynamics of an age-structured population under weak frequency-dependent selection. It turns out that the weak selection is affected in a non-trivial way by the life-history trait. We can disentangle the dynamics, based on the appearance of different time scales. These time scales, which seem to form a universal structure in the interplay of weak selection and life-history traits, allow us to reduce the infinite dimensional model to a one-dimensional modified replicator equation. The modified replicator equation is then used to investigate cooperation (the prisoner's dilemma) by means of adaptive dynamics. We identify conditions under which age structure is able to promote cooperation. At the end we discuss the relevance of our findings. △ Less

Submitted 19 December, 2022; originally announced December 2022.

MSC Class: 91A22; 92D25

First measurement of quasi-elastic $Λ$ baryon production in muon anti-neutrino interactions in the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, D. Andrade Aldana, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, J. Barrow, V. Basque, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, D. Caratelli, I. Caro Terrazas, F. Cavanna , et al. (161 additional authors not shown)

Abstract: We present the first measurement of the cross section of Cabibbo-suppressed $Λ$ baryon production, using data collected with the MicroBooNE detector when exposed to the neutrinos from the Main Injector beam at the Fermi National Accelerator Laboratory. The data analyzed correspond to $2.2 \times 10^{20}$ protons on target of neutrino mode running and $4.9 \times 10^{20}$ protons on target of anti-… ▽ More We present the first measurement of the cross section of Cabibbo-suppressed $Λ$ baryon production, using data collected with the MicroBooNE detector when exposed to the neutrinos from the Main Injector beam at the Fermi National Accelerator Laboratory. The data analyzed correspond to $2.2 \times 10^{20}$ protons on target of neutrino mode running and $4.9 \times 10^{20}$ protons on target of anti-neutrino mode running. An automated selection is combined with hand scanning, with the former identifying five candidate $Λ$ production events when the signal was unblinded, consistent with the GENIE prediction of $5.3 \pm 1.1$ events. Several scanners were employed, selecting between three and five events, compared with a prediction from a blinded Monte Carlo simulation study of $3.7 \pm 1.0$ events. Restricting the phase space to only include $Λ$ baryons that decay above MicroBooNE's detection thresholds, we obtain a flux averaged cross section of $2.0^{+2.2}_{-1.7} \times 10^{-40}$ cm$^2/$Ar, where statistical and systematic uncertainties are combined. △ Less

Submitted 9 June, 2023; v1 submitted 15 December, 2022; originally announced December 2022.

Report number: FERMILAB-PUB-22-925-ND

Towards Improved Learning in Gaussian Processes: The Best of Two Worlds

Authors: Rui Li, ST John, Arno Solin

Abstract: Gaussian process training decomposes into inference of the (approximate) posterior and learning of the hyperparameters. For non-Gaussian (non-conjugate) likelihoods, two common choices for approximate inference are Expectation Propagation (EP) and Variational Inference (VI), which have complementary strengths and weaknesses. While VI's lower bound to the marginal likelihood is a suitable objective… ▽ More Gaussian process training decomposes into inference of the (approximate) posterior and learning of the hyperparameters. For non-Gaussian (non-conjugate) likelihoods, two common choices for approximate inference are Expectation Propagation (EP) and Variational Inference (VI), which have complementary strengths and weaknesses. While VI's lower bound to the marginal likelihood is a suitable objective for inferring the approximate posterior, it does not automatically imply it is a good learning objective for hyperparameter optimization. We design a hybrid training procedure where the inference leverages conjugate-computation VI and the learning uses an EP-like marginal likelihood approximation. We empirically demonstrate on binary classification that this provides a good learning objective and generalizes better. △ Less

Submitted 11 November, 2022; originally announced November 2022.

Comments: In the 2022 NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems

First Measurement of Differential Cross Sections for Muon Neutrino Charged Current Interactions on Argon with a Two-proton Final State in the MicroBooNE Detector

Authors: MicroBooNE collaboration, P. Abratenko, D. Andrade Aldana, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, J. Barrow, V. Basque, L. Bathe-Peters, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, D. Caratelli, I. Caro Terrazas , et al. (161 additional authors not shown)

Abstract: We present the first measurement of differential cross sections for charged-current muon neutrino interactions on argon with one muon, two protons, and no pions in the final state. Such interactions leave the target nucleus in a two-particle two-hole state; these states are of great interest, but currently there is limited information about their production in neutrino-nucleus interactions. Detail… ▽ More We present the first measurement of differential cross sections for charged-current muon neutrino interactions on argon with one muon, two protons, and no pions in the final state. Such interactions leave the target nucleus in a two-particle two-hole state; these states are of great interest, but currently there is limited information about their production in neutrino-nucleus interactions. Detailed investigations of the production of two-particle two-hole states are vital to support upcoming experiments exploring the nature of the neutrino, and the development of the liquid-argon time-projection-chamber has made possible the isolation of such final states. The opening angle between the two protons, the angle between the total proton momentum and the muon, and the total transverse momentum of the final state system are sensitive to the underlying physics processes as embodied in a variety of models. Realistic initial-state momentum distributions are shown to be important in reproducing the data. △ Less

Submitted 3 August, 2023; v1 submitted 7 November, 2022; originally announced November 2022.

Comments: Resubmitted to PRL in response to reviewer comments

Report number: FERMILAB-PUB-22-836-ND

Fantasizing with Dual GPs in Bayesian Optimization and Active Learning

Authors: Paul E. Chang, Prakhar Verma, ST John, Victor Picheny, Henry Moss, Arno Solin

Abstract: Gaussian processes (GPs) are the main surrogate functions used for sequential modelling such as Bayesian Optimization and Active Learning. Their drawbacks are poor scaling with data and the need to run an optimization loop when using a non-Gaussian likelihood. In this paper, we focus on `fantasizing' batch acquisition functions that need the ability to condition on new fantasized data computationa… ▽ More Gaussian processes (GPs) are the main surrogate functions used for sequential modelling such as Bayesian Optimization and Active Learning. Their drawbacks are poor scaling with data and the need to run an optimization loop when using a non-Gaussian likelihood. In this paper, we focus on `fantasizing' batch acquisition functions that need the ability to condition on new fantasized data computationally efficiently. By using a sparse Dual GP parameterization, we gain linear scaling with batch size as well as one-step updates for non-Gaussian likelihoods, thus extending sparse models to greedy batch fantasizing acquisition functions. △ Less

Submitted 2 November, 2022; originally announced November 2022.

Comments: In the 2022 NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems

A Low-Power 1 Gb/s Line Driver with Configurable Pre-Emphasis for Lossy Transmission Lines

Authors: Nicholas St. John, Soumyajit Mandal, Grzegorz W. Deptuch, Eric Raguzin, Sergio Rescia

Abstract: A line driver with configurable pre-emphasis is implemented in a 65 nm CMOS process. The driver utilizes a three-tap feed-forward equalization (FFE) architecture. The relative delays between the taps are selectable in increments of 1/16th of the unit interval (UI) via an 8-stage delay-locked loop (DLL) and digital interpolator. It is also possible to control the output amplitude and source impedan… ▽ More A line driver with configurable pre-emphasis is implemented in a 65 nm CMOS process. The driver utilizes a three-tap feed-forward equalization (FFE) architecture. The relative delays between the taps are selectable in increments of 1/16th of the unit interval (UI) via an 8-stage delay-locked loop (DLL) and digital interpolator. It is also possible to control the output amplitude and source impedance for each tap via a programmable array of eight source-series terminated (SST) drivers. The entire design consumes 9 mW from a 1.2 V supply at 1 Gb/s. △ Less

Submitted 21 October, 2022; originally announced October 2022.

Comments: Submitted to JINST

First constraints on light sterile neutrino oscillations from combined appearance and disappearance searches with the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, D. Andrade Aldana, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, G. Barr, J. Barrow, V. Basque, L. Bathe-Peters, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, D. Caratelli, I. Caro Terrazas , et al. (162 additional authors not shown)

Abstract: We present a search for eV-scale sterile neutrino oscillations in the MicroBooNE liquid argon detector, simultaneously considering all possible appearance and disappearance effects within the $3+1$ active-to-sterile neutrino oscillation framework. We analyze the neutrino candidate events for the recent measurements of charged-current $ν_e$ and $ν_μ$ interactions in the MicroBooNE detector, using d… ▽ More We present a search for eV-scale sterile neutrino oscillations in the MicroBooNE liquid argon detector, simultaneously considering all possible appearance and disappearance effects within the $3+1$ active-to-sterile neutrino oscillation framework. We analyze the neutrino candidate events for the recent measurements of charged-current $ν_e$ and $ν_μ$ interactions in the MicroBooNE detector, using data corresponding to an exposure of 6.37$\times$10$^{20}$ protons on target from the Fermilab booster neutrino beam. We observe no evidence of light sterile neutrino oscillations and derive exclusion contours at the $95\%$ confidence level in the plane of the mass-squared splitting $Δm^2_{41}$ and the sterile neutrino mixing angles $θ_{μe}$ and $θ_{ee}$, excluding part of the parameter space allowed by experimental anomalies. Cancellation of $ν_e$ appearance and $ν_e$ disappearance effects due to the full $3+1$ treatment of the analysis leads to a degeneracy when determining the oscillation parameters, which is discussed in this paper and will be addressed by future analyses. △ Less

Submitted 6 December, 2022; v1 submitted 18 October, 2022; originally announced October 2022.

Comments: 9 pages, 4 figures; supplemental: 6 pages, 8 figures

Report number: FERMILAB-PUB-22-750-ND

Journal ref: Phys. Rev. Lett. 130, 011801 (2023)

Uncertainty Aware ML-based surrogate models for particle accelerators: A Study at the Fermilab Booster Accelerator Complex

Authors: Malachi Schram, Kishansingh Rajput, Karthik Somayaji Peng Li, Jason St. John, Himanshu Sharma

Abstract: Standard deep learning methods, such as Ensemble Models, Bayesian Neural Networks and Quantile Regression Models provide estimates to prediction uncertainties for data-driven deep learning models. However, they can be limited in their applications due to their heavy memory, inference cost, and ability to properly capture out-of-distribution uncertainties. Additionally, some of these models require… ▽ More Standard deep learning methods, such as Ensemble Models, Bayesian Neural Networks and Quantile Regression Models provide estimates to prediction uncertainties for data-driven deep learning models. However, they can be limited in their applications due to their heavy memory, inference cost, and ability to properly capture out-of-distribution uncertainties. Additionally, some of these models require post-training calibration which limits their ability to be used for continuous learning applications. In this paper, we present a new approach to provide prediction with calibrated uncertainties that includes out-of-distribution contributions and compare it to standard methods on the Fermi National Accelerator Laboratory (FNAL) Booster accelerator complex. △ Less

Submitted 11 December, 2022; v1 submitted 15 September, 2022; originally announced September 2022.

Causal Modeling of Policy Interventions From Sequences of Treatments and Outcomes

Authors: Çağlar Hızlı, ST John, Anne Juuti, Tuure Saarinen, Kirsi Pietiläinen, Pekka Marttinen

Abstract: A treatment policy defines when and what treatments are applied to affect some outcome of interest. Data-driven decision-making requires the ability to predict what happens if a policy is changed. Existing methods that predict how the outcome evolves under different scenarios assume that the tentative sequences of future treatments are fixed in advance, while in practice the treatments are determi… ▽ More A treatment policy defines when and what treatments are applied to affect some outcome of interest. Data-driven decision-making requires the ability to predict what happens if a policy is changed. Existing methods that predict how the outcome evolves under different scenarios assume that the tentative sequences of future treatments are fixed in advance, while in practice the treatments are determined stochastically by a policy and may depend, for example, on the efficiency of previous treatments. Therefore, the current methods are not applicable if the treatment policy is unknown or a counterfactual analysis is needed. To handle these limitations, we model the treatments and outcomes jointly in continuous time, by combining Gaussian processes and point processes. Our model enables the estimation of a treatment policy from observational sequences of treatments and outcomes, and it can predict the interventional and counterfactual progression of the outcome after an intervention on the treatment policy (in contrast with the causal effect of a single treatment). We show with real-world and semi-synthetic data on blood glucose progression that our method can answer causal queries more accurately than existing alternatives. △ Less

Submitted 20 June, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

Comments: Accepted at ICML 2023

Connexive implications in Substructural Logics

Authors: Davide Fazio, Gavin St. John

Abstract: This paper is devoted to the investigation of term-definable connexive implications in substructural logics with exchange and, on the semantical perspective, in sub-varieties of commutative residuated lattices (FLe-algebras). In particular, we inquire into sufficient and necessary conditions under which generalizations of the connexive implication-like operation defined in [6] for Heyting algebras… ▽ More This paper is devoted to the investigation of term-definable connexive implications in substructural logics with exchange and, on the semantical perspective, in sub-varieties of commutative residuated lattices (FLe-algebras). In particular, we inquire into sufficient and necessary conditions under which generalizations of the connexive implication-like operation defined in [6] for Heyting algebras still satisfy connexive theses. It will turn out that, in most cases, connexive principles are equivalent to the equational Glivenko property with respect to Boolean algebras. Furthermore, we provide some philosophical upshots like e.g., a discussion on the relevance of the above operation in relationship with G. Polya's logic of plausible inference, and some characterization results on weak and strong connexivity. △ Less

Submitted 6 September, 2022; originally announced September 2022.

MSC Class: 03B47; 03B55; 03A10

Differential cross section measurement of charged current $ν_{e}$ interactions without final-state pions in MicroBooNE

Authors: MicroBooNE collaboration, P. Abratenko, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, C. Barnes, G. Barr, J. Barrow, V. Basque, L. Bathe-Peters, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, D. Caratelli, I. Caro Terrazas , et al. (161 additional authors not shown)

Abstract: In this letter we present the first measurements of an exclusive electron neutrino cross section with the MicroBooNE experiment using data from the Booster Neutrino Beamline at Fermilab. These measurements are made for a selection of charged-current electron neutrinos without final-state pions. Differential cross sections are extracted in energy and angle with respect to the beam for the electron… ▽ More In this letter we present the first measurements of an exclusive electron neutrino cross section with the MicroBooNE experiment using data from the Booster Neutrino Beamline at Fermilab. These measurements are made for a selection of charged-current electron neutrinos without final-state pions. Differential cross sections are extracted in energy and angle with respect to the beam for the electron and the leading proton. The differential cross section as a function of proton energy is measured using events with protons both above and below the visibility threshold. This is done by including a separate selection of electron neutrino events without reconstructed proton candidates in addition to those with proton candidates. Results are compared to the predictions from several modern generators, and we find the data agrees well with these models. The data shows best agreement, as quantified by $p$-value, with the generators that predict a lower overall cross section, such as GENIE v3 and NuWro. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Report number: FERMILAB-PUB-22-573-ND-SCD

Search for long-lived heavy neutral leptons and Higgs portal scalars decaying in the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, C. Barnes, G. Barr, J. Barrow, V. Basque, L. Bathe-Peters, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, M. Bhattacharya, M. Bishai, A. Blake, B. Bogart, T. Bolton, J. Y. Book, L. Camilleri, D. Caratelli, I. Caro Terrazas , et al. (163 additional authors not shown)

Abstract: We present a search for long-lived Higgs portal scalars (HPS) and heavy neutral leptons (HNL) decaying in the MicroBooNE liquid-argon time projection chamber. The measurement is performed using data collected synchronously with the NuMI neutrino beam from Fermilab's Main Injector with a total exposure corresponding to $7.01 \times 10^{20}$ protons on target. We set upper limits at the $90\%$ confi… ▽ More We present a search for long-lived Higgs portal scalars (HPS) and heavy neutral leptons (HNL) decaying in the MicroBooNE liquid-argon time projection chamber. The measurement is performed using data collected synchronously with the NuMI neutrino beam from Fermilab's Main Injector with a total exposure corresponding to $7.01 \times 10^{20}$ protons on target. We set upper limits at the $90\%$ confidence level on the mixing parameter $\lvert U_{μ4}\rvert^2$ ranging from $\lvert U_{μ4}\rvert^2<12.9\times 10^{-8}$ for Majorana HNLs with a mass of $m_{\rm HNL}=246$ MeV to $\lvert U_{μ4}\rvert^2<0.92 \times 10^{-8}$ for $m_{\rm HNL}=385$ MeV, assuming $\lvert U_{e 4}\rvert^2 = \lvert U_{τ4}\rvert^2 = 0$ and HNL decays into $μ^\pmπ^\mp$ pairs. These limits on $\lvert U_{μ4}\rvert^2$ represent an order of magnitude improvement in sensitivity compared to the previous MicroBooNE result. We also constrain the scalar-Higgs mixing angle $θ$ by searching for HPS decays into $μ^+μ^-$ final states, excluding a contour in the parameter space with lower bounds of $θ^2<31.3 \times 10^{-9}$ for $m_{\rm HPS}=212$ GeV and $θ^2<1.09 \times 10^{-9}$ for $m_{\rm HPS}=275$ GeV. These are the first constraints on the scalar-Higgs mixing angle $θ$ from a dedicated experimental search in this mass range. △ Less

Submitted 6 December, 2022; v1 submitted 8 July, 2022; originally announced July 2022.

Comments: This paper is dedicated to the memory of Salvatore Davide Porzio. This is the journal accepted version with only minor presentational changes compared to preprint

Report number: FERMILAB-PUB-22-507

Journal ref: Phys. Rev. D 106, 092006 (2022)

Kwame for Science: An AI Teaching Assistant Based on Sentence-BERT for Science Education in West Africa

Authors: George Boateng, Samuel John, Andrew Glago, Samuel Boateng, Victor Kumbol

Abstract: Africa has a high student-to-teacher ratio which limits students' access to teachers. Consequently, students struggle to get answers to their questions. In this work, we extended Kwame, our previous AI teaching assistant, adapted it for science education, and deployed it as a web app. Kwame for Science answers questions of students based on the Integrated Science subject of the West African Senior… ▽ More Africa has a high student-to-teacher ratio which limits students' access to teachers. Consequently, students struggle to get answers to their questions. In this work, we extended Kwame, our previous AI teaching assistant, adapted it for science education, and deployed it as a web app. Kwame for Science answers questions of students based on the Integrated Science subject of the West African Senior Secondary Certificate Examination (WASSCE). Kwame for Science is a Sentence-BERT-based question-answering web app that displays 3 paragraphs as answers along with a confidence score in response to science questions. Additionally, it displays the top 5 related past exam questions and their answers in addition to the 3 paragraphs. Our preliminary evaluation of the Kwame for Science with a 2.5-week real-world deployment showed a top 3 accuracy of 87.5% (n=56) with 190 users across 11 countries. Kwame for Science will enable the delivery of scalable, cost-effective, and quality remote education to millions of people across Africa. △ Less

Submitted 10 July, 2022; v1 submitted 27 June, 2022; originally announced June 2022.

Comments: 5 pages, Accepted at the Fourth Workshop on Intelligent Textbooks (iTextbooks) at the 23th International Conference on Artificial Intelligence in Education (AIED 2022)

Quiescence generates moving average in a stochastic epidemiological model with one host and two parasites

Authors: Usman Sanusi, Sona John, Johannes Mueller, Aurélien Tellier

Abstract: Mathematical modelling of epidemiological and coevolutionary dynamics is widely being used to improve disease management strategies of infectious diseases. Many diseases present some form of intra-host quiescent stage, also known as covert infection, while others exhibit dormant stages in the environment. As quiescent/dormant stages can be resistant to drug, antibiotics, fungicide treatments, it i… ▽ More Mathematical modelling of epidemiological and coevolutionary dynamics is widely being used to improve disease management strategies of infectious diseases. Many diseases present some form of intra-host quiescent stage, also known as covert infection, while others exhibit dormant stages in the environment. As quiescent/dormant stages can be resistant to drug, antibiotics, fungicide treatments, it is of practical relevance to study the influence of these two life-history traits on the coevolutionary dynamics. We develop first a deterministic coevolutionary model with two parasite types infecting one host type and study analytically the stability of the dynamical system. We specifically derive a stability condition for a five-by-five system of equations with quiescence. Second, we develop a stochastic version of the model to study the influence of quiescence on stochasticity of the system dynamics. We compute the steady state distribution of the parasite types which follows a multivariate normal distribution. Furthermore, we obtain numerical solutions for the covariance matrix of the system under symmetric and asymmetric quiescence rates between parasite types. When parasite strains are identical, quiescence increases the variance of the number of infected individuals at high transmission rate and vice versa when the transmission rate is low. However, when there is competition between parasite strains with different quiescent rates, quiescence generates a moving average behaviour which dampen off stochasticity and decreases the variance of the number of infected hosts. The strain with the highest rate of entering quiescence determines the strength of the moving average and the magnitude of reduction of stochasticity. Thus, it is worth investigating simple models of multi-strain parasite under quiescence/dormancy to improve disease management strategies. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Measurement of neutral current single $π^0$ production on argon with the MicroBooNE detector

Authors: MicroBooNE collaboration, P. Abratenko, J. Anthony, L. Arellano, J. Asaadi, A. Ashkenazi, S. Balasubramanian, B. Baller, C. Barnes, G. Barr, J. Barrow, V. Basque, L. Bathe-Peters, O. Benevides Rodrigues, S. Berkman, A. Bhanderi, A. Bhat, M. Bhattacharya, M. Bishai, A. Blake, T. Bolton, J. Y. Book, L. Camilleri, D. Caratelli, I. Caro Terrazas , et al. (170 additional authors not shown)

Abstract: We report the first measurement of $π^0$ production in neutral current (NC) interactions on argon with average neutrino energy of $\lesssim1$~GeV. We use data from the MicroBooNE detector's 85-tonne active volume liquid argon time projection chamber situated in Fermilab's Booster Neutrino Beam and exposed to $5.89\times10^{20}$ protons on target for this measurement. Measurements of NC $π^0$ event… ▽ More We report the first measurement of $π^0$ production in neutral current (NC) interactions on argon with average neutrino energy of $\lesssim1$~GeV. We use data from the MicroBooNE detector's 85-tonne active volume liquid argon time projection chamber situated in Fermilab's Booster Neutrino Beam and exposed to $5.89\times10^{20}$ protons on target for this measurement. Measurements of NC $π^0$ events are reported for two exclusive event topologies without charged pions. Those include a topology with two photons from the decay of the $π^0$ and one proton and a topology with two photons and zero protons. Flux-averaged cross-sections for each exclusive topology and for their semi-inclusive combination are extracted (efficiency-correcting for two-plus proton final states), and the results are compared to predictions from the \textsc{genie}, \textsc{neut}, and \textsc{NuWro} neutrino event generators. We measure cross sections of $1.243\pm0.185$ (syst) $\pm0.076$ (stat), $0.444\pm0.098\pm0.047$, and $0.624\pm0.131\pm0.075$ $[10^{-38}\textrm{cm}^2/\textrm{Ar}]$ for the semi-inclusive NC$π^0$, exclusive NC$π^0$+1p, and exclusive NC$π^0$+0p processes, respectively. △ Less

Submitted 8 December, 2022; v1 submitted 16 May, 2022; originally announced May 2022.

Comments: 16 pages, 14 figures, 2 tables

Report number: FERMILAB-PUB-22-412-ND-SCD