Showing 1–25 of 25 results for author: Scheinker, A

Towards latent space evolution of spatiotemporal dynamics of six-dimensional phase space of charged particle beams

Authors: Mahindra Rautela, Alan Williams, Alexander Scheinker

Abstract: Addressing the charged particle beam diagnostics in accelerators poses a formidable challenge, demanding high-fidelity simulations in limited computational time. Machine learning (ML) based surrogate models have emerged as a promising tool for non-invasive charged particle beam diagnostics. Trained ML models can make predictions much faster than computationally expensive physics simulations. In th… ▽ More Addressing the charged particle beam diagnostics in accelerators poses a formidable challenge, demanding high-fidelity simulations in limited computational time. Machine learning (ML) based surrogate models have emerged as a promising tool for non-invasive charged particle beam diagnostics. Trained ML models can make predictions much faster than computationally expensive physics simulations. In this work, we have proposed a temporally structured variational autoencoder model to autoregressively forecast the spatiotemporal dynamics of the 15 unique 2D projections of 6D phase space of charged particle beam as it travels through the LANSCE linear accelerator. In the model, VAE embeds the phase space projections into a lower dimensional latent space. A long-short-term memory network then learns the temporal correlations in the latent space. The trained network can evolve the phase space projections across further modules provided the first few modules as inputs. The model predicts all the projections across different modules with low mean squared error and high structural similarity index. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2403.13858

Accelerator system parameter estimation using variational autoencoded latent regression

Authors: Mahindra Rautela, Alan Williams, Alexander Scheinker

Abstract: Particle accelerators are time-varying systems whose components are perturbed by external disturbances. Tuning accelerators can be a time-consuming process involving manual adjustment of multiple components, such as RF cavities, to minimize beam loss due to time-varying drifts. The high dimensionality of the system ($\sim$100 amplitude and phase RF settings in the LANSCE accelerator) makes it diff… ▽ More Particle accelerators are time-varying systems whose components are perturbed by external disturbances. Tuning accelerators can be a time-consuming process involving manual adjustment of multiple components, such as RF cavities, to minimize beam loss due to time-varying drifts. The high dimensionality of the system ($\sim$100 amplitude and phase RF settings in the LANSCE accelerator) makes it difficult to achieve optimal operation. The time-varying drifts and the dimensionality make system parameter estimation a challenging optimization problem. In this work, we propose a Variational Autoencoded Latent Regression (VALeR) model for robust estimation of system parameters using 2D unique projections of a charged particle beam's 6D phase space. In VALeR, VAE projects the phase space projections into a lower-dimensional latent space, and a dense neural network maps the latent space onto the space of system parameters. The trained network can predict system parameters for unseen phase space projections. Furthermore, VALeR can generate new projections by randomly sampling the latent space of VAE and also estimate the corresponding system parameters. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Practical Safe Extremum Seeking with Assignable Rate of Attractivity to the Safe Set

Authors: Alan Williams, Miroslav Krstic, Alexander Scheinker

Abstract: We present Assignably Safe Extremum Seeking (ASfES), an algorithm designed to minimize a measured objective function while maintaining a measured metric of safety (a control barrier function or CBF) be positive in a practical sense. We ensure that for trajectories with safe initial conditions, the violation of safety can be made arbitrarily small with appropriately chosen design constants. We also… ▽ More We present Assignably Safe Extremum Seeking (ASfES), an algorithm designed to minimize a measured objective function while maintaining a measured metric of safety (a control barrier function or CBF) be positive in a practical sense. We ensure that for trajectories with safe initial conditions, the violation of safety can be made arbitrarily small with appropriately chosen design constants. We also guarantee an assignable ``attractivity'' rate: from unsafe initial conditions, the trajectories approach the safe set, in the sense of the measured CBF, at a rate no slower than a user-assigned rate. Similarly, from safe initial conditions, the trajectories approach the unsafe set, in the sense of the CBF, no faster than the assigned attractivity rate. The feature of assignable attractivity is not present in the semiglobal version of safe extremum seeking, where the semiglobality of convergence is achieved by slowing the adaptation. We also demonstrate local convergence of the parameter to a neighborhood of the minimum of the objective function constrained to the safe set. The ASfES algorithm and analysis are multivariable, but we also extend the algorithm to a Newton-Based ASfES scheme (NB-ASfES) which we show is only useful in the scalar case. The proven properties of the designs are illustrated through simulation examples. △ Less

Submitted 12 April, 2024; originally announced April 2024.

A conditional latent autoregressive recurrent model for generation and forecasting of beam dynamics in particle accelerators

Authors: Mahindra Rautela, Alan Williams, Alexander Scheinker

Abstract: Particle accelerators are complex systems that focus, guide, and accelerate intense charged particle beams to high energy. Beam diagnostics present a challenging problem due to limited non-destructive measurements, computationally demanding simulations, and inherent uncertainties in the system. We propose a two-step unsupervised deep learning framework named as Conditional Latent Autoregressive Re… ▽ More Particle accelerators are complex systems that focus, guide, and accelerate intense charged particle beams to high energy. Beam diagnostics present a challenging problem due to limited non-destructive measurements, computationally demanding simulations, and inherent uncertainties in the system. We propose a two-step unsupervised deep learning framework named as Conditional Latent Autoregressive Recurrent Model (CLARM) for learning the spatiotemporal dynamics of charged particles in accelerators. CLARM consists of a Conditional Variational Autoencoder (CVAE) transforming six-dimensional phase space into a lower-dimensional latent distribution and a Long Short-Term Memory (LSTM) network capturing temporal dynamics in an autoregressive manner. The CLARM can generate projections at various accelerator modules by sampling and decoding the latent space representation. The model also forecasts future states (downstream locations) of charged particles from past states (upstream locations). The results demonstrate that the generative and forecasting ability of the proposed approach is promising when tested against a variety of evaluation metrics. △ Less

Submitted 19 March, 2024; originally announced March 2024.

Semi-Global Practical Extremum Seeking with Practical Safety

Authors: Alan Williams, Miroslav Krstic, Alexander Scheinker

Abstract: We introduce a type of safe extremum seeking (ES) controller, which minimizes an unknown objective function while also maintaining practical positivity of an unknown barrier function. We show semi-global practical asymptotic stability of our algorithm and present an analogous notion of practical safety. The dynamics of the controller are inspired by the quadratic program (QP) based safety filter d… ▽ More We introduce a type of safe extremum seeking (ES) controller, which minimizes an unknown objective function while also maintaining practical positivity of an unknown barrier function. We show semi-global practical asymptotic stability of our algorithm and present an analogous notion of practical safety. The dynamics of the controller are inspired by the quadratic program (QP) based safety filter designs which, in the literature, are more commonly used in cases where the barrier function is known. Conditions on the barrier and objective function are explored showing that non convex problems can be solved. A Lyapunov argument is proposed to achieve the main results of the paper. Finally, an example is given of the algorithm which solves the constrained optimization problem. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Experimental Safe Extremum Seeking for Accelerators

Authors: Alan Williams, Alexander Scheinker, En-Chuan Huang, Charles Taylor, Miroslav Krstic

Abstract: We demonstrate the recent designs of Safe Extremum Seeking (Safe ES) on the 1 kilometer-long charged particle accelerator at the Los Alamos Neutron Science Center (LANSCE). Safe ES is a modification of ES which, in addition to minimizing an analytically unknown cost, also employs a safety filter based on an analytically unknown control barrier function (CBF) safety metric. Accelerator tuning is ne… ▽ More We demonstrate the recent designs of Safe Extremum Seeking (Safe ES) on the 1 kilometer-long charged particle accelerator at the Los Alamos Neutron Science Center (LANSCE). Safe ES is a modification of ES which, in addition to minimizing an analytically unknown cost, also employs a safety filter based on an analytically unknown control barrier function (CBF) safety metric. Accelerator tuning is necessitated by the accelerators being large, with many drifting parameters due to thermal effects and degradation. At the same time, safe operation (the maintenance of state constraints) is crucial, as damage brings astronomical costs, both financially and in operation downtime. Our measured (but analytically unknown) safety metric is the beam current. We perform multivariable Safe ES on three accelerator applications, in which we adapt 4, 6, and 3 magnet strength parameters, respectively. Two of the three applications are for validated simulation models of beamlines at LANSCE: the first for the Proton Radiography (pRad) beamline of 800 MeV protons for spot size tuning; the second on a high performance code, HPSim, for tuning the low energy beam transport (LEBT) region of of 750 keV protons. The third is an experimental tuning of the steering magnets in the LEBT at LANSCE. △ Less

Submitted 29 August, 2023; originally announced August 2023.

Virtual-Diagnostic-Based Time Stamping for Ultrafast Electron Diffraction

Authors: Frederick Cropp, Lauren Moos, Alexander Scheinker, Antonio Gilardi, Dan Wang, Sergio Paiagua, Carlos Serrano, Pietro Musumeci, Daniele Filippetto

Abstract: In this work, non-destructive virtual diagnostics are applied to retrieve the electron beam time of arrival and energy in a relativistic ultrafast electron diffraction (UED) beamline using independently-measured machine parameters. This technique has the potential to improve temporal resolution of pump and probe UED scans. Fluctuations in time of arrival have multiple components, including a shot-… ▽ More In this work, non-destructive virtual diagnostics are applied to retrieve the electron beam time of arrival and energy in a relativistic ultrafast electron diffraction (UED) beamline using independently-measured machine parameters. This technique has the potential to improve temporal resolution of pump and probe UED scans. Fluctuations in time of arrival have multiple components, including a shot-to-shot jitter and a long-term drift which can be separately addressed by closed loop feedback systems. A linear-regression-based model is used to fit the beam energy and time of arrival and is shown to be able to predict accurately behavior for both on long and short time scales. More advanced time-series analysis based on machine learning techniques can be applied to improve this prediction further. △ Less

Submitted 9 February, 2023; originally announced February 2023.

Comments: 12 pages, 10 figures

Physics-constrained 3D Convolutional Neural Networks for Electrodynamics

Authors: Alexander Scheinker, Reeju Pokharel

Abstract: We present a physics-constrained neural network (PCNN) approach to solving Maxwell's equations for the electromagnetic fields of intense relativistic charged particle beams. We create a 3D convolutional PCNN to map time-varying current and charge densities J(r,t) and p(r,t) to vector and scalar potentials A(r,t) and V(r,t) from which we generate electromagnetic fields according to Maxwell's equati… ▽ More We present a physics-constrained neural network (PCNN) approach to solving Maxwell's equations for the electromagnetic fields of intense relativistic charged particle beams. We create a 3D convolutional PCNN to map time-varying current and charge densities J(r,t) and p(r,t) to vector and scalar potentials A(r,t) and V(r,t) from which we generate electromagnetic fields according to Maxwell's equations: B=curl(A), E=-div(V)-dA/dt. Our PCNNs satisfy hard constraints, such as div(B)=0, by construction. Soft constraints push A and V towards satisfying the Lorenz gauge. △ Less

Submitted 31 January, 2023; originally announced January 2023.

2022 Review of Data-Driven Plasma Science

Authors: Rushil Anirudh, Rick Archibald, M. Salman Asif, Markus M. Becker, Sadruddin Benkadda, Peer-Timo Bremer, Rick H. S. Budé, C. S. Chang, Lei Chen, R. M. Churchill, Jonathan Citrin, Jim A Gaffney, Ana Gainaru, Walter Gekelman, Tom Gibbs, Satoshi Hamaguchi, Christian Hill, Kelli Humbird, Sören Jalas, Satoru Kawaguchi, Gon-Ho Kim, Manuel Kirchen, Scott Klasky, John L. Kline, Karl Krushelnick , et al. (38 additional authors not shown)

Abstract: Data science and technology offer transformative tools and methods to science. This review article highlights latest development and progress in the interdisciplinary field of data-driven plasma science (DDPS). A large amount of data and machine learning algorithms go hand in hand. Most plasma data, whether experimental, observational or computational, are generated or collected by machines today.… ▽ More Data science and technology offer transformative tools and methods to science. This review article highlights latest development and progress in the interdisciplinary field of data-driven plasma science (DDPS). A large amount of data and machine learning algorithms go hand in hand. Most plasma data, whether experimental, observational or computational, are generated or collected by machines today. It is now becoming impractical for humans to analyze all the data manually. Therefore, it is imperative to train machines to analyze and interpret (eventually) such data as intelligently as humans but far more efficiently in quantity. Despite the recent impressive progress in applications of data science to plasma science and technology, the emerging field of DDPS is still in its infancy. Fueled by some of the most challenging problems such as fusion energy, plasma processing of materials, and fundamental understanding of the universe through observable plasma phenomena, it is expected that DDPS continues to benefit significantly from the interdisciplinary marriage between plasma science and data science into the foreseeable future. △ Less

Submitted 31 May, 2022; originally announced May 2022.

Comments: 112 pages (including 700+ references), 44 figures, submitted to IEEE Transactions on Plasma Science as a part of the IEEE Golden Anniversary Special Issue

Report number: Los Alamos Report number LA-UR-22-24834

Journal ref: IEEE Transactions on Plasma Science 51, 1750 - 1838 (2023)

Feedback and control systems for future linear colliders: White Paper for Snowmass 2021 Topical Group AF07-RF

Authors: Daniele Filippetto, Carlos Serrano, Qiang Du, Lawrence Doolittle, Dan Wang, Michalis Bachtis, Pietro Musumeci, Alexander Scheinker, John Power, Marco Bellaveglia, Alessandro Gallo, Luca Piersanti

Abstract: Particle accelerators for high energy physics will generate TeV-scale particle beams in large, multi-Km size machines colliding high brightness beams at the interaction point [1-4]. The high luminosity in such machines is achieved by producing very small asymmetric beam size at the interaction point, with short durations to minimize beam-beam effects. Tuning energy, timing and position of the beam… ▽ More Particle accelerators for high energy physics will generate TeV-scale particle beams in large, multi-Km size machines colliding high brightness beams at the interaction point [1-4]. The high luminosity in such machines is achieved by producing very small asymmetric beam size at the interaction point, with short durations to minimize beam-beam effects. Tuning energy, timing and position of the beam for optimal performance will require high-precision controls of amplitude and phase of high-frequency electromagnetic fields and real-time processing of complex algorithms. The stability of the colliding beams has a large impact on the collider's effective luminosity. Therefore, the technology readiness level of diagnostic and control systems will be a major consideration in the collider design. The technical requirements of such systems depend on the specifics of beam parameters, such as transverse and longitudinal dimensions, charge/pulse and beam pulse format, which are driven by the accelerating technology of choice. While feedback systems with single bunch position monitor resolution below 50 nm and latency <300 ns have been demonstrated in beam test facilities, many advanced collider concepts make use of higher repetition rates, brighter beams and higher accelerating frequencies, and will require better performance, up to 1-2 order of magnitude, demanding aggressive R&D to be able to deliver and maintain the targeted luminosity. △ Less

Submitted 6 April, 2022; v1 submitted 1 April, 2022; originally announced April 2022.

Comments: contribution to Snowmass 2021

Snowmass21 Accelerator Modeling Community White Paper

Authors: S. Biedron, L. Brouwer, D. L. Bruhwiler, N. M. Cook, A. L. Edelen, D. Filippetto, C. -K. Huang, A. Huebl, T. Katsouleas, N. Kuklev, R. Lehe, S. Lund, C. Messe, W. Mori, C. -K. Ng, D. Perez, P. Piot, J. Qiang, R. Roussel, D. Sagan, A. Sahai, A. Scheinker, M. Thévenet, F. Tsung, J. -L. Vay , et al. (2 additional authors not shown)

Abstract: After a summary of relevant comments and recommendations from various reports over the last ten years, this paper examines the modeling needs in accelerator physics, from the modeling of single beams and individual accelerator elements, to the realization of virtual twins that replicate all the complexity to model a particle accelerator complex as accurately as possible. We then discuss cutting-ed… ▽ More After a summary of relevant comments and recommendations from various reports over the last ten years, this paper examines the modeling needs in accelerator physics, from the modeling of single beams and individual accelerator elements, to the realization of virtual twins that replicate all the complexity to model a particle accelerator complex as accurately as possible. We then discuss cutting-edge and emerging computing opportunities, such as advanced algorithms, AI/ML and quantum computing, computational needs in hardware, software performance, portability and scalability, and needs for scalable I/O and in-situ analysis. Considerations of reliability, long-term sustainability, user support and training are considered next, before discussing the benefits of ecosystems with integrated workflows based on standardized input and output, and with integrated frameworks and data repositories developed as a community. Last, we highlight how the community can work more collaboratively and efficiently through the development of consortia and centers, and via collaboration with industry. △ Less

Submitted 22 September, 2022; v1 submitted 15 March, 2022; originally announced March 2022.

Comments: contribution to Snowmass 2021

Adaptive Machine Learning for Time-Varying Systems: Towards 6D Phase Space Diagnostics of Short Intense Charged Particle Beams

Authors: Alexander Scheinker, Spencer Gessner

Abstract: As charged particle bunches become shorter and more intense, the effects of nonlinear intra-bunch collective interactions such as space charge forces and bunch-to-bunch influences such as wakefields and coherent synchrotron radiation also increase. Shorter more intense bunches are also more difficult to accurately image because their dimensions are beyond the resolution of existing diagnostics and… ▽ More As charged particle bunches become shorter and more intense, the effects of nonlinear intra-bunch collective interactions such as space charge forces and bunch-to-bunch influences such as wakefields and coherent synchrotron radiation also increase. Shorter more intense bunches are also more difficult to accurately image because their dimensions are beyond the resolution of existing diagnostics and they may be destructive to intercepting diagnostics. The limited availability of detailed diagnostics for intense high energy beams is a fundamental challenge for the accelerator community because both beams and accelerators are time-varying systems that change in unpredictable ways. The detailed 6D (x,y,z,px,py,pz) distributions of beams emerging from sources vary with time due to factors such as evolving photocathode laser intensity profiles and the quantum efficiency of photocathodes. Accelerator magnets, RF amplifiers, and control systems are perturbed by external disturbances, beam-loading effects, temperature variations, and misalignments. Although machine learning (ML) methods have grown in popularity in the accelerator community in recently years, they are fundamentally limited when it comes to time-varying systems for which most current approaches are to simply collect large new data sets and perform re-training, something which is not feasible for busy accelerator user facilities because detailed beam measurements usually interrupt operations. New adaptive machine learning (AML) methods designed for time-varying systems are needed to aid in the diagnostics and control of high-intensity, ultrashort beams by combining deep learning tools such as convolutional neural network-based encoder-decoder architectures, model-independent feedback, physics constraints, and online models with real time non-invasive beam data, to provide a detailed virtual view of intense bunch dynamics. △ Less

Submitted 22 March, 2022; v1 submitted 8 March, 2022; originally announced March 2022.

Comments: contribution to Snowmass 2021

Machine Learning in Nuclear Physics

Authors: Amber Boehnlein, Markus Diefenthaler, Cristiano Fanelli, Morten Hjorth-Jensen, Tanja Horn, Michelle P. Kuchera, Dean Lee, Witold Nazarewicz, Kostas Orginos, Peter Ostroumov, Long-Gang Pang, Alan Poon, Nobuo Sato, Malachi Schram, Alexander Scheinker, Michael S. Smith, Xin-Nian Wang, Veronique Ziegler

Abstract: Advances in machine learning methods provide tools that have broad applicability in scientific research. These techniques are being applied across the diversity of nuclear physics research topics, leading to advances that will facilitate scientific discoveries and societal applications. This Review gives a snapshot of nuclear physics research which has been transformed by machine learning techni… ▽ More Advances in machine learning methods provide tools that have broad applicability in scientific research. These techniques are being applied across the diversity of nuclear physics research topics, leading to advances that will facilitate scientific discoveries and societal applications. This Review gives a snapshot of nuclear physics research which has been transformed by machine learning techniques. △ Less

Submitted 2 May, 2022; v1 submitted 4 December, 2021; originally announced December 2021.

Comments: Comments are welcome

Simulations of Future Particle Accelerators: Issues and Mitigations

Authors: D. Sagan, M. Berz, N. M. Cook, Y. Hao, G. Hoffstaetter, A. Huebl, C. -K. Huang, M. H. Langston, C. E. Mayes, C. E. Mitchell, C. -K. Ng, J. Qiang, R. D. Ryne, A. Scheinker, E. Stern, J. -L. Vay, D. Winklehner, H. Zhang

Abstract: The ever increasing demands placed upon machine performance have resulted in the need for more comprehensive particle accelerator modeling. Computer simulations are key to the success of particle accelerators. Many aspects of particle accelerators rely on computer modeling at some point, sometimes requiring complex simulation tools and massively parallel supercomputing. Examples include the modeli… ▽ More The ever increasing demands placed upon machine performance have resulted in the need for more comprehensive particle accelerator modeling. Computer simulations are key to the success of particle accelerators. Many aspects of particle accelerators rely on computer modeling at some point, sometimes requiring complex simulation tools and massively parallel supercomputing. Examples include the modeling of beams at extreme intensities and densities (toward the quantum degeneracy limit), and with ultra-fine control (down to the level of individual particles). In the future, adaptively tuned models might also be relied upon to provide beam measurements beyond the resolution of existing diagnostics. Much time and effort has been put into creating accelerator software tools, some of which are highly successful. However, there are also shortcomings such as the general inability of existing software to be easily modified to meet changing simulation needs. In this paper possible mitigating strategies are discussed for issues faced by the accelerator community as it endeavors to produce better and more comprehensive modeling tools. This includes lack of coordination between code developers, lack of standards to make codes portable and/or reusable, lack of documentation, among others. △ Less

Submitted 24 August, 2021; originally announced August 2021.

Comments: 21 pages, 1 figure. To be published in JINST

Adaptive Machine Learning for Time-Varying Systems: Low Dimensional Latent Space Tuning

Authors: Alexander Scheinker

Abstract: Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map combinations of accelerator parameters and images which are 2D projections of the 6D phase space distributions of charged particle beams as they are transported between… ▽ More Machine learning (ML) tools such as encoder-decoder convolutional neural networks (CNN) can represent incredibly complex nonlinear functions which map between combinations of images and scalars. For example, CNNs can be used to map combinations of accelerator parameters and images which are 2D projections of the 6D phase space distributions of charged particle beams as they are transported between various particle accelerator locations. Despite their strengths, applying ML to time-varying systems, or systems with shifting distributions, is an open problem, especially for large systems for which collecting new data for re-training is impractical or interrupts operations. Particle accelerators are one example of large time-varying systems for which collecting detailed training data requires lengthy dedicated beam measurements which may no longer be available during regular operations. We present a recently developed method of adaptive ML for time-varying systems. Our approach is to map very high (N>100k) dimensional inputs (a combination of scalar parameters and images) into the low dimensional (N~2) latent space at the output of the encoder section of an encoder-decoder CNN. We then actively tune the low dimensional latent space-based representation of complex system dynamics by the addition of an adaptively tuned feedback vector directly before the decoder sections builds back up to our image-based high-dimensional phase space density representations. This method allows us to learn correlations within and to quickly tune the characteristics of incredibly high parameter systems and to track their evolution in real time based on feedback without massive new data sets for re-training. △ Less

Submitted 13 July, 2021; originally announced July 2021.

Adaptive Latent Space Tuning for Non-Stationary Distributions

Authors: Alexander Scheinker, Frederick Cropp, Sergio Paiagua, Daniele Filippetto

Abstract: Powerful deep learning tools, such as convolutional neural networks (CNN), are able to learn the input-output relationships of large complicated systems directly from data. Encoder-decoder deep CNNs are able to extract features directly from images, mix them with scalar inputs within a general low-dimensional latent space, and then generate new complex 2D outputs which represent complex physical p… ▽ More Powerful deep learning tools, such as convolutional neural networks (CNN), are able to learn the input-output relationships of large complicated systems directly from data. Encoder-decoder deep CNNs are able to extract features directly from images, mix them with scalar inputs within a general low-dimensional latent space, and then generate new complex 2D outputs which represent complex physical phenomenon. One important challenge faced by deep learning methods is large non-stationary systems whose characteristics change quickly with time for which re-training is not feasible. In this paper we present a method for adaptive tuning of the low-dimensional latent space of deep encoder-decoder style CNNs based on real-time feedback to quickly compensate for unknown and fast distribution shifts. We demonstrate our approach for predicting the properties of a time-varying charged particle beam in a particle accelerator whose components (accelerating electric fields and focusing magnetic fields) are also quickly changing with time. △ Less

Submitted 6 June, 2021; v1 submitted 7 May, 2021; originally announced May 2021.

Adaptive deep learning for time-varying systems with hidden parameters: Predicting changing input beam distributions of compact particle accelerators

Authors: Alexander Scheinker, Frederick Cropp, Sergio Paiagua, Daniele Filippetto

Abstract: Machine learning (ML) tools such as encoder-decoder deep convolutional neural networks (CNN) are able to extract relationships between inputs and outputs of large complex systems directly from raw data. For time-varying systems the predictive capabilities of ML tools degrade as the systems are no longer accurately represented by the data sets with which the ML models were trained. Re-training is p… ▽ More Machine learning (ML) tools such as encoder-decoder deep convolutional neural networks (CNN) are able to extract relationships between inputs and outputs of large complex systems directly from raw data. For time-varying systems the predictive capabilities of ML tools degrade as the systems are no longer accurately represented by the data sets with which the ML models were trained. Re-training is possible, but only if the changes are slow and if new input-output training data measurements can be made online non-invasively. In this work we present an approach to deep learning for time-varying systems in which adaptive feedback based only on available system output measurements is applied to encoded low-dimensional dense layers of encoder-decoder type CNNs. We demonstrate our method in developing an inverse model of a complex charged particle accelerator system, mapping output beam measurements to input beam distributions while both the accelerator components and the unknown input beam distribution quickly vary with time. We demonstrate our results using experimental measurements of the input and output beam distributions of the HiRES ultra-fast electron diffraction (UED) microscopy beam line at Lawrence Berkeley National Laboratory. We show how our method can be used to aid both physics and ML-based surrogate online models to provide non-invasive beam diagnostics and we also demonstrate how our method can be used to automatically track the time varying quantum efficiency map of a particle accelerator's photocathode. △ Less

Submitted 23 March, 2021; v1 submitted 21 February, 2021; originally announced February 2021.

Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging

Authors: Alexander Scheinker, Reeju Pokharel

Abstract: We present a novel adaptive machine-learning based approach for reconstructing three-dimensional (3D) crystals from coherent diffraction imaging (CDI). We represent the crystals using spherical harmonics (SH) and generate corresponding synthetic diffraction patterns. We utilize 3D convolutional neural networks (CNN) to learn a mapping between 3D diffraction volumes and the SH which describe the bo… ▽ More We present a novel adaptive machine-learning based approach for reconstructing three-dimensional (3D) crystals from coherent diffraction imaging (CDI). We represent the crystals using spherical harmonics (SH) and generate corresponding synthetic diffraction patterns. We utilize 3D convolutional neural networks (CNN) to learn a mapping between 3D diffraction volumes and the SH which describe the boundary of the physical volumes from which they were generated. We use the 3D CNN-predicted SH coefficients as the initial guesses which are then fine tuned using adaptive model independent feedback for improved accuracy. △ Less

Submitted 23 August, 2020; originally announced August 2020.

Online Multi-Objective Particle Accelerator Optimization of the AWAKE Electron Beam Line for Simultaneous Emittance and Orbit Control

Authors: Alexander Scheinker, Simon Hirlaende, Francesco Maria Velotti, Spencer Gessner, Giovanni Zevi Della Port, Verena Kain, Rebecca Ramjiawan

Abstract: Multi-objective optimization is important for particle accelerators where various competing objectives must be satisfied routinely such as, for example, transverse emittance vs bunch length. We develop and demonstrate an online multi-time scale multi-objective optimization algorithm that performs real time feedback on particle accelerators. We demonstrate the ability to simultaneously minimize the… ▽ More Multi-objective optimization is important for particle accelerators where various competing objectives must be satisfied routinely such as, for example, transverse emittance vs bunch length. We develop and demonstrate an online multi-time scale multi-objective optimization algorithm that performs real time feedback on particle accelerators. We demonstrate the ability to simultaneously minimize the emittance and maintain a reference trajectory of a beam in the electron beamline in CERN's Advanced Proton Driven Plasma Wakefield Acceleration Experiment (AWAKE). △ Less

Submitted 24 March, 2020; originally announced March 2020.

Advanced Control Methods for Particle Accelerators (ACM4PA) 2019 Workshop Report

Authors: Alexander Scheinker, Claudio Emma, Auralee L. Edelen, Spencer Gessner

Abstract: Los Alamos is currently developing novel particle accelerator controls and diagnostics algorithms to enable higher quality beams with lower beam losses than is currently possible. The purpose of this workshop was to consider tuning and optimization challenges of a wide range of particle accelerators including linear proton accelerators such as the Los Alamos Neutron Science Center (LANSCE), rings… ▽ More Los Alamos is currently developing novel particle accelerator controls and diagnostics algorithms to enable higher quality beams with lower beam losses than is currently possible. The purpose of this workshop was to consider tuning and optimization challenges of a wide range of particle accelerators including linear proton accelerators such as the Los Alamos Neutron Science Center (LANSCE), rings such as the Advanced Photon Source (APS) synchrotron, free electron lasers (FEL) such as the Linac Coherent Light Source (LCLS) and LCLS-II, the European X-ray Free Electron Laser (EuXFEL), the Swiss FEL, and the planned MaRIE FEL, and plasma wake-field accelerators such as FACET, FACET-II, and AWAKE at CERN. One major challenge is an the ability to quickly create very high quality, extremely intense, custom current and energy profile beams while working with limited real time non-invasive diagnostics and utilizing time-varying uncertain initial beam distributions and accelerator components. Currently, a few individual accelerator labs have been developing and applying their own diagnostics tools and custom control and ML algorithms for automated machine tuning and optimization. The goal of this workshop was to bring together a group of accelerator physicists and accelerator related control and ML experts in order to define which controls and diagnostics would be most useful for existing and future accelerators and to create a plan for developing a new family of algorithms that can be shared and maintained by the community. △ Less

Submitted 15 January, 2020; originally announced January 2020.

Report number: LA-UR-19-32526

Response to NITRD, NCO, NSF Request for Information on "Update to the 2016 National Artificial Intelligence Research and Development Strategic Plan"

Authors: J. Amundson, J. Annis, C. Avestruz, D. Bowring, J. Caldeira, G. Cerati, C. Chang, S. Dodelson, D. Elvira, A. Farahi, K. Genser, L. Gray, O. Gutsche, P. Harris, J. Kinney, J. B. Kowalkowski, R. Kutschke, S. Mrenna, B. Nord, A. Para, K. Pedro, G. N. Perdue, A. Scheinker, P. Spentzouris, J. St. John , et al. (5 additional authors not shown)

Abstract: We present a response to the 2018 Request for Information (RFI) from the NITRD, NCO, NSF regarding the "Update to the 2016 National Artificial Intelligence Research and Development Strategic Plan." Through this document, we provide a response to the question of whether and how the National Artificial Intelligence Research and Development Strategic Plan (NAIRDSP) should be updated from the perspect… ▽ More We present a response to the 2018 Request for Information (RFI) from the NITRD, NCO, NSF regarding the "Update to the 2016 National Artificial Intelligence Research and Development Strategic Plan." Through this document, we provide a response to the question of whether and how the National Artificial Intelligence Research and Development Strategic Plan (NAIRDSP) should be updated from the perspective of Fermilab, America's premier national laboratory for High Energy Physics (HEP). We believe the NAIRDSP should be extended in light of the rapid pace of development and innovation in the field of Artificial Intelligence (AI) since 2016, and present our recommendations below. AI has profoundly impacted many areas of human life, promising to dramatically reshape society --- e.g., economy, education, science --- in the coming years. We are still early in this process. It is critical to invest now in this technology to ensure it is safe and deployed ethically. Science and society both have a strong need for accuracy, efficiency, transparency, and accountability in algorithms, making investments in scientific AI particularly valuable. Thus far the US has been a leader in AI technologies, and we believe as a national Laboratory it is crucial to help maintain and extend this leadership. Moreover, investments in AI will be important for maintaining US leadership in the physical sciences. △ Less

Submitted 4 November, 2019; originally announced November 2019.

Report number: FERMILAB-FN-1092-SCD

Phase space exchange-based bunch compression with reduced CSR effects

Authors: Alexander Malyzhenkov, Alexander Scheinker

Abstract: Through an interaction of theory and optimization-guided design, we have developed a novel bunch compression scheme based on an asymmetric double emittance exchange (DEEX) with greatly reduced coherent synchrotron radiation (CSR) effects. First, we discuss the benefits of the phase space exchange-based bunch compressor (BC) in comparison to the chicane-based counterpart in the approximation of lin… ▽ More Through an interaction of theory and optimization-guided design, we have developed a novel bunch compression scheme based on an asymmetric double emittance exchange (DEEX) with greatly reduced coherent synchrotron radiation (CSR) effects. First, we discuss the benefits of the phase space exchange-based bunch compressor (BC) in comparison to the chicane-based counterpart in the approximation of linear single particle dynamics and with respect to microbunching instabilities driven by longitudinal space charge forces. We present simulation results for nonlinear dynamics in a symmetric DEEX BC which accounts for the CSR effects of the scheme with direct and mirrored longitudinal phase space at the exit of the beamline. The later scheme demonstrates self-compensation of CSR effects on the longitudinal dynamics. Next, we optimize the parameters of the beam elements with an adaptive feedback, resulting in an asymmetric configuration of the scheme with compensated CSR and nonlinear effects on the transverse dynamics, which we further improve by incorporating several sextupoles relying on an eigen-emittance analysis. Finally, we discuss how this method can be generalized for optimizing nonlinear beam dynamics with collective effects. △ Less

Submitted 14 September, 2018; originally announced September 2018.

Extremum Seeking Optimal Controls of Unknown Systems

Authors: Alexander Scheinker, David Scheinker

Abstract: We present a method for finding optimal controllers for unknown, time-varying, dynamic systems which can be re-initialized from a given initial condition repeatedly, in which the performance measure is available for sampling with noise, but analytically unknown. Such systems are present throughout industry where processes must be repeated many times, such as a voltage source which is repeatedly tu… ▽ More We present a method for finding optimal controllers for unknown, time-varying, dynamic systems which can be re-initialized from a given initial condition repeatedly, in which the performance measure is available for sampling with noise, but analytically unknown. Such systems are present throughout industry where processes must be repeated many times, such as a voltage source which is repeatedly turned on for a fraction of a second from zero initial conditions and then turned off again, whose output must track a specific trajectory, while the system's components are slowly drifting with time due to temperature variations. For systems with convex cost functions we prove that our algorithm will produce controllers that approach the minimal cost, e.g., the cost minimizing LQR optimal controller that could have been designed analytically had the system and objective function been known. We demonstrate the algorithm's effectiveness with simulation studies of noisy and time-varying systems. △ Less

Submitted 15 August, 2018; originally announced August 2018.

Extremum Seeking for Stabilization of Systems Not Affine in Control

Authors: Alexander Scheinker, David Scheinker

Abstract: In [22] a form of extremum seeking for control (ESC) was developed for the stabilization of uncertain nonlinear systems. In ESC the extremum seeker itself controls the systems through feedback rather than fine tuning a controller. The ESC results, and other related results, apply only to systems affine in control. However, in most physical systems the control effort enters the system's dynamics th… ▽ More In [22] a form of extremum seeking for control (ESC) was developed for the stabilization of uncertain nonlinear systems. In ESC the extremum seeker itself controls the systems through feedback rather than fine tuning a controller. The ESC results, and other related results, apply only to systems affine in control. However, in most physical systems the control effort enters the system's dynamics through a nonlinear function, such as an input with deadline and saturation. In this work, we utilize our previous results on ESC to develop stabilizing controllers for systems of practical interest that are non-affine in control. △ Less

Submitted 16 August, 2016; originally announced August 2016.

Comments: 6 pages, 4 figures

Suppression of Space Charge Induced Beam Halo in Nonlinear Focusing Channel

Authors: Yuri K. Batygin, Alexander Scheinker, Sergey Kurennoy, Chao Li

Abstract: An intense non-uniform particle beam exhibits strong emittance growth and halo formation in focusing channels due to nonlinear space charge forces of the beam. This phenomenon limits beam brightness and results in particle losses. The problem is connected with irreversible distortion of phase space volume of the beam in conventional focusing structures due to filamentation in phase space. Emittanc… ▽ More An intense non-uniform particle beam exhibits strong emittance growth and halo formation in focusing channels due to nonlinear space charge forces of the beam. This phenomenon limits beam brightness and results in particle losses. The problem is connected with irreversible distortion of phase space volume of the beam in conventional focusing structures due to filamentation in phase space. Emittance growth is accompanied by halo formation in real space, which results in inevitable particle losses. A new approach for solving a self-consistent problem for a matched non-uniform beam in two-dimensional geometry is discussed. The resulting solution is applied to the problem of beam transport, while avoiding emittance growth and halo formation by the use of nonlinear focusing field. Conservation of a beam distribution function is demonstrated analytically and by particle-in-cell simulation for a beam with a realistic beam distribution. △ Less

Submitted 16 February, 2016; originally announced February 2016.

Comments: 17 pages, 9 figures

Report number: LA-UR-15-20477

Journal ref: Nuclear Instruments and Methods in Physics Research A 816 (2016) 78 - 86