Showing 1–8 of 8 results for author: Ghavami, M

Probabilistic Programming with Programmable Variational Inference

Authors: McCoy R. Becker, Alexander K. Lew, Xiaoyan Wang, Matin Ghavami, Mathieu Huot, Martin C. Rinard, Vikash K. Mansinghka

Abstract: Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection of variational objectives and gradient estimators, which are implemented monolithically (and without formal correctness arguments) in PPL backends. In this paper… ▽ More Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection of variational objectives and gradient estimators, which are implemented monolithically (and without formal correctness arguments) in PPL backends. In this paper, we propose a more modular approach to supporting variational inference in PPLs, based on compositional program transformation. In our approach, variational objectives are expressed as programs, that may employ first-class constructs for computing densities of and expected values under user-defined models and variational families. We then transform these programs systematically into unbiased gradient estimators for optimizing the objectives they define. Our design enables modular reasoning about many interacting concerns, including automatic differentiation, density accumulation, tracing, and the application of unbiased gradient estimation strategies. Additionally, relative to existing support for VI in PPLs, our design increases expressiveness along three axes: (1) it supports an open-ended set of user-defined variational objectives, rather than a fixed menu of options; (2) it supports a combinatorial space of gradient estimation strategies, many not automated by today's PPLs; and (3) it supports a broader class of models and variational families, because it supports constructs for approximate marginalization and normalization (previously introduced only for Monte Carlo inference). We implement our approach in an extension to the Gen probabilistic programming system (genjax.vi, implemented in JAX), and evaluate on several deep generative modeling tasks, showing minimal performance overhead vs. hand-coded implementations and performance competitive with well-established open-source PPLs. △ Less

Submitted 22 June, 2024; originally announced June 2024.

Journal ref: PLDI 2024

GenSQL: A Probabilistic Programming System for Querying Generative Models of Database Tables

Authors: Mathieu Huot, Matin Ghavami, Alexander K. Lew, Ulrich Schaechtle, Cameron E. Freer, Zane Shelby, Martin C. Rinard, Feras A. Saad, Vikash K. Mansinghka

Abstract: This article presents GenSQL, a probabilistic programming system for querying probabilistic generative models of database tables. By augmenting SQL with only a few key primitives for querying probabilistic models, GenSQL enables complex Bayesian inference workflows to be concisely implemented. GenSQL's query planner rests on a unified programmatic interface for interacting with probabilistic model… ▽ More This article presents GenSQL, a probabilistic programming system for querying probabilistic generative models of database tables. By augmenting SQL with only a few key primitives for querying probabilistic models, GenSQL enables complex Bayesian inference workflows to be concisely implemented. GenSQL's query planner rests on a unified programmatic interface for interacting with probabilistic models of tabular data, which makes it possible to use models written in a variety of probabilistic programming languages that are tailored to specific workflows. Probabilistic models may be automatically learned via probabilistic program synthesis, hand-designed, or a combination of both. GenSQL is formalized using a novel type system and denotational semantics, which together enable us to establish proofs that precisely characterize its soundness guarantees. We evaluate our system on two case real-world studies -- an anomaly detection in clinical trials and conditional synthetic data generation for a virtual wet lab -- and show that GenSQL more accurately captures the complexity of the data as compared to common baselines. We also show that the declarative syntax in GenSQL is more concise and less error-prone as compared to several alternatives. Finally, GenSQL delivers a 1.7-6.8x speedup compared to its closest competitor on a representative benchmark set and runs in comparable time to hand-written code, in part due to its reusable optimizations and code specialization. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Comments: 54 pages, 30 figures, 1 table, published at PLDI 2024

Multi-BD Symbiotic Radio-Aided 6G IoT Network: Energy Consumption Optimization with QoS Constraint Approach

Authors: Rahman Saadat Yeganeh, Mohammad Javad Omidi, Mohammad Ghavami

Abstract: The commensal symbiotic radio (CSR) system is proposed as a novel solution for connecting systems through green communication networks. This system enables us to establish secure, ubiquitous, and unlimited connectivity, which is a goal of 6G. The base station uses MIMO antennas to transmit its signal. Passive IoT devices, called symbiotic backscatter devices (SBDs), receive the signal and use it t… ▽ More The commensal symbiotic radio (CSR) system is proposed as a novel solution for connecting systems through green communication networks. This system enables us to establish secure, ubiquitous, and unlimited connectivity, which is a goal of 6G. The base station uses MIMO antennas to transmit its signal. Passive IoT devices, called symbiotic backscatter devices (SBDs), receive the signal and use it to charge their power supply. When the SBDs have data to transmit, they modulate the information onto the received ambient RF signal and send it to the symbiotic user equipment, which is a typical active device. The main purpose is to enhance energy efficiency in this network by minimizing energy consumption (EC) while ensuring the minimum required throughput for SBDs. To achieve this, we propose a new scheduling scheme called Timing-SR that optimally allocates resources to SBDs. The main optimization problem involves non-convex objective functions and constraints. To solve this, we use mathematical techniques and introduce a new approach called sequential quadratic and conic quadratic representation to relax and discipline the problem, leading to reducing its complexity and convergence time. The simulation results demonstrate that the proposed approach outperforms other outlined schemes in reducing EC. △ Less

Submitted 29 January, 2024; originally announced January 2024.

Sum Throughput Maximization in Multi-BD Symbiotic Radio NOMA Network Assisted by Active-STAR-RIS

Authors: Rahman Saadat Yeganeh, Mohammad Javad Omidi, Farshad Zeinali, Mohammad Robat Mili, Mohammad Ghavami

Abstract: In this paper, we employ active simultaneously transmitting and reflecting reconfigurable intelligent surface (ASRIS) to aid in establishing and enhancing communication within a commensal symbiotic radio (CSR) network. Unlike traditional RIS, ASRIS not only ensures coverage in an omni directional manner but also amplifies received signals, consequently elevating overall network performance. in the… ▽ More In this paper, we employ active simultaneously transmitting and reflecting reconfigurable intelligent surface (ASRIS) to aid in establishing and enhancing communication within a commensal symbiotic radio (CSR) network. Unlike traditional RIS, ASRIS not only ensures coverage in an omni directional manner but also amplifies received signals, consequently elevating overall network performance. in the first phase, base station (BS) with active massive MIMO antennas, send ambient signal to SBDs. In the first phase, the BS transmits ambient signals to the symbiotic backscatter devices (SBDs), and after harvesting the energy and modulating their information onto the signal carrier, the SBDs send Backscatter signals back to the BS. In this scheme, we employ the Backscatter Relay system to facilitate the transmission of information from the SBDs to the symbiotic User Equipments (SUEs) with the assistance of the BS. In the second phase, the BS transmits information signals to the SUEs after eliminating interference using the Successive Interference Cancellation (SIC) method. ASRIS is employed to establish communication among SUEs lacking a line of sight (LoS) and to amplify power signals for SUEs with a LoS connection to the BS. It is worth noting that we use NOMA for multiple access in all network. The main goal of this paper is to maximize the sum throughput between all users. To achieve this, we formulate an optimization problem with variables including active beamforming coefficients at the BS and ASRIS, as well as the phase adjustments of ASRIS and scheduling parameters between the first and second phases. To model this optimization problem, we employ three deep reinforcement learning (DRL) methods, namely PPO, TD3, and A3C. Finally, the mentioned methods are simulated and compared with each other. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Comments: This article will be submitted to the Transactions journal

Bayes3D: fast learning and inference in structured generative models of 3D objects and scenes

Authors: Nishad Gothoskar, Matin Ghavami, Eric Li, Aidan Curtis, Michael Noseworthy, Karen Chung, Brian Patton, William T. Freeman, Joshua B. Tenenbaum, Mirko Klukas, Vikash K. Mansinghka

Abstract: Robots cannot yet match humans' ability to rapidly learn the shapes of novel 3D objects and recognize them robustly despite clutter and occlusion. We present Bayes3D, an uncertainty-aware perception system for structured 3D scenes, that reports accurate posterior uncertainty over 3D object shape, pose, and scene composition in the presence of clutter and occlusion. Bayes3D delivers these capabilit… ▽ More Robots cannot yet match humans' ability to rapidly learn the shapes of novel 3D objects and recognize them robustly despite clutter and occlusion. We present Bayes3D, an uncertainty-aware perception system for structured 3D scenes, that reports accurate posterior uncertainty over 3D object shape, pose, and scene composition in the presence of clutter and occlusion. Bayes3D delivers these capabilities via a novel hierarchical Bayesian model for 3D scenes and a GPU-accelerated coarse-to-fine sequential Monte Carlo algorithm. Quantitative experiments show that Bayes3D can learn 3D models of novel objects from just a handful of views, recognizing them more robustly and with orders of magnitude less training data than neural baselines, and tracking 3D objects faster than real time on a single GPU. We also demonstrate that Bayes3D learns complex 3D object models and accurately infers 3D scene composition when used on a Panda robot in a tabletop scenario. △ Less

Submitted 14 December, 2023; originally announced December 2023.

A Consensus-Based Generalized Multi-Population Aggregative Game with Application to Charging Coordination of Electric Vehicles

Authors: Mahsa Ghavami, Babak Ghaffarzadeh Bakhshayesh, Mohammad Haeri, Giacomo Como, Hamed Kebriaei

Abstract: This paper introduces a consensus-based generalized multi-population aggregative game coordination approach with application to electric vehicles charging under transmission line constraints. The algorithm enables agents to seek an equilibrium solution while considering the limited infrastructure capacities that impose coupling constraints among the users. The Nash-seeking algorithm consists of tw… ▽ More This paper introduces a consensus-based generalized multi-population aggregative game coordination approach with application to electric vehicles charging under transmission line constraints. The algorithm enables agents to seek an equilibrium solution while considering the limited infrastructure capacities that impose coupling constraints among the users. The Nash-seeking algorithm consists of two interrelated iterations. In the upper layer, population coordinators collaborate for a distributed estimation of the coupling aggregate term in the agents' cost function and the associated Lagrange multiplier of the coupling constraint, transmitting the latest updated values to their population's agents. In the lower layer, each agent updates its best response based on the most recent information received and communicates it back to its population coordinator. For the case when the agents' best response mappings are non-expansive, we prove the algorithm's convergence to the generalized Nash equilibrium point of the game. Simulation results demonstrate the algorithm's effectiveness in achieving equilibrium in the presence of a coupling constraint. △ Less

Submitted 18 October, 2023; originally announced October 2023.

Comments: 8 pages, 5 figures, journal

Stochastic Galerkin finite element method for nonlinear elasticity and application to reinforced concrete members

Authors: Mohammad S. Ghavami, Bedřich Sousedík, Hooshang Dabbagh, Morad Ahmadnasab

Abstract: We develop a stochastic Galerkin finite element method for nonlinear elasticity and apply it to reinforced concrete members with random material properties. The strategy is based on the modified Newton-Raphson method, which consists of an incremental loading process and a linearization scheme applied at each load increment. We consider that the material properties are given by a stochastic expansi… ▽ More We develop a stochastic Galerkin finite element method for nonlinear elasticity and apply it to reinforced concrete members with random material properties. The strategy is based on the modified Newton-Raphson method, which consists of an incremental loading process and a linearization scheme applied at each load increment. We consider that the material properties are given by a stochastic expansion in the so-called generalized polynomial chaos (gPC) framework. We search the gPC expansion of the displacement, which is then used to update the gPC expansions of the stress, strain and internal forces. The proposed method is applied to a reinforced concrete beam with uncertain initial concrete modulus of elasticity and a shear wall with uncertain maximum compressive stress of concrete, and the results are compared to those of stochastic collocation and Monte Carlo methods. Since the systems of equations obtained in the linearization scheme using the stochastic Galerkin method are very large, and there are typically many load increments, we also studied iterative solution using preconditioned conjugate gradients. The efficiency of the proposed method is illustrated by a set of numerical experiments. △ Less

Submitted 21 March, 2022; originally announced March 2022.

Comments: 24 pages, 12 figures, 5 tables

MSC Class: 65F08; 65N22 ACM Class: G.1.3; G.3

Full Electrostatic Control of Nanomechanical Buckling

Authors: Selcuk Oguz Erbil, Utku Hatipoglu, Cenk Yanik, Mahyar Ghavami, Atakan B. Ari, Mert Yuksel, M. Selim Hanay

Abstract: Buckling at the micro and nanoscale generates distant bistable states which can be beneficial for sensing, shape-reconfiguration and mechanical computation applications. Although different approaches have been developed to access buckling at small scales, such as the use heating or pre-stressing beams, very little attention has been paid so far to dynamically and precisely control all the critical… ▽ More Buckling at the micro and nanoscale generates distant bistable states which can be beneficial for sensing, shape-reconfiguration and mechanical computation applications. Although different approaches have been developed to access buckling at small scales, such as the use heating or pre-stressing beams, very little attention has been paid so far to dynamically and precisely control all the critical bifurcation parameters, the compressive stress and the lateral force on the beam. Precise and on-demand generation of compressive stress on individually addressable microstructures is especially critical for morphologically reconfigurable devices. Here, we develop an all-electrostatic architecture to control the compressive force, as well as the direction and amount of buckling, without significant heat generation on micro/nano structures. With this architecture, we demonstrated fundamental aspects of device function and dynamics. By applying voltages at any of the digital electronics standards, we have controlled the direction of buckling. Lateral deflections as large as 12% of the beam length were achieved. By modulating the compressive stress and lateral electrostatic force acting on the beam, we tuned the potential energy barrier between the post-bifurcation stable states and characterized snap-through transitions between these states. The proposed architecture opens avenues for further studies that can enable efficient actuators and multiplexed shape-shifting devices. △ Less

Submitted 13 February, 2019; originally announced February 2019.

Journal ref: Phys. Rev. Lett. 124, 046101 (2020)