-
CityTFT: Temporal Fusion Transformer for Urban Building Energy Modeling
Authors:
Ting-Yu Dai,
Dev Niyogi,
Zoltan Nagy
Abstract:
Urban Building Energy Modeling (UBEM) is an emerging method to investigate urban design and energy systems against the increasing energy demand at urban and neighborhood levels. However, current UBEM methods are mostly physic-based and time-consuming in multiple climate change scenarios. This work proposes CityTFT, a data-driven UBEM framework, to accurately model the energy demands in urban envir…
▽ More
Urban Building Energy Modeling (UBEM) is an emerging method to investigate urban design and energy systems against the increasing energy demand at urban and neighborhood levels. However, current UBEM methods are mostly physic-based and time-consuming in multiple climate change scenarios. This work proposes CityTFT, a data-driven UBEM framework, to accurately model the energy demands in urban environments. With the empowerment of the underlying TFT framework and an augmented loss function, CityTFT could predict heating and cooling triggers in unseen climate dynamics with an F1 score of 99.98 \% while RMSE of loads of 13.57 kWh.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Understanding the soil water dynamics during excess and deficit rainfall conditions over the Core monsoon zone of India
Authors:
Mangesh M. Goswami,
Milind Mujumdar,
Bhupendra Bahadur Singh,
Madhusudan Ingale,
Naresh Ganeshi,
Manish Ranalkar,
Trenton E. Franz,
Prashant Srivastav,
Dev Niyogi,
R. Krishnan,
S. N. Patil
Abstract:
Observations of soil moisture (SM) during excess and deficit monsoon seasons between 2000 to 2021 present a unique opportunity to understand the soil water dynamics (SWD) over core monsoon zone (CMZ) of India. This study aims to analyse SWD by investigating the SM variability, SM memory (SMM), and the coupling between the surface and subsurface SM levels. Particularly intriguing are instances of c…
▽ More
Observations of soil moisture (SM) during excess and deficit monsoon seasons between 2000 to 2021 present a unique opportunity to understand the soil water dynamics (SWD) over core monsoon zone (CMZ) of India. This study aims to analyse SWD by investigating the SM variability, SM memory (SMM), and the coupling between the surface and subsurface SM levels. Particularly intriguing are instances of concurrent monsoonal extremes, which give rise to complex SWD patterns. Usually, it is noted that a depleted convective activity and persistence of higher temperatures during the pre-monsoon season leads to lower SM, while monsoon rains and post-monsoon showers support the prevalence of higher SM conditions. The long persistent dry spells during deficit monsoon years enhances the Bowen ratio (BR) due to the high sensible heat fluxes. On the other hand, the availability of large latent heat flux during excess monsoon and post-monsoon seasons tends to decrease the BR. This enhancement or reduction in BR is due to evapotranspiration (ET), which influences the SWD by modulating the surface subsurface SM coupling. The surface and subsurface SM coupling analysis for CMZ exhibits significant distinction in the evolution of wet and dry extremes. SM variations and persistence time scale is used as an indicator of SMM, and analysed for both surface and subsurface SM observation levels. Evidently, subsurface SM exhibits remarkably prolonged memory timescales, approximately twice that of surface SM. Furthermore, we dissect SWD linked to wet and dry extremes by analysing annual soil water balance (SWB). Our findings reveal augmented (diminished) ET during deficit (excess) years, subjected to a higher (lower) number of break events. In essence, our study underscores the significance of surface-subsurface SM observations in unravelling the intricate tapestry of SWD.
△ Less
Submitted 29 August, 2023;
originally announced August 2023.
-
Developing Digital Twins for Earth Systems: Purpose, Requisites, and Benefits
Authors:
Yuhan Rao,
Rob Redmon,
Kirstine Dale,
Sue E. Haupt,
Aaron Hopkinson,
Ann Bostrom,
Sid Boukabara,
Thomas Geenen,
David M. Hall,
Benjamin D. Smith,
Dev Niyogi,
V. Ramaswamy,
Eric A. Kihn
Abstract:
The accelerated change in our planet due to human activities has led to grand societal challenges including health crises, intensified extreme weather events, food security, environmental injustice, etc. Digital twin systems combined with emerging technologies such as artificial intelligence and edge computing provide opportunities to support planning and decision-making to address these challenge…
▽ More
The accelerated change in our planet due to human activities has led to grand societal challenges including health crises, intensified extreme weather events, food security, environmental injustice, etc. Digital twin systems combined with emerging technologies such as artificial intelligence and edge computing provide opportunities to support planning and decision-making to address these challenges. Digital twins for Earth systems (DT4ESs) are defined as the digital representation of the complex integrated Earth system including both natural processes and human activities. They have the potential to enable a diverse range of users to explore what-if scenarios across spatial and temporal scales to improve our understanding, prediction, mitigation, and adaptation to grand societal challenges. The 4th NOAA AI Workshop convened around 100 members who are developing or interested in participating in the development of DT4ES to discuss a shared community vision and path forward on fostering a future ecosystem of interoperable DT4ES. This paper summarizes the workshop discussions around DT4ES. We first defined the foundational features of a viable digital twins for Earth system that can be used to guide the development of various use cases of DT4ES. Finally, we made practical recommendations for the community on different aspects of collaboration in order to enable a future ecosystem of interoperable DT4ES, including equity-centered use case development, community-driven investigation of interoperability for DT4ES, trust-oriented co-development, and developing a community of practice.
△ Less
Submitted 19 June, 2023;
originally announced June 2023.
-
Long-term normalized difference urban index (NDUI) data time series for urban studies
Authors:
Manmeet Singh,
Subhasis Ghosh,
Harsh Kamath,
Vaisakh SB,
Chandana Mitra,
Shivam Saxena,
Suryachandra Rao,
Marshall Shepherd,
Dev Niyogi
Abstract:
Keeping continuous, long-term data to examine changes in urban surroundings is crucial as cities expand and develop. The DMSP OLS nighttime lights data and the Landsat NDVI were used to create the Normalized Difference Urbanization Index (NDUI), which has proven to be an invaluable resource for studying urban areas. However, DMSP's reach and usefulness are constrained by the fact that data collect…
▽ More
Keeping continuous, long-term data to examine changes in urban surroundings is crucial as cities expand and develop. The DMSP OLS nighttime lights data and the Landsat NDVI were used to create the Normalized Difference Urbanization Index (NDUI), which has proven to be an invaluable resource for studying urban areas. However, DMSP's reach and usefulness are constrained by the fact that data collecting ended in 2014 while VIIRS has continued to collect the nighttime lights data since 2012. The unavailability of DMSP translates to a challenge in performing urban studies using the NDUI. In this work, we address this difficulty and suggest a novel approach to bringing the NDUI time series up to date. We first map the VIIRS to DMSP using 2012 as a calibration year and then construct an updated NDUI time series. ClimateDownscaleSuite is used and Swin Transformer is selected as the best model for the mapping. The Swin Transformer model and the sophisticated machine learning capabilities it offers are used in conjunction with the VIIRS evening lighting data collected after 2012. By using this strategy, not only is the NDUI time series extended, but the potential of AI in filling in data gaps and boosting urban studies is also highlighted.
△ Less
Submitted 5 June, 2023;
originally announced June 2023.
-
Fire and Smoke Digital Twin -- A computational framework for modeling fire incident outcomes
Authors:
Junfeng Jiao,
Ryan Hardesty Lewis,
Kijin Seong,
Arya Farahi,
Paul Navratil,
Nate Casebeer,
Dev Niyogi
Abstract:
Fires and burning are the chief causes of particulate matter (PM2.5), a key measurement of air quality in communities and cities worldwide. This work develops a live fire tracking platform to show active reported fires from over twenty cities in the U.S., as well as predict their smoke paths and impacts on the air quality of regions within their range. Specifically, our close to real-time tracking…
▽ More
Fires and burning are the chief causes of particulate matter (PM2.5), a key measurement of air quality in communities and cities worldwide. This work develops a live fire tracking platform to show active reported fires from over twenty cities in the U.S., as well as predict their smoke paths and impacts on the air quality of regions within their range. Specifically, our close to real-time tracking and predictions culminates in a digital twin to protect public health and inform the public of fire and air quality risk. This tool tracks fire incidents in real-time, utilizes the 3D building footprints of Austin to simulate smoke outputs, and predicts fire incident smoke falloffs within the complex city environment. Results from this study include a complete fire and smoke digital twin model for Austin. We work in cooperation with the City of Austin Fire Department to ensure the accuracy of our forecast and also show that air quality sensor density within our cities cannot validate urban fire presence. We additionally release code and methodology to replicate these results for any city in the world. This work paves the path for similar digital twin models to be developed and deployed to better protect the health and safety of citizens.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
Accurate Prediction of Global Mean Temperature through Data Transformation Techniques
Authors:
Debdarsan Niyogi,
J. Srinivasan
Abstract:
It is important to predict how the Global Mean Temperature (GMT) will evolve in the next few decades. The ability to predict historical data is a necessary first step toward the actual goal of making long-range forecasts. This paper examines the advantage of statistical and simpler Machine Learning (ML) methods instead of directly using complex ML algorithms and Deep Learning Neural Networks (DNN)…
▽ More
It is important to predict how the Global Mean Temperature (GMT) will evolve in the next few decades. The ability to predict historical data is a necessary first step toward the actual goal of making long-range forecasts. This paper examines the advantage of statistical and simpler Machine Learning (ML) methods instead of directly using complex ML algorithms and Deep Learning Neural Networks (DNN). Often neglected data transformation methods prior to applying different algorithms have been used as a means of improving predictive accuracy. The GMT time series is treated both as a univariate time series and also cast as a regression problem. Some steps of data transformations were found to be effective. Various simple ML methods did as well or better than the more well-known ones showing merit in trying a large bouquet of algorithms as a first step. Fifty-six algorithms were subject to Box-Cox, Yeo-Johnson, and first-order differencing and compared with the absence of them. Predictions for the annual GMT testing data were better than that published so far, with the lowest RMSE value of 0.02 $^\circ$C. RMSE for five-year mean GMT values for the test data ranged from 0.00002 to 0.00036 $^\circ$C.
△ Less
Submitted 11 March, 2023;
originally announced March 2023.
-
A Novel Method Combines Moving Fronts, Data Decomposition and Deep Learning to Forecast Intricate Time Series
Authors:
Debdarsan Niyogi
Abstract:
A univariate time series with high variability can pose a challenge even to Deep Neural Network (DNN). To overcome this, a univariate time series is decomposed into simpler constituent series, whose sum equals the original series. As demonstrated in this article, the conventional one-time decomposition technique suffers from a leak of information from the future, referred to as a data leak. In thi…
▽ More
A univariate time series with high variability can pose a challenge even to Deep Neural Network (DNN). To overcome this, a univariate time series is decomposed into simpler constituent series, whose sum equals the original series. As demonstrated in this article, the conventional one-time decomposition technique suffers from a leak of information from the future, referred to as a data leak. In this work, a novel Moving Front (MF) method is proposed to prevent data leakage, so that the decomposed series can be treated like other time series. Indian Summer Monsoon Rainfall (ISMR) is a very complex time series, which poses a challenge to DNN and is therefore selected as an example. From the many signal processing tools available, Empirical Wavelet Transform (EWT) was chosen for decomposing the ISMR into simpler constituent series, as it was found to be more effective than the other popular algorithm, Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN). The proposed MF method was used to generate the constituent leakage-free time series. Predictions and forecasts were made by state-of-the-art Long and Short-Term Memory (LSTM) network architecture, especially suitable for making predictions of sequential patterns. The constituent MF series has been divided into training, testing, and forecasting. It has been found that the model (EWT-MF-LSTM) developed here made exceptionally good train and test predictions, as well as Walk-Forward Validation (WFV), forecasts with Performance Parameter ($PP$) values of 0.99, 0.86, and 0.95, respectively, where $PP$ = 1.0 signifies perfect reproduction of the data.
△ Less
Submitted 11 March, 2023;
originally announced March 2023.
-
Urban precipitation downscaling using deep learning: a smart city application over Austin, Texas, USA
Authors:
Manmeet Singh,
Nachiketa Acharya,
Sajad Jamshidi,
Junfeng Jiao,
Zong-Liang Yang,
Marc Coudert,
Zach Baumer,
Dev Niyogi
Abstract:
Urban downscaling is a link to transfer the knowledge from coarser climate information to city scale assessments. These high-resolution assessments need multiyear climatology of past data and future projections, which are complex and computationally expensive to generate using traditional numerical weather prediction models. The city of Austin, Texas, USA has seen tremendous growth in the past dec…
▽ More
Urban downscaling is a link to transfer the knowledge from coarser climate information to city scale assessments. These high-resolution assessments need multiyear climatology of past data and future projections, which are complex and computationally expensive to generate using traditional numerical weather prediction models. The city of Austin, Texas, USA has seen tremendous growth in the past decade. Systematic planning for the future requires the availability of fine resolution city-scale datasets. In this study, we demonstrate a novel approach generating a general purpose operator using deep learning to perform urban downscaling. The algorithm employs an iterative super-resolution convolutional neural network (Iterative SRCNN) over the city of Austin, Texas, USA. We show the development of a high-resolution gridded precipitation product (300 m) from a coarse (10 km) satellite-based product (JAXA GsMAP). High resolution gridded datasets of precipitation offer insights into the spatial distribution of heavy to low precipitation events in the past. The algorithm shows improvement in the mean peak-signal-to-noise-ratio and mutual information to generate high resolution gridded product of size 300 m X 300 m relative to the cubic interpolation baseline. Our results have implications for developing high-resolution gridded-precipitation urban datasets and the future planning of smart cities for other cities and other climatic variables.
△ Less
Submitted 15 August, 2022;
originally announced September 2022.
-
Short-range forecasts of global precipitation using deep learning-augmented numerical weather prediction
Authors:
Manmeet Singh,
Vaisakh S B,
Nachiketa Acharya,
Aditya Grover,
Suryachandra A Rao,
Bipin Kumar,
Zong-Liang Yang,
Dev Niyogi
Abstract:
Precipitation governs Earth's hydroclimate, and its daily spatiotemporal fluctuations have major socioeconomic effects. Advances in Numerical weather prediction (NWP) have been measured by the improvement of forecasts for various physical fields such as temperature and pressure; however, large biases exist in precipitation prediction. We augment the output of the well-known NWP model CFSv2 with de…
▽ More
Precipitation governs Earth's hydroclimate, and its daily spatiotemporal fluctuations have major socioeconomic effects. Advances in Numerical weather prediction (NWP) have been measured by the improvement of forecasts for various physical fields such as temperature and pressure; however, large biases exist in precipitation prediction. We augment the output of the well-known NWP model CFSv2 with deep learning to create a hybrid model that improves short-range global precipitation at 1-, 2-, and 3-day lead times. To hybridise, we address the sphericity of the global data by using modified DLWP-CS architecture which transforms all the fields to cubed-sphere projection. Dynamical model precipitation and surface temperature outputs are fed into a modified DLWP-CS (UNET) to forecast ground truth precipitation. While CFSv2's average bias is +5 to +7 mm/day over land, the multivariate deep learning model decreases it to within -1 to +1 mm/day. Hurricane Katrina in 2005, Hurricane Ivan in 2004, China floods in 2010, India floods in 2005, and Myanmar storm Nargis in 2008 are used to confirm the substantial enhancement in the skill for the hybrid dynamical-deep learning model. CFSv2 typically shows a moderate to large bias in the spatial pattern and overestimates the precipitation at short-range time scales. The proposed deep learning augmented NWP model can address these biases and vastly improve the spatial pattern and magnitude of predicted precipitation. Deep learning enhanced CFSv2 reduces mean bias by 8x over important land regions for 1 day lead compared to CFSv2. The spatio-temporal deep learning system opens pathways to further the precision and accuracy in global short-range precipitation forecasts.
△ Less
Submitted 11 November, 2022; v1 submitted 23 June, 2022;
originally announced June 2022.
-
GLOBUS: GLObal Building heights for Urban Studies
Authors:
Harsh G. Kamath,
Manmeet Singh,
Lori A. Magruder,
Zong-Liang Yang,
Dev Niyogi
Abstract:
Urban weather and climate studies continue to be important as extreme events cause economic loss and impact public health. Weather models seek to represent urban areas but are oversimplified due to data availability, especially building information. This paper introduces a novel Level of Detail-1 (LoD-1) building dataset derived from a Deep Neural Network (DNN) called GLObal Building heights for U…
▽ More
Urban weather and climate studies continue to be important as extreme events cause economic loss and impact public health. Weather models seek to represent urban areas but are oversimplified due to data availability, especially building information. This paper introduces a novel Level of Detail-1 (LoD-1) building dataset derived from a Deep Neural Network (DNN) called GLObal Building heights for Urban Studies (GLOBUS). GLOBUS uses open-source datasets as predictors: Advanced Land Observation Satellite (ALOS) Digital Surface Model (DSM) normalized using Shuttle Radar Topography Mission (SRTM) Digital Elevation Model (DEM), Landscan population density, and building footprints. The building information from GLOBUS can be ingested in Numerical Weather Prediction (NWP) and urban energy-water balance models to study localized phenomena such as the Urban Heat Island (UHI) effect. GLOBUS has been trained and validated using the United States Geological Survey (USGS) 3DEP Light Detection and Ranging (LiDAR) data. We used data from 5 US cities for training and the model was validated over 6 cities. Performance metrics are computed at a spatial resolution of 300-meter. The Root Mean Squared Error (RMSE) and Mean Absolute Percentage Error (MAPE) were 5.15 meters and 28.8 %, respectively. The standard deviation and histogram of building heights over a 300-meter grid are well represented using GLOBUS.
△ Less
Submitted 24 May, 2022;
originally announced May 2022.
-
Deep learning for improved global precipitation in numerical weather prediction systems
Authors:
Manmeet Singh,
Bipin Kumar,
Suryachandra Rao,
Sukhpal Singh Gill,
Rajib Chattopadhyay,
Ravi S Nanjundiah,
Dev Niyogi
Abstract:
The formation of precipitation in state-of-the-art weather and climate models is an important process. The understanding of its relationship with other variables can lead to endless benefits, particularly for the world's monsoon regions dependent on rainfall as a support for livelihood. Various factors play a crucial role in the formation of rainfall, and those physical processes are leading to si…
▽ More
The formation of precipitation in state-of-the-art weather and climate models is an important process. The understanding of its relationship with other variables can lead to endless benefits, particularly for the world's monsoon regions dependent on rainfall as a support for livelihood. Various factors play a crucial role in the formation of rainfall, and those physical processes are leading to significant biases in the operational weather forecasts. We use the UNET architecture of a deep convolutional neural network with residual learning as a proof of concept to learn global data-driven models of precipitation. The models are trained on reanalysis datasets projected on the cubed-sphere projection to minimize errors due to spherical distortion. The results are compared with the operational dynamical model used by the India Meteorological Department. The theoretical deep learning-based model shows doubling of the grid point, as well as area averaged skill measured in Pearson correlation coefficients relative to operational system. This study is a proof-of-concept showing that residual learning-based UNET can unravel physical relationships to target precipitation, and those physical constraints can be used in the dynamical operational models towards improved precipitation forecasts. Our results pave the way for the development of online, hybrid models in the future.
△ Less
Submitted 24 August, 2021; v1 submitted 20 June, 2021;
originally announced June 2021.
-
Design and Deployment of Photo2Building: A Cloud-based Procedural Modeling Tool as a Service
Authors:
Manush Bhatt,
Rajesh Kalyanam,
Gen Nishida,
Liu He,
Christopher May,
Dev Niyogi,
Daniel Aliaga
Abstract:
We present a Photo2Building tool to create a plausible 3D model of a building from only a single photograph. Our tool is based on a prior desktop version which, as described in this paper, is converted into a client-server model, with job queuing, web-page support, and support of concurrent usage. The reported cloud-based web-accessible tool can reconstruct a building in 40 seconds on average and…
▽ More
We present a Photo2Building tool to create a plausible 3D model of a building from only a single photograph. Our tool is based on a prior desktop version which, as described in this paper, is converted into a client-server model, with job queuing, web-page support, and support of concurrent usage. The reported cloud-based web-accessible tool can reconstruct a building in 40 seconds on average and costing only 0.60 USD with current pricing. This provides for an extremely scalable and possibly widespread tool for creating building models for use in urban design and planning applications. With the growing impact of rapid urbanization on weather and climate and resource availability, access to such a service is expected to help a wide variety of users such as city planners, urban meteorologists worldwide in the quest to improved prediction of urban weather and designing climate-resilient cities of the future.
△ Less
Submitted 3 August, 2020;
originally announced August 2020.
