-
Blind Image Deconvolution Using Variational Deep Image Prior
Authors:
Dong Huo,
Abbas Masoumzadeh,
Rafsanjany Kushol,
Yee-Hong Yang
Abstract:
Conventional deconvolution methods utilize hand-crafted image priors to constrain the optimization. While deep-learning-based methods have simplified the optimization by end-to-end training, they fail to generalize well to blurs unseen in the training dataset. Thus, training image-specific models is important for higher generalization. Deep image prior (DIP) provides an approach to optimize the we…
▽ More
Conventional deconvolution methods utilize hand-crafted image priors to constrain the optimization. While deep-learning-based methods have simplified the optimization by end-to-end training, they fail to generalize well to blurs unseen in the training dataset. Thus, training image-specific models is important for higher generalization. Deep image prior (DIP) provides an approach to optimize the weights of a randomly initialized network with a single degraded image by maximum a posteriori (MAP), which shows that the architecture of a network can serve as the hand-crafted image prior. Different from the conventional hand-crafted image priors that are statistically obtained, it is hard to find a proper network architecture because the relationship between images and their corresponding network architectures is unclear. As a result, the network architecture cannot provide enough constraint for the latent sharp image. This paper proposes a new variational deep image prior (VDIP) for blind image deconvolution, which exploits additive hand-crafted image priors on latent sharp images and approximates a distribution for each pixel to avoid suboptimal solutions. Our mathematical analysis shows that the proposed method can better constrain the optimization. The experimental results further demonstrate that the generated images have better quality than that of the original DIP on benchmark datasets. The source code of our VDIP is available at https://github.com/Dong-Huo/VDIP-Deconvolution.
△ Less
Submitted 5 June, 2023; v1 submitted 31 January, 2022;
originally announced February 2022.
-
Blind Non-Uniform Motion Deblurring using Atrous Spatial Pyramid Deformable Convolution and Deblurring-Reblurring Consistency
Authors:
Dong Huo,
Abbas Masoumzadeh,
Yee-Hong Yang
Abstract:
Many deep learning based methods are designed to remove non-uniform (spatially variant) motion blur caused by object motion and camera shake without knowing the blur kernel. Some methods directly output the latent sharp image in one stage, while others utilize a multi-stage strategy (\eg multi-scale, multi-patch, or multi-temporal) to gradually restore the sharp image. However, these methods have…
▽ More
Many deep learning based methods are designed to remove non-uniform (spatially variant) motion blur caused by object motion and camera shake without knowing the blur kernel. Some methods directly output the latent sharp image in one stage, while others utilize a multi-stage strategy (\eg multi-scale, multi-patch, or multi-temporal) to gradually restore the sharp image. However, these methods have the following two main issues: 1) The computational cost of multi-stage is high; 2) The same convolution kernel is applied in different regions, which is not an ideal choice for non-uniform blur. Hence, non-uniform motion deblurring is still a challenging and open problem. In this paper, we propose a new architecture which consists of multiple Atrous Spatial Pyramid Deformable Convolution (ASPDC) modules to deblur an image end-to-end with more flexibility. Multiple ASPDC modules implicitly learn the pixel-specific motion with different dilation rates in the same layer to handle movements of different magnitude. To improve the training, we also propose a reblurring network to map the deblurred output back to the blurred input, which constrains the solution space. Our experimental results show that the proposed method outperforms state-of-the-art methods on the benchmark datasets. The code is available at https://github.com/Dong-Huo/ASPDC.
△ Less
Submitted 21 April, 2022; v1 submitted 27 June, 2021;
originally announced June 2021.
-
The Panacea Threat Intelligence and Active Defense Platform
Authors:
Adam Dalton,
Ehsan Aghaei,
Ehab Al-Shaer,
Archna Bhatia,
Esteban Castillo,
Zhuo Cheng,
Sreekar Dhaduvai,
Qi Duan,
Md Mazharul Islam,
Younes Karimi,
Amir Masoumzadeh,
Brodie Mather,
Sashank Santhanam,
Samira Shaikh,
Tomek Strzalkowski,
Bonnie J. Dorr
Abstract:
We describe Panacea, a system that supports natural language processing (NLP) components for active defenses against social engineering attacks. We deploy a pipeline of human language technology, including Ask and Framing Detection, Named Entity Recognition, Dialogue Engineering, and Stylometry. Panacea processes modern message formats through a plug-in architecture to accommodate innovative appro…
▽ More
We describe Panacea, a system that supports natural language processing (NLP) components for active defenses against social engineering attacks. We deploy a pipeline of human language technology, including Ask and Framing Detection, Named Entity Recognition, Dialogue Engineering, and Stylometry. Panacea processes modern message formats through a plug-in architecture to accommodate innovative approaches for message analysis, knowledge representation and dialogue generation. The novelty of the Panacea system is that uses NLP for cyber defense and engages the attacker using bots to elicit evidence to attribute to the attacker and to waste the attacker's time and resources.
△ Less
Submitted 20 April, 2020;
originally announced April 2020.
-
Network-Based Analysis of Public Transportation Systems in North American Cities
Authors:
Abbas Masoumzadeh,
Tilemachos Pechlivanoglou
Abstract:
A comprehensive data analysis system is implemented for the extraction of information and comparison of North American public transport systems. The system is based on network representations of the transport systems and makes use of a span of metrics and algorithms from the established properties in graph theory to complicated domain specific measurements. Due to nature of big data systems and th…
▽ More
A comprehensive data analysis system is implemented for the extraction of information and comparison of North American public transport systems. The system is based on network representations of the transport systems and makes use of a span of metrics and algorithms from the established properties in graph theory to complicated domain specific measurements. Due to nature of big data systems and the requirement of scalability, many heuristic optimizations and approximations have been considered in the system. Integration with other sources of data specially population density maps is also executed in the system. Formal evaluations are done on subcomponents of the system to make sure the approximations have reasonable precision. Results on comparison of four cities, San Francisco, Boston, Toronto and Los Angeles, approves that the big data approach to comparison of public transit systems can successfully reveal the underlying similarities and differences.
△ Less
Submitted 6 January, 2020;
originally announced January 2020.
-
Impact of Optimal Storage Allocation on Price Volatility in Electricity Markets
Authors:
Amin Masoumzadeh,
Ehsan Nekouei,
Tansu Alpcan,
Deb Chattopadhyay
Abstract:
Recent studies show that the fast growing expansion of wind power generation may lead to extremely high levels of price volatility in wholesale electricity markets. Storage technologies, regardless of their specific forms e.g. pump-storage hydro, large-scale or distributed batteries, are capable of alleviating the extreme price volatility levels due to their energy usage time shifting, fast-rampin…
▽ More
Recent studies show that the fast growing expansion of wind power generation may lead to extremely high levels of price volatility in wholesale electricity markets. Storage technologies, regardless of their specific forms e.g. pump-storage hydro, large-scale or distributed batteries, are capable of alleviating the extreme price volatility levels due to their energy usage time shifting, fast-ramping and price arbitrage capabilities. In this paper, we propose a stochastic bi-level optimization model to find the optimal nodal storage capacities required to achieve a certain price volatility level in a highly volatile electricity market. The decision on storage capacities is made in the upper level problem and the operation of strategic/regulated generation, storage and transmission players is modeled at the lower level problem using an extended Cournot-based stochastic game. The South Australia (SA) electricity market, which has recently experienced high levels of price volatility, is considered as the case study for the proposed storage allocation framework. Our numerical results indicate that 80% price volatility reduction in SA electricity market can be achieved by installing either 340 MWh regulated storage or 420 MWh strategic storage. In other words, regulated storage firms are more efficient in reducing the price volatility than strategic storage firms.
△ Less
Submitted 1 March, 2017;
originally announced March 2017.
