Search

The availability of continuous glucose monitors as over-the-counter commodities have created a unique opportunity to monitor a person's blood glucose levels, forecast blood glucose trajectories and provide automated interventions to prevent devastating chronic complications that arise from poor glucose control. However, forecasting blood glucose levels is challenging because blood glucose changes consistently in response to food intake, medication intake, physical activity, sleep, and stress. It is particularly difficult to accurately predict BGL from multimodal and irregularly sampled data and over long prediction horizons. Furthermore, these forecasting models must operate in real-time on edge devices to provide in-the-moment interventions. To address these challenges, we propose GlucoNet, an AI-powered sensor system for continuously monitoring behavioral and physiological health and robust forecasting of blood glucose patterns. GlucoNet devises a feature decomposition-based transformer model that incorporates patients' behavioral and physiological data and transforms sparse and irregular patient data (e.g., diet and medication intake data) into continuous features using a mathematical model, facilitating better integration with the BGL data. Given the non-linear and non-stationary nature of BG signals, we propose a decomposition method to extract both low and high-frequency components from the BGL signals, thus providing accurate forecasting. To reduce the computational complexity, we also propose to employ knowledge distillation to compress the transformer model. GlucoNet achieves a 60% improvement in RMSE and a 21% reduction in the number of parameters, using data obtained involving 12 participants with T1-Diabetes. These results underscore GlucoNet's potential as a compact and reliable tool for real-world diabetes prevention and management.

Metaheuristics are stochastic optimization algorithms that mimic natural processes to find optimal solutions to complex problems. The success of metaheuristics largely depends on the ability to effectively explore and exploit the search space. Memory mechanisms have been introduced in several popular metaheuristic algorithms to enhance their performance. This chapter explores the significance of memory in metaheuristic algorithms and provides insights from well-known algorithms. The chapter begins by introducing the concept of memory, and its role in metaheuristic algorithms. The key factors influencing the effectiveness of memory mechanisms are discussed, such as the size of the memory, the information stored in memory, and the rate of information decay. A comprehensive analysis of how memory mechanisms are incorporated into popular metaheuristic algorithms is presented and concludes by highlighting the importance of memory in metaheuristic performance and providing future research directions for improving memory mechanisms. The key takeaways are that memory mechanisms can significantly enhance the performance of metaheuristics by enabling them to explore and exploit the search space effectively and efficiently, and that the choice of memory mechanism should be tailored to the problem domain and the characteristics of the search space., Comment: 25 pages, 5 figures, book chapter, Springer

An improved bilinear fuzzy genetic algorithm (BFGA) is introduced in this chapter for the design optimization of steel structures with semi-rigid connections. Semi-rigid connections provide a compromise between the stiffness of fully rigid connections and the flexibility of fully pinned connections. However, designing such structures is challenging due to the nonlinear behavior of semi-rigid connections. The BFGA is a robust optimization method that combines the strengths of fuzzy logic and genetic algorithm to handle the complexity and uncertainties of structural design problems. The BFGA, compared to standard GA, demonstrated to generate high-quality solutions in a reasonable time. The application of the BFGA is demonstrated through the optimization of steel structures with semirigid connections, considering the weight and performance criteria. The results show that the proposed BFGA is capable of finding optimal designs that satisfy all the design requirements and constraints. The proposed approach provides a promising solution for the optimization of complex structures with nonlinear behavior., Comment: 19 pages, 12 figures, book chapter, Springer

Opposition-based learning (OBL) is an effective approach to improve the performance of metaheuristic optimization algorithms, which are commonly used for solving complex engineering problems. This chapter provides a comprehensive review of the literature on the use of opposition strategies in metaheuristic optimization algorithms, discussing the benefits and limitations of this approach. An overview of the opposition strategy concept, its various implementations, and its impact on the performance of metaheuristic algorithms are presented. Furthermore, case studies on the application of opposition strategies in engineering problems are provided, including the optimum locating of control systems in tall building. A shear frame with Magnetorheological (MR) fluid damper is considered as a case study. The results demonstrate that the incorporation of opposition strategies in metaheuristic algorithms significantly enhances the quality and speed of the optimization process. This chapter aims to provide a clear understanding of the opposition strategy in metaheuristic optimization algorithms and its engineering applications, with the ultimate goal of facilitating its adoption in real-world engineering problems., Comment: 17 pages, 4 figures, book chapter, Springer

Building deep reinforcement learning (RL) agents that find a good policy with few samples has proven notoriously challenging. To achieve sample efficiency, recent work has explored updating neural networks with large numbers of gradient steps for every new sample. While such high update-to-data (UTD) ratios have shown strong empirical performance, they also introduce instability to the training process. Previous approaches need to rely on periodic neural network parameter resets to address this instability, but restarting the training process is infeasible in many real-world applications and requires tuning the resetting interval. In this paper, we focus on one of the core difficulties of stable training with limited samples: the inability of learned value functions to generalize to unobserved on-policy actions. We mitigate this issue directly by augmenting the off-policy RL training process with a small amount of data generated from a learned world model. Our method, Model-Augmented Data for Temporal Difference learning (MAD-TD) uses small amounts of generated data to stabilize high UTD training and achieve competitive performance on the most challenging tasks in the DeepMind control suite. Our experiments further highlight the importance of employing a good model to generate data, MAD-TD's ability to combat value overestimation, and its practical stability gains for continued learning.

Existing 3D facial emotion modeling have been constrained by limited emotion classes and insufficient datasets. This paper introduces "Emo3D", an extensive "Text-Image-Expression dataset" spanning a wide spectrum of human emotions, each paired with images and 3D blendshapes. Leveraging Large Language Models (LLMs), we generate a diverse array of textual descriptions, facilitating the capture of a broad spectrum of emotional expressions. Using this unique dataset, we conduct a comprehensive evaluation of language-based models' fine-tuning and vision-language models like Contranstive Language Image Pretraining (CLIP) for 3D facial expression synthesis. We also introduce a new evaluation metric for this task to more directly measure the conveyed emotion. Our new evaluation metric, Emo3D, demonstrates its superiority over Mean Squared Error (MSE) metrics in assessing visual-text alignment and semantic richness in 3D facial expressions associated with human emotions. "Emo3D" has great applications in animation design, virtual reality, and emotional human-computer interaction., Comment: 11 pages, 10 figures

Critical Casimir forces emerge among particles or surfaces immersed in a near-critical fluid, with the sign of the force determined by surface properties and with its strength tunable by minute temperature changes. Here, we show how such forces can be used to trap a colloidal particle and levitate it above a substrate with a bull's-eye pattern consisting of a ring with surface properties opposite to the rest of the substrate. Using the Derjaguin approximation and mean-field calculations, we find a rich behavior of spherical colloids at such a patterned surface, including sedimentation towards the ring and levitation above the ring (ring levitation) or above the bull's-eye's center (point levitation). Within the Derjaguin approximation, we calculate a levitation diagram for point levitation showing the depth of the trapping potential and the height at which the colloid levitates, both depending on the pattern properties, the colloid size, and the solution temperature. Our calculations reveal that the parameter space associated with point levitation shrinks if the system is driven away from a critical point, while, surprisingly, the trapping force becomes stronger. We discuss the application of critical Casimir levitation for sorting colloids by size and for determining the thermodynamic distance to criticality. Our results show that critical Casimir forces provide rich opportunities for controlling the behavior of colloidal particles at patterned surfaces.

The Value Iteration (VI) algorithm is an iterative procedure to compute the value function of a Markov decision process, and is the basis of many reinforcement learning (RL) algorithms as well. As the error convergence rate of VI as a function of iteration $k$ is $O(\gamma^k)$, it is slow when the discount factor $\gamma$ is close to $1$. To accelerate the computation of the value function, we propose Deflated Dynamics Value Iteration (DDVI). DDVI uses matrix splitting and matrix deflation techniques to effectively remove (deflate) the top $s$ dominant eigen-structure of the transition matrix $\mathcal{P}^{\pi}$. We prove that this leads to a $\tilde{O}(\gamma^k |\lambda_{s+1}|^k)$ convergence rate, where $\lambda_{s+1}$is $(s+1)$-th largest eigenvalue of the dynamics matrix. We then extend DDVI to the RL setting and present Deflated Dynamics Temporal Difference (DDTD) algorithm. We empirically show the effectiveness of the proposed algorithms.

Long-horizon tasks, which have a large discount factor, pose a challenge for most conventional reinforcement learning (RL) algorithms. Algorithms such as Value Iteration and Temporal Difference (TD) learning have a slow convergence rate and become inefficient in these tasks. When the transition distributions are given, PID VI was recently introduced to accelerate the convergence of Value Iteration using ideas from control theory. Inspired by this, we introduce PID TD Learning and PID Q-Learning algorithms for the RL setting, in which only samples from the environment are available. We give a theoretical analysis of the convergence of PID TD Learning and its acceleration compared to the conventional TD Learning. We also introduce a method for adapting PID gains in the presence of noise and empirically verify its effectiveness.

We investigate the impact of auxiliary learning tasks such as observation reconstruction and latent self-prediction on the representation learning problem in reinforcement learning. We also study how they interact with distractions and observation functions in the MDP. We provide a theoretical analysis of the learning dynamics of observation reconstruction, latent self-prediction, and TD learning in the presence of distractions and observation functions under linear model assumptions. With this formalization, we are able to explain why latent-self prediction is a helpful \emph{auxiliary task}, while observation reconstruction can provide more useful features when used in isolation. Our empirical analysis shows that the insights obtained from our learning dynamics framework predicts the behavior of these loss functions beyond the linear model assumption in non-linear neural networks. This reinforces the usefulness of the linear model framework not only for theoretical analysis, but also practical benefit for applied problems.

Deep Neural Networks (DNNs) have advanced in many real-world applications, such as healthcare and autonomous driving. However, their high computational complexity and vulnerability to adversarial attacks are ongoing challenges. In this letter, approximate multipliers are used to explore DNN robustness improvement against adversarial attacks. By uniformly replacing accurate multipliers for state-of-the-art approximate ones in DNN layer models, we explore the DNNs robustness against various adversarial attacks in a feasible time. Results show up to 7% accuracy drop due to approximations when no attack is present while improving robust accuracy up to 10% when attacks applied.

We show that deep reinforcement learning algorithms can retain their ability to learn without resetting network parameters in settings where the number of gradient updates greatly exceeds the number of environment samples by combatting value function divergence. Under large update-to-data ratios, a recent study by Nikishin et al. (2022) suggested the emergence of a primacy bias, in which agents overfit early interactions and downplay later experience, impairing their ability to learn. In this work, we investigate the phenomena leading to the primacy bias. We inspect the early stages of training that were conjectured to cause the failure to learn and find that one fundamental challenge is a long-standing acquaintance: value function divergence. Overinflated Q-values are found not only on out-of-distribution but also in-distribution data and can be linked to overestimation on unseen action prediction propelled by optimizer momentum. We employ a simple unit-ball normalization that enables learning under large update ratios, show its efficacy on the widely used dm_control suite, and obtain strong performance on the challenging dog tasks, competitive with model-based approaches. Our results question, in parts, the prior explanation for sub-optimal learning due to overfitting early data., Comment: Accepted as a conference paper at the First Reinforcement Learning Conference (RLC)

Instantons present a deep insight into non-perturbative effects both in physics and mathematics. While leading instanton effects can be calculated simply as an exponent of the instanton action, the calculation of subleading contributions usually requires the spectrum of fluctuation operator on the instanton background and its Green's function, explicit knowledge of which is rare and a great success. Thus, we propose an inverse problem, namely, the reconstruction of the nonlinear action of the theory admitting instantons from the given fluctuation operator with a known Green's function. We constructively build the solution for this problem and apply it to a wide class of exactly solvable Schr\"{o}dinger operators, called shape-invariant operators, and its simpler subclass, namely reflectionless P\"{o}schl-Teller operators. In the latter case, we found that for the most values of parameters the reconstructed potentials are naturally defined not on the real line, but on some special multisheet covering of the complex plane, and discuss its physical interpretation. For the wider but less simple class of shape-invariant operators, we derive the set of parameters leading to the new infinite families of analytic potentials., Comment: 30+9 pages, 13 figures; comments are welcome

In this paper, $F(\nu)$ cosmology is proposed for the accelerating universe with asymptotic de Sitter expansion in terms of Hankel function index $\nu$. To some extent, both the initial expansion during early inflation and the current accelerated expansion can be studied with a vacuum cosmic fluid i.e. $\Lambda$ in the pure de Sitter phase. Observational data further support the notion of a quasi-vacuum fluid, rather than a pure vacuum, contributing to the quasi-de Sitter acceleration in both the early and late universe. By examining the asymptotic expansion of the Henkel function as an approximate solution of the Mukhanov-Sasaki equation, we seek a more detailed study of quasi-de Sitter solutions in cosmology containing vacuum-like fluid., Comment: 11 pages, 2 tables

Detecting faults in steel plates is crucial for ensuring the safety and reliability of the structures and industrial equipment. Early detection of faults can prevent further damage and costly repairs. This chapter aims at diagnosing and predicting the likelihood of steel plates developing faults using experimental text data. Various machine learning methods such as GWO-based and FDO-based MLP and CMLP are tested to classify steel plates as either faulty or non-faulty. The experiments produced promising results for all models, with similar accuracy and performance. However, the FDO-based MLP and CMLP models consistently achieved the best results, with 100% accuracy in all tested datasets. The other models' outcomes varied from one experiment to another. The findings indicate that models that employed the FDO as a learning algorithm had the potential to achieve higher accuracy with a little longer runtime compared to other algorithms. In conclusion, early detection of faults in steel plates is critical for maintaining safety and reliability, and machine learning techniques can help predict and diagnose these faults accurately., Comment: 19 pages

The manipulation of microscopic objects requires precise and controllable forces and torques. Recent advances have led to the use of critical Casimir forces as a powerful tool, which can be finely tuned through the temperature of the environment and the chemical properties of the involved objects. For example, these forces have been used to self-organize ensembles of particles and to counteract stiction caused by Casimir-Liftshitz forces. However, until now, the potential of critical Casimir torques has been largely unexplored. Here, we demonstrate that critical Casimir torques can efficiently control the alignment of microscopic objects on nanopatterned substrates. We show experimentally and corroborate with theoretical calculations and Monte Carlo simulations that circular patterns on a substrate can stabilize the position and orientation of microscopic disks. By making the patterns elliptical, such microdisks can be subject to a torque which flips them upright while simultaneously allowing for more accurate control of the microdisk position. More complex patterns can selectively trap 2D-chiral particles and generate particle motion similar to non-equilibrium Brownian ratchets. These findings provide new opportunities for nanotechnological applications requiring precise positioning and orientation of microscopic objects.

Neural networks are susceptible to adversarial perturbations that are transferable across different models. In this paper, we introduce a novel model alignment technique aimed at improving a given source model's ability in generating transferable adversarial perturbations. During the alignment process, the parameters of the source model are fine-tuned to minimize an alignment loss. This loss measures the divergence in the predictions between the source model and another, independently trained model, referred to as the witness model. To understand the effect of model alignment, we conduct a geometric analysis of the resulting changes in the loss landscape. Extensive experiments on the ImageNet dataset, using a variety of model architectures, demonstrate that perturbations generated from aligned source models exhibit significantly higher transferability than those from the original source model., Comment: Accepted at the European Conference on Computer Vision (ECCV) 2024. Code: https://github.com/averyma/model-alignment

Stochastic gradient descent (SGD) and adaptive gradient methods, such as Adam and RMSProp, have been widely used in training deep neural networks. We empirically show that while the difference between the standard generalization performance of models trained using these methods is small, those trained using SGD exhibit far greater robustness under input perturbations. Notably, our investigation demonstrates the presence of irrelevant frequencies in natural datasets, where alterations do not affect models' generalization performance. However, models trained with adaptive methods show sensitivity to these changes, suggesting that their use of irrelevant frequencies can lead to solutions sensitive to perturbations. To better understand this difference, we study the learning dynamics of gradient descent (GD) and sign gradient descent (signGD) on a synthetic dataset that mirrors natural signals. With a three-dimensional input space, the models optimized with GD and signGD have standard risks close to zero but vary in their adversarial risks. Our result shows that linear models' robustness to $\ell_2$-norm bounded changes is inversely proportional to the model parameters' weight norm: a smaller weight norm implies better robustness. In the context of deep learning, our experiments show that SGD-trained neural networks show smaller Lipschitz constants, explaining the better robustness to input perturbations than those trained with adaptive gradient methods.

We design a novel algorithm for optimal transport by drawing from the entropic optimal transport, mirror descent and conjugate gradients literatures. Our scalable and GPU parallelizable algorithm is able to compute the Wasserstein distance with extreme precision, reaching relative error rates of $10^{-8}$ without numerical stability issues. Empirically, the algorithm converges to high precision solutions more quickly in terms of wall-clock time than a variety of algorithms including log-domain stabilized Sinkhorn's Algorithm. We provide careful ablations with respect to algorithm and problem parameters, and present benchmarking over upsampled MNIST images, comparing to various recent algorithms over high-dimensional problems. The results suggest that our algorithm can be a useful addition to the practitioner's optimal transport toolkit.

We consider the problem of learning models for risk-sensitive reinforcement learning. We theoretically demonstrate that proper value equivalence, a method of learning models which can be used to plan optimally in the risk-neutral setting, is not sufficient to plan optimally in the risk-sensitive setting. We leverage distributional reinforcement learning to introduce two new notions of model equivalence, one which is general and can be used to plan for any risk measure, but is intractable; and a practical variation which allows one to choose which risk measures they may plan optimally for. We demonstrate how our framework can be used to augment any model-free risk-sensitive algorithm, and provide both tabular and large-scale experiments to demonstrate its ability.

The idea of decision-aware model learning, that models should be accurate where it matters for decision-making, has gained prominence in model-based reinforcement learning. While promising theoretical results have been established, the empirical performance of algorithms leveraging a decision-aware loss has been lacking, especially in continuous control problems. In this paper, we present a study on the necessary components for decision-aware reinforcement learning models and we showcase design choices that enable well-performing algorithms. To this end, we provide a theoretical and empirical investigation into algorithmic ideas in the field. We highlight that empirical design decisions established in the MuZero line of works, most importantly the use of a latent model, are vital to achieving good performance for related algorithms. Furthermore, we show that the MuZero loss function is biased in stochastic environments and establish that this bias has practical consequences. Building on these findings, we present an overview of which decision-aware loss functions are best used in what empirical scenarios, providing actionable insights to practitioners in the field.

A modified robust model predictive control scheme for linear parametric variable (LPV) or hybrid systems is proposed based on a quasi-min-max algorithm. Using a new cost function reduced unwanted disturbances during switching. In addition, the effects of uncertainties are reduced in the prediction dynamics that guarantee robust stability of piecewise switching LPV systems subjected to linear matrix inequality (LMI) input constraints. Simulation results demonstrate the performance of the proposed controller compared to a prior research.

Haptic training simulators generally consist of three major components, namely a human operator, a haptic interface, and a virtual environment. Appropriate dynamic modeling of each of these components can have far-reaching implications for the whole system's performance improvement in terms of transparency, the analogy to the real environment, and stability. In this paper, we developed a virtual-based haptic training simulator for Endoscopic Sinus Surgery (ESS) by doing a dynamic characterization of the phenomenological sinus tissue fracture in the virtual environment, using an input-constrained linear parametric variable model. A parallel robot manipulator equipped with a calibrated force sensor is employed as a haptic interface. A lumped five-parameter single-degree-of-freedom mass-stiffness-damping impedance model is assigned to the operator's arm dynamic. A robust online output feedback quasi-min-max model predictive control (MPC) framework is proposed to stabilize the system during the switching between the piecewise linear dynamics of the virtual environment. The simulations and the experimental results demonstrate the effectiveness of the proposed control algorithm in terms of robustness and convergence to the desired impedance quantities.

With the ongoing development of Indoor Location-Based Services, the location information of users in indoor environments has been a challenging issue in recent years. Due to the widespread use of WiFi networks, WiFi fingerprinting has become one of the most practical methods of locating mobile users. In addition to localization accuracy, some other critical factors such as latency, and users' privacy should be considered in indoor localization systems. In this study, we propose a light Convolutional Neural Network-based method for edge devices (e.g. smartphones) to overcome the above issues by eliminating the need for a cloud/server in the localization system. The proposed method is evaluated for three different open datasets, i.e., UJIIndoorLoc, Tampere and UTSIndoorLoc, as well as for our collected dataset named SBUK-D to verify its scalability. We also evaluate performance efficiency of our localization method on an Android smartphone to demonstrate its applicability to edge devices. For UJIIndoorLoc dataset, our model obtains approximately 99% building accuracy, over 90% floor accuracy, and 9.5 m positioning mean error with the model size and inference time of 0.5 MB and 51 us, respectively, which demonstrate high accuracy in range of state of the art works as well as amenability to the resource-constrained edge devices.

Approximate computing (AC) has become a prominent solution to improve the performance, area, and power/energy efficiency of a digital design at the cost of output accuracy. We propose a novel scalable approximate multiplier that utilizes a lookup table-based compensation unit. To improve energy-efficiency, input operands are truncated to a reduced bitwidth representation (e.g., h bits) based on their leading one positions. Then, a curve-fitting method is employed to map the product term to a linear function, and a piecewise constant error-correction term is used to reduce the approximation error. For computing the piecewise constant error-compensation term, we partition the function space into M segments and compute the compensation factor for each segment by averaging the errors in the segment. The multiplier supports various degrees of truncation and error-compensation to exploit accuracy-efficiency trade-off. The proposed approximate multiplier offers better error metrics such as mean and standard deviation of absolute relative error (MARED and StdARED) compare to a state-of-the-art integer approximate multiplier. The proposed approximate multiplier improves the MARED and StdARED by about 38% and 32% when its energy consumption is about equal to the state-of-the-art approximate multiplier. Moreover, the performance of the proposed approximate multiplier is evaluated in image classification applications using a Deep Neural Network (DNN). The results indicate that the degradation of DNN accuracy is negligible especially due to the compensation properties of our approximate multiplier.

We introduce new planning and reinforcement learning algorithms for discounted MDPs that utilize an approximate model of the environment to accelerate the convergence of the value function. Inspired by the splitting approach in numerical linear algebra, we introduce Operator Splitting Value Iteration (OS-VI) for both Policy Evaluation and Control problems. OS-VI achieves a much faster convergence rate when the model is accurate enough. We also introduce a sample-based version of the algorithm called OS-Dyna. Unlike the traditional Dyna architecture, OS-Dyna still converges to the correct value function in presence of model approximation error., Comment: Accepted to NeurIPS2022

The ability to measure and track the speed and trajectory of a community's post-disaster recovery is essential to inform resource allocation and prioritization. The current survey-based approaches to examining community recovery, however, have significant lags and put the burden of data collection on affected people. Also, the existing literature lacks quantitative measures for important milestones to inform the assessment of recovery trajectory. Recognizing these gaps, this study uses location-based data related to visitation patterns and credit card transactions to specify critical recovery milestones related to population activity recovery. Using data from 2017 Hurricane Harvey in Harris County (Texas), the study specifies four critical post-disaster recovery milestones and calculates quantitative measurements of the length of time between the end of a hazard event and when the spatial areas (census tracts) reached these milestones based on fluctuations in visits to essential and non-essential facilities, and essential and non-essential credit card transactions. Accordingly, an integrated recovery metric is created for an overall measurement of each spatial area's recovery progression. Exploratory statistical analyses were conducted to examine whether variations in community recovery progression in achieving the critical milestones is correlated to its flood status, socioeconomic characteristics, and demographic composition. Finally, the extent of spatial inequality is examined. The results show the presence of moderate spatial inequality in population activity recovery in Hurricane Harvey, based upon which the inequality of recovery is measured. Results of this study can benefit post-disaster recovery resource allocation as well as improve community resilience towards future natural hazards.

Despite the criticality of dialysis facilities, limited knowledge exists regarding the extent and inequality of disrupted access caused by weather events. This study uses mobility data in the context of the 2017 Hurricane Harvey in Harris County to examine the impact of flooding on access to dialysis centers. We examined access dimensions using multiple static and dynamic metrics. By analyzing fluctuations in dynamic metrics during the flood event, we derived spatiotemporal patterns of access disruptions and inequity in mobility from CBGs to dialysis centers. The results show that: (1) the extent of dependence of CBGs on dialysis centers varies; (2) flooding significantly reduces access redundancy and frequency of dialysis center visits; access disruptions persist for more than one month after the flood event; (3) CBGs with a greater minority percentage and lower household income were more likely to experience more extensive access disruptions; (4) high-income CBGs more quickly revert to their pre-disaster levels; (5) larger dialysis centers located in non-flooded areas are critical to absorbing the unmet demand from disrupted facilities; these larger facilities contribute to the absorptive capacity of the network of dialysis facilities in the region.

The use of crowdsourced data has been finding practical use for enhancing situational awareness during disasters. While recent studies have shown promising results regarding the potential of crowdsourced data for flood mapping, little attention has been paid to data imbalances issues that could introduce biases. We examine biases present in crowdsourced reports to identify data imbalances with a goal of improving disaster situational awareness. Sample bias, spatial bias, and demographic bias are examined as we analyzed reported flooding from 3-1-1, Waze reports, and FEMA damage data collected in the aftermaths of Tropical Storm Imelda in 2019 and Hurricane Ida in 2021. Integrating other flooding related topics from 3-1-1 reports into the Global Moran's I and Local Indicator of Spatial Association (LISA) test revealed more communities that were impacted by floods. To examine spatial bias, we perform the LISA and BI-LISA tests on the three datasets at the census tract and census block group level. By looking at two geographical aggregations, we found that the larger spatial aggregations, census tracts, show less data imbalance in the results. Finally, one-way analysis of Variance (ANOVA) test performed on the clusters generated from the BI-LISA shows that data imbalance exists in areas where minority populations reside. Through a regression analysis, we found that 3-1-1 and Waze reports have data imbalance limitations in areas where minority populations reside. The findings of this study advance understanding of data imbalances and biases in crowdsourced datasets that are growingly used for disaster situational awareness., Comment: 28 Pages, 12 Figures 9 Tables

The objective of this study is to propose a system-level framework with quantitative measures to assess the resilience of road networks. The framework proposed in this paper can help transportation agencies incorporate resilience considerations into project development proactively and to understand the resilience performance of current road networks effectively. This study identified and implemented four quantitative metrics to classify the criticality of road segments based on critical dimensions of road network resilience, and two integrated metrics were proposed to combine all metrics to show the overall resilience performance of road segments. A case study was conducted on the Texas road networks to demonstrate the effectiveness of implementing this framework in a practical scenario. Since the data used in this study is available to other states and countries, the framework presented in this study can be adopted by other transportation agencies across the globe for regional transportation resilience assessments.

Model-based reinforcement learning (MBRL) is a sample efficient technique to obtain control policies, yet unavoidable modeling errors often lead performance deterioration. The model in MBRL is often solely fitted to reconstruct dynamics, state observations in particular, while the impact of model error on the policy is not captured by the training objective. This leads to a mismatch between the intended goal of MBRL, enabling good policy and value learning, and the target of the loss function employed in practice, future state prediction. Naive intuition would suggest that value-aware model learning would fix this problem and, indeed, several solutions to this objective mismatch problem have been proposed based on theoretical analysis. However, they tend to be inferior in practice to commonly used maximum likelihood (MLE) based approaches. In this paper we propose the Value-gradient weighted Model Learning (VaGraM), a novel method for value-aware model learning which improves the performance of MBRL in challenging settings, such as small model capacity and the presence of distracting state dimensions. We analyze both MLE and value-aware approaches and demonstrate how they fail to account for exploration and the behavior of function approximation when learning value-aware models and highlight the additional goals that must be met to stabilize optimization in the deep learning setting. We verify our analysis by showing that our loss function is able to achieve high returns on the Mujoco benchmark suite while being more robust than maximum likelihood based approaches.

Secure ultra-reliable low-latency communication (URLLC) has been recently investigated with the fundamental limits of finite block length (FBL) regime in mind. Analysis has revealed that when eavesdroppers outnumber BS antennas or enjoy a more favorable channel condition compared to the legitimate users, base station (BS) transmit power should increase exorbitantly to meet quality of service (QoS) constraints. Channel-induced impairments such as shadowing and/or blockage pose a similar challenge. These practical considerations can drastically limit secure URLLC performance in FBL regime. Deployment of an intelligent reflecting surface (IRS) can endow such systems with much-needed resiliency and robustness to satisfy stringent latency, availability, and reliability requirements. We address this problem and propose a joint design of IRS platform and secure URLLC network. We minimize the total BS transmit power by simultaneously designing the beamformers and artificial noise at the BS and phase-shifts at the IRS, while guaranteeing the required number of securely transmitted bits with the desired packet error probability, information leakage, and maximum affordable delay. The proposed optimization problem is non-convex and we apply block coordinate descent and successive convex approximation to iteratively solve a series of convex sub-problems instead. The proposed algorithm converges to a sub-optimal solution in a few iterations and attains substantial power saving and robustness compared to baseline schemes., Comment: Submitted to International Conference on Communications (ICC) 2022

Smart resilience is the beneficial result of the collision course of the fields of data science and urban resilience to flooding. The objective of this study is to propose and demonstrate a smart flood resilience framework that leverages heterogeneous community-scale big data and infrastructure sensor data to enhance predictive risk monitoring and situational awareness. The smart flood resilience framework focuses on four core capabilities that could be augmented by the use of heterogeneous community-scale big data and analytics techniques: (1) predictive flood risk mapping; (2) automated rapid impact assessment; (3) predictive infrastructure failure prediction and monitoring; and (4) smart situational awareness capabilities. We demonstrate the components of these core capabilities of the smart flood resilience framework in the context of the 2017 Hurricane Harvey in Harris County, Texas. First, we demonstrate the use of flood sensors for the prediction of floodwater overflow in channel networks and inundation of co-located road networks. Second, we discuss the use of social media and machine learning techniques for assessing the impacts of floods on communities and sensing emotion signals to examine societal impacts. Third, we illustrate the use of high-resolution traffic data in network-theoretic models for nowcasting of flood propagation on road networks and the disrupted access to critical facilities, such as hospitals. Fourth, we leverage location-based and credit card transaction data in spatial analyses to proactively evaluate the recovery of communities and the impacts of floods on businesses. These analyses show that the significance of core capabilities of the smart flood resilience framework in helping emergency managers, city planners, public officials, responders, and volunteers to better cope with the impacts of catastrophic flooding events., Comment: 24 pages, 22 figures

The objective of this study is to develop and test a novel structured deep-learning modeling framework for urban flood nowcasting by integrating physics-based and human-sensed features. We present a new computational modeling framework including an attention-based spatial-temporal graph convolution network (ASTGCN) model and different streams of data that are collected in real-time, preprocessed, and fed into the model to consider spatial and temporal information and dependencies that improve flood nowcasting. The novelty of the computational modeling framework is threefold; first, the model is capable of considering spatial and temporal dependencies in inundation propagation thanks to the spatial and temporal graph convolutional modules; second, it enables capturing the influence of heterogeneous temporal data streams that can signal flooding status, including physics-based features such as rainfall intensity and water elevation, and human-sensed data such as flood reports and fluctuations of human activity. Third, its attention mechanism enables the model to direct its focus on the most influential features that vary dynamically. We show the application of the modeling framework in the context of Harris County, Texas, as the case study and Hurricane Harvey as the flood event. Results indicate that the model provides superior performance for the nowcasting of urban flood inundation at the census tract level, with a precision of 0.808 and a recall of 0.891, which shows the model performs better compared with some other novel models. Moreover, ASTGCN model performance improves when heterogeneous dynamic features are added into the model that solely relies on physics-based features, which demonstrates the promise of using heterogenous human-sensed data for flood nowcasting

While volume-based grid tariffs have been the norm for residential consumers, capacity-based tariffs will become more relevant with the increasing electrification of society. A further development is capacity subscription, where consumers are financially penalised for exceeding their subscribed capacity, or alternatively their demand is limited to the subscribed level. The penalty or limitation can either be static (always active) or dynamic, meaning that it is only activated when there are active grid constraints. We investigate the cost impact for static and dynamic capacity subscription tariffs, for 84 consumers based on six years of historical load data. We use several approaches for finding the optimal subscription level ex ante. The results show that annual costs remain both stable and similar for most consumers, with a few exceptions for those that have high peak demand. In the case of a physical limitation, it is important to use a stochastic approach for the optimal subscription level to avoid excessive demand limitations. Facing increased peak loads due to electrification, regulators should consider a move to capacity-based tariffs in order to reduce cross-subsidisation between consumers and increase cost reflectivity without impacting the DSO cost recovery.

In many areas, such as the physical sciences, life sciences, and finance, control approaches are used to achieve a desired goal in complex dynamical systems governed by differential equations. In this work we formulate the problem of controlling stochastic partial differential equations (SPDE) as a reinforcement learning problem. We present a learning-based, distributed control approach for online control of a system of SPDEs with high dimensional state-action space using deep deterministic policy gradient method. We tested the performance of our method on the problem of controlling the stochastic Burgers' equation, describing a turbulent fluid flow in an infinitely large domain.

The authors provide a comprehensive overview of flexibility characterization along the dimensions of time, spatiality, resource, and risk in power systems. These dimensions are discussed in relation to flexibility assets, products, and services, as well as new and existing flexibility market designs. The authors argue that flexibility should be evaluated based on the dimensions under discussion. Flexibility products and services can increase the efficiency of power systems and markets if flexibility assets and related services are taken into consideration and used along the time, geography, technology, and risk dimensions. Although it is possible to evaluate flexibility in existing market designs, a local flexibility market may be needed to exploit the value of the flexibility, depending on the dimensions of the flexibility products and services. To locate flexibility in power grids and prevent incorrect valuations, the authors also discuss TSO-DSO coordination along the four dimensions, and they present interrelations between flexibility dimensions, products, services, and related market designs for productive usage of flexible electricity., Comment: This paper was sent to the Renewable & Sustainable Energy Reviews at August 2021. It is currently under review

The objective of this study is to predict road flooding risks based on topographic, hydrologic, and temporal precipitation features using machine learning models. Predictive flood monitoring of road network flooding status plays an essential role in community hazard mitigation, preparedness, and response activities. Existing studies related to the estimation of road inundations either lack observed road inundation data for model validations or focus mainly on road inundation exposure assessment based on flood maps. This study addresses this limitation by using crowdsourced and fine-grained traffic data as an indicator of road inundation, and topographic, hydrologic, and temporal precipitation features as predictor variables. Two tree-based machine learning models (random forest and AdaBoost) were then tested and trained for predicting road inundations in the contexts of 2017 Hurricane Harvey and 2019 Tropical Storm Imelda in Harris County, Texas. The findings from Hurricane Harvey indicate that precipitation is the most important feature for predicting road inundation susceptibility, and that topographic features are more essential than hydrologic features for predicting road inundations in both storm cases. The random forest and AdaBoost models had relatively high AUC scores (0.860 and 0.810 for Harvey respectively and 0.790 and 0.720 for Imelda respectively) with the random forest model performing better in both cases. The random forest model showed stable performance for Harvey, while varying significantly for Imelda. This study advances the emerging field of smart flood resilience in terms of predictive flood risk mapping at the road level. For example, such models could help impacted communities and emergency management agencies develop better preparedness and response strategies with improved situational awareness of road inundation likelihood as an extreme weather event unfolds., Comment: 17 pages, 7 figures

Performance-based optimization of energy dissipation devices in structures necessitates massive and repetitive dynamic analyses. In the endurance time method known as a rather fast dynamic analysis procedure, structures are subjected to intensifying dynamic excitations and their response at multiple intensity levels is estimated by a minimal number of analyses. So, this method significantly reduces computational endeavors. In this paper, the endurance time method is employed to determine the optimal placement of viscous dampers in a weak structure to achieve the desired performance at various hazard levels, simultaneously. The viscous damper is one of the energy dissipation systems which can dissipate a large amount of seismic input energy to the structure. To this end, hysteretic energy compatible endurance time excitation functions are used and the validity of the results is investigated by comparing them with the results obtained from a suite of ground motions. To optimize the placement of the dampers, the genetic algorithm is used. The damping coefficients of the dampers are considered as design variables in the optimization procedure and determined in such a way that the sum of them has a minimum value. The behavior of the weak structure before and after rehabilitation is also investigated using endurance time and nonlinear time history analysis procedures in different hazard levels., Comment: This article has been fully published in NMCE journal

Heat-Bath Algorithmic Cooling techniques (HBAC) are techniques that are used to purify a target element in a quantum system. These methods compress and transfer entropy away from the target element into auxiliary elements of the system. The performance of Algorithmic Cooling has been investigated under ideal noiseless conditions. However, realistic implementations are imperfect and for practical purposes, noise should be taken into account. Here we analyze Heat-Bath Algorithmic Cooling techniques under realistic noise models. Surprisingly, we find that noise can in some cases enhance the performance and improve the cooling limit of Heat-Bath Algorithmic Cooling techniques. We numerically simulate the noisy algorithmic cooling for the two optimal strategies, the Partner Pairing, and the Two-sort algorithms. We find that for both of them, in the presence of the generalized amplitude damping noise, the process converges and the asymptotic purity can be higher than the noiseless process. This opens up new avenues for increasing the purity beyond the heat-bath algorithmic cooling.

Various methods have been presented to improve the performance of buildings against earthquakes. Friction damper device is one of the energy dissipation devices that appropriately absorbs and dissipates the input energy and decreases displacements. In this paper, the possibility of using endurance time method to determine the efficiency index and optimum slip load for these dampers was investigated by comparing the results of endurance time and nonlinear time history analyses. The efficiency indexes acquired from the average of results for nonlinear time history and endurance time analyses were close to each other. In this research, by assuming identical optimum slip load for the dampers in all stories, the normalized damper strength was increased in a number of equal steps ranging from zero to one to determine the efficiency index of dampers in each step. Then, the optimum slip load of dampers in the steel frames was calculated according to the minimum efficiency index of dampers. As a result, employing the endurance time method instead of a high number of nonlinear time history analyses is also possible, and using the endurance time method diminishes 57% of computational endeavors. Lastly, a relation for acquiring the optimum slip load of the friction damper devices in steel structures was proposed in terms of the weight of the structures. After adding optimal FDDs to the structures and investigating the effectiveness of the dampers, it was concluded that by using endurance time excitation function with better energy consistency, the endurance time results could be improved.

We present algebraic semantics for the classical logic of proofs based on Boolean algebras. We also extend the language of the logic of proofs in order to have a Boolean structure on justification terms and equality predicate on terms. In the end, the completeness theorem and certain generalizations of Stone's representation theorem are obtained for all proposed algebras., Comment: 28 pages

We construct certain integral structures for the cores of reduced tame extended affine Lie algebras of rank at least 2. One of the main tools to achieve this is a generalization of Chevalley automorphisms in the context of extended affine Lie algebras. As an application, groups of extended affine Lie type associated to the adjoint representation are defined over arbitrary fields., Comment: 45 pages

Approximate computing is an emerging paradigm to improve the power and performance efficiency of error-resilient applications. As adders are one of the key components in almost all processing systems, a significant amount of research has been carried out towards designing approximate adders that can offer better efficiency than conventional designs, however, at the cost of some accuracy loss. In this paper, we highlight a new class of energy-efficient approximate adders, namely Heterogeneous Block-based Approximate Adders (HBAA), and propose a generic configurable adder model that can be configured to represent a particular HBAA configuration. An HBAA, in general, is composed of heterogeneous sub-adder blocks of equal length, where each sub-adder can be an approximate sub-adder and have a different configuration. The sub-adders are mainly approximated through inexact logic and carry truncation. Compared to the existing design space, HBAAs provide additional design points that fall on the Pareto-front and offer a better quality-efficiency trade-off in certain scenarios. Furthermore, to enable efficient design space exploration based on user-defined constraints, we propose an analytical model to efficiently evaluate the Probability Mass Function (PMF) of approximation error and other error metrics, such as Mean Error Distance (MED), Normalized Mean Error Distance (NMED) and Error Rate (ER) of HBAAs. The results show that HBAA configurations can provide around 15% reduction in area and up to 17% reduction in energy compared to state-of-the-art approximate adders., Comment: Accepted for publication in ACM Transactions on Embedded Computing Systems (TECS)

In this work, we investigate how flexible assets within a residential building influence the long-term impact of operation. We use a measured-peak grid tariff (MPGT) that puts a cost on the highest single-hour peak import over the month. We apply a mathematical model of a Home Energy Management System (HEMS) together with Stochastic Dynamic Programming (SDP), which calculates the long-term impact of operating as a non-linear expected future cost curve (EFCC) from the end of the scheduling period to the start. The proposed model is applied to a case study for a Norwegian building with smart control of a battery energy storage system (BESS), Electric vehicle (EV) charging and space heating (SH). Each of the flexible assets are investigated individually with MPGT and for an energy-based grid tariff. The results showed that EV charging has the highest peak-power impact in the system, decreasing the total electricity cost by 14.6% with MPGT when controllable compared to a reference case with passive charging. It is further shown how the EFCC helps achieve optimal timing and level of the peak demand, where it co-optimizes both real-time pricing and the MPGT., Comment: This paper was sent to the International Journal of Electrical Power & Energy Systems early February 2021. Currently under review

In this paper, we introduce an application of a high-performance MultiPeriod AC Optimal Power Flow (MPOPF) solver, called "BATTPOWER", to simulate active distribution grids for a near-future scenario. A large-scale Norwegian distribution grid along with a large population of Electric Vehicles (EV) are here taken as the case-study. We suggest and analyse three operational strategies (in terms of control of charge scheduling fleet of EV) for the Distribution System Operator (DSO): (a) uncoordinated/dumb charge scheduling, (b) coordinated charge scheduling with the objective of energy cost-minimisation without operational constraints of the grid, and (c) coordinated charge scheduling with the objective of energy cost-minimisation along with the operational constraints of the grid. The results demonstrate that the uncoordinated charging would lead to: 1) overloading of lines and transformers when the share of EVs is above 20%, and 2) higher operational costs than the proposed control strategies of (b) and (c). In strategy (b) operational line/transformer limits are violated when the populations of EVs are growing above 36%. This implies that current market design must be altered to allow active control of a large proportion of DERs within grid operational limits to achieve cost minimization at system level. To our knowledge, the work presented in this paper is the first ever attempt to do a comprehensive analysis of the impact of EV charging demand on a real Norwegian distribution grid. Moreover, the inference of the analysis says that the Norwegian distribution networks are more prone to congestion problems than the voltage problems for the EV demand which includes a smart charging scheme accounting for grid conditions., Comment: Preprint submitted to Electric Power Systems Research (EPSR)

With the introduction of massive renewable energy sources and storage devices, the traditional process of grid operation must be improved in order to be safe, reliable, fast responsive and cost efficient, and in this regard power flow solvers are indispensable. In this paper, we introduce an Interior Point-based (IP) Multi-Period AC Optimal Power Flow (MPOPF) solver for the integration of Stationary Energy Storage Systems (SESS) and Electric Vehicles (EV). The primary methodology is based on: 1) analytic and exact calculation of partial differential equations of the Lagrangian sub-problem, and 2) exploiting the sparse structure and pattern of the coefficient matrix of Newton-Raphson approach in the IP algorithm. Extensive results of the application of proposed methods on several benchmark test systems are presented and elaborated, where the advantages and disadvantages of different existing algorithms for the solution of MPOPF, from the standpoint of computational efficiency, are brought forward. We compare the computational performance of the proposed Schur-Complement algorithm with a direct sparse LU solver. The comparison is performed for two different applicational purposes: SESS and EV. The results suggest the substantial computational performance of Schur-Complement algorithm in comparison with that of a direct LU solver when the number of storage devices and optimisation horizon increase for both cases of SESS and EV. Also, some situations where computational performance is inferior are discussed., Comment: 24 pages, 15 figures, Accepted for publication in IEEE Transactions on Power Systems

Reinforcement Learning (RL) agents typically learn memoryless policies---policies that only consider the last observation when selecting actions. Learning memoryless policies is efficient and optimal in fully observable environments. However, some form of memory is necessary when RL agents are faced with partial observability. In this paper, we study a lightweight approach to tackle partial observability in RL. We provide the agent with an external memory and additional actions to control what, if anything, is written to the memory. At every step, the current memory state is part of the agent's observation, and the agent selects a tuple of actions: one action that modifies the environment and another that modifies the memory. When the external memory is sufficiently expressive, optimal memoryless policies yield globally optimal solutions. Unfortunately, previous attempts to use external memory in the form of binary memory have produced poor results in practice. Here, we investigate alternative forms of memory in support of learning effective memoryless policies. Our novel forms of memory outperform binary and LSTM-based memory in well-established partially observable domains.

Scheduling a residential building short-term to optimize the electricity bill can be difficult with the inclusion of capacity-based grid tariffs. Scheduling the building based on a proposed measured-peak (MP) grid tariff, which is a cost based on the highest peak power over a period, requires the user to consider the impact the current decision-making has in the future. Therefore, the authors propose a mathematical model using stochastic dynamic programming (SDP) that tries to represent the long-term impact of current decision-making. The SDP algorithm calculates non-linear expected future cost curves (EFCC) for the building based on the peak power backwards for each day over a month. The uncertainty in load demand and weather are considered using a discrete Markov chain setup. The model is applied to a case study for a Norwegian building with smart control of flexible loads, and compared against methods where the MP grid tariff is not accurately represented, and where the user has perfect information of the whole month. The results showed that the SDP algorithm performs 0.3 % better than a scenario with no accurate way of presenting future impacts, and performs 3.6 % worse compared to a scenario where the user had perfect information., Comment: Presented at the 16th International Conference on Probabilistic Methods Applied to Power Systems 2020 (PMAPS 2020) August 19th. Awarded the Roy Billinton Student Paper Gold Award

A multiple antenna base station (BS) with an intelligent reflecting surface (IRS) platform, and several single antenna users are considered in the downlink mode. Simultaneous wireless information and power transfer (SWIPT) is utilized by the BS via transmit beamforming to convey information and power to all devices. Each device applies power splitting (PS) to dedicate separate parts of received power to information decoding and energy harvesting. We formulate a total transmit power minimization problem to jointly design the BS beamforming vectors, IRS phase shifts, and PS ratios at the receivers subject to minimum rate and harvested energy quality of service (QoS) constraints at all the receivers. First, we develop a block coordinate descent algorithm, also known as alternating optimization that can decrease the objective function with every iteration with guaranteed convergence. Afterwards, two low-complexity sub-optimal algorithms that rely on well-known maximum ratio transmission and zero-forcing beamforming techniques are introduced. These algorithms are beneficial when the number of BS antennas and/or number of users are large, or coherence times of channels are small. Simulations corroborate the expectation that by deploying a passive IRS, BS power can be reduced by $10-20$ dBw while maintaining similar guaranteed QoS. Furthermore, even the proposed sub-optimal algorithms outperform the globally optimal SWIPT solution without IRS for a modest number of IRS elements.