Search

Internet of Things (IoTs) is a promising technology that combines communication and data networking. Integration of Smart Grids (SGs) and IoT will fulfill an increased demand for energy requirements by transforming the reliable and efficient traditional power grids. The SG enables bi-directional transmission between the Service Provider (SP) and Smart Meter (SM) to send and receive information regarding electricity consumption over a public channel. The public channel allows an adversary to intercept the information exchanged between them and tamper with the SM as it is installed outside which leads to forging or modification of the messages and privacy violation. In addition, the SM has limited computational and storage capacity. To protect SM privacy and securely communicate in the SG network, Physically Unclonable Functions (PUFs) based Authentication and Key Agreement (AKA) schemes were suggested in the literature. However, they may suffer from the machine learning modeling attack and several other security issues. Thus, we propose a finite state machine enabled controlled PUF based AKA (PF-AKA) Framework for the IoT based SG (IoT-SG) network. The PF-AKA framework is verified formally using the Real-or-Random (RoR) model, AVISPA tool, and BAN logic. It shows that PF-AKA achieves the security requirements along with protection from the SM physical and modeling attacks. The performance analysis is carried out and it represents that the PF-AKA yields competitive computation and communication costs compared to AKA schemes in the literature for the IoT-SG network. [ABSTRACT FROM AUTHOR]

This paper presents a comprehensive and comparative study of solar energy forecasting in Morocco, utilizing four machine learning algorithms: Extreme Gradient Boosting (XGBoost), Gradient Boosting Machine (GBM), recurrent neural networks (RNNs), and artificial neural networks (ANNs). The study is conducted using a smart metering device designed for a photovoltaic system at an industrial site in Benguerir, Morocco. The smart metering device collects energy usage data from a submeter and transmits it to the cloud via an ESP-32 card, enhancing monitoring, efficiency, and energy utilization. Our methodology includes an analysis of solar resources, considering factors such as location, temperature, and irradiance levels, with PVSYST simulation software version 7.2, employed to evaluate system performance under varying conditions. Additionally, a data logger is developed to monitor solar panel energy production, securely storing data in the cloud while accurately measuring key parameters and transmitting them using reliable communication protocols. An intuitive web interface is also created for data visualization and analysis. The research demonstrates a holistic approach to smart metering devices for photovoltaic systems, contributing to sustainable energy utilization, smart grid development, and environmental conservation in Morocco. The performance analysis indicates that ANNs are the most effective predictive model for solar energy forecasting in similar scenarios, demonstrating the lowest RMSE and MAE values, along with the highest R2 value. [ABSTRACT FROM AUTHOR]

The major component of the smart grid (SG) is the advanced metering infrastructure (AMI), which monitors and controls the existing power system and provides interactive services for invoicing and electricity usage management with the utility. Including a cyber-layer in the metering system allows two-way communication but creates a new opportunity for energy theft, resulting in significant monetary loss. This article proposes an approach to detecting abnormal consumption patterns using energy metering data based on the ensemble technique AdaBoost, a boosting algorithm. Different statistical and descriptive features are retrieved from metering data samples, which account for extreme conditions. The model is trained for malicious and non-malicious data for five different attack scenarios, which are analyzed on the Irish Social Science Data Archive (ISSDA) smart meter dataset. In contrast to prior supervised techniques, it works well even with unbalanced data. The efficacy of the proposed theft detection method has been evaluated by comparing the accuracy, precision, recall, and F1 score with the other well-known approaches in the literature. [ABSTRACT FROM AUTHOR]

With the surge in population growth, the demand for electricity has escalated, necessitating efficient solutions to enhance the reliability and security of electrical systems. Smart grids, functioning as self-sufficient systems, offer a promising avenue by facilitating bi-directional communication between producers and consumers. Ensuring the stability and predictability of smart grid operations is paramount to evaluating their efficacy and usability. Machine learning emerges as a crucial tool for decision-making amidst fluctuating consumer demand and power supplies, thereby bolstering the stability and reliability of smart grids. This study explores the performance of various machine learning classifiers in predicting the stability of smart grid systems. Utilizing a smart grid dataset obtained from the University of California's machine learning repository, classifiers such as logistic regression (LR), XGBoost, linear support vector machine (Linear SVM), and SVM with radial basis function (SVM-RBF) were evaluated. Evaluation metrics, including accuracy, precision, recall, and F1 score, were employed to assess classifier performance. The results demonstrate high accuracy across all models, with the Deep Neural Network (DNN) model achieving the highest accuracy of 99.5%. Additionally, LR, linear SVM, and SVM-RBF exhibited comparable accuracy levels of 98.9%, highlighting their efficacy in smart grid stability prediction. These findings underscore the utility of machine learning techniques in enhancing the reliability and efficiency of smart grid systems. [ABSTRACT FROM AUTHOR]

This review paper is a foundational resource for power distribution and management decisions, thoroughly examining short-term load forecasting (STLF) models within power systems. The study categorizes these models into three groups: statistical approaches, intelligent-computing-based methods, and hybrid models. Performance indicators are compared, revealing the superiority of heuristic search and population-based optimization learning algorithms integrated with artificial neural networks (ANNs) for STLF. However, challenges persist in ANN models, particularly in weight initialization and susceptibility to local minima. The investigation underscores the necessity for sophisticated predictive models to enhance forecasting accuracy, advocating for the efficacy of hybrid models incorporating multiple predictive approaches. Acknowledging the changing landscape, the focus shifts to STLF in smart grids, exploring the transformative potential of advanced power networks. Smart measurement devices and storage systems are pivotal in boosting STLF accuracy, enabling more efficient energy management and resource allocation in evolving smart grid technologies. In summary, this review provides a comprehensive analysis of contemporary predictive models and suggests that ANNs and hybrid models could be the most suitable methods to attain reliable and accurate STLF. However, further research is required, including considerations of network complexity, improved training techniques, convergence rates, and highly correlated inputs to enhance STLF model performance in modern power systems. [ABSTRACT FROM AUTHOR]

Water Scarcity is a very severe problem across the world, one of the main factors is improper distribution of water and careless use of water by people, this is only going to be more severe in future as population and needs of the world rises. Many countries have increased deployment of smart water meters to monitor water usage and tried convincing people to not use water in a careless manner but have not been successful yet. This research paper presents the development and implementation of a smart water meter (SWM) prototype for household water consumption measurement. The SWM utilizes Wi-Fi or Long Range (LoRa) technology to transmit data and is integrated with Citizen Id (SSN) to centralize water distribution, and help detect water theft. Additionally, the meter incorporates SARIMA forecasting to predict water consumption based on past usage trends on the edge. The water consumption data can be accessed through a web and Android application, and an integrated billing system has been developed to provide users with information about their current water usage. The machine learning model was trained and tested on the water consumption dataset by DAIAD. The DAIAD dataset consists of hourly water consumption time series for 1,007 randomly selected consumers from the AMAEM (Association of Energy and Water Management) utility in Alicante, Spain, spanning from January 2015 to May 2017, totaling 16,857,056 measurements. The whole system was tested by installing it in a house and the forecasting model achieved an accuracy of 74%. [ABSTRACT FROM AUTHOR]

Using recent information and communication technologies for monitoring and management initiates a revolution in the smart grid. These technologies generate massive data that can only be processed using big data tools. This paper emphasizes the role of big data in resolving load forecasting, renewable energy sources integration, and demand response as significant aspects of smart grids. Meters data from the Low Carbon London Project is investigated as a case study. Because of the immense stream of meters' readings and exogenous data added to load forecasting models, addressing the problem is in the context of big data. Descriptive analytics are developed using Spark SQL to get insights regarding household energy consumption. Spark MLlib is utilized for predictive analytics by building scalable machine learning models accommodating meters' data streams. Multivariate polynomial regression and decision tree models are preferred here based on the big data point of view and the literature that ensures they are accurate and interpretable. The results confirmed the descriptive analytics and data visualization capabilities to provide valuable insights, guide the feature selection process, and enhance load forecasting models' accuracy. Accordingly, proper evaluation of demand response programs and integration of renewable energy resources is accomplished using achieved load forecasting results. [ABSTRACT FROM AUTHOR]

Non-intrusive load monitoring (NILM) has emerged as a pivotal technology in energy management applications by enabling precise monitoring of individual appliance energy consumption without the requirements of intrusive sensors or smart meters. In this technique, the load disaggregation for the individual device is accrued by the recognition of their current signals by employing machine learning (ML) methods. This research paper conducts a comprehensive comparative analysis of various ML techniques applied to NILM, aiming to identify the most effective methodologies for accurate load disaggregation. The study employs a diverse dataset comprising high-resolution electricity consumption data collected from an Estonian household. The ML algorithms, including deep neural networks based on long short-term memory networks (LSTM), extreme gradient boost (XgBoost), logistic regression (LR), and dynamic time warping with K-nearest neighbor (DTW-KNN) are implemented and evaluated for their performance in load disaggregation. Key evaluation metrics such as accuracy, precision, recall, and F1 score are utilized to assess the effectiveness of each technique in capturing the nuanced energy consumption patterns of diverse appliances. Results indicate that the XgBoost-based model demonstrates superior performance in accurately identifying and disaggregating individual loads from aggregated energy consumption data. Insights derived from this research contribute to the optimization of NILM techniques for real-world applications, facilitating enhanced energy efficiency and informed decision-making in smart grid environments. [ABSTRACT FROM AUTHOR]

Electricity theft (ET), which endangers public safety, interferes with the regular operation of grid infrastructure, and increases revenue losses, is a significant issue for power companies. To find ET, numerous machine learning, deep learning, and mathematically based algorithms have been published in the literature. However, these models do not yield the greatest results due to issues like the dimensionality curse, class imbalance, inappropriate hyper‐parameter tuning of machine learning, deep learning models etc. A hybrid DL model is presented for effectively detecting electricity thieves in smart grids while considering the abovementioned concerns. Pre‐processing techniques are first employed to clean up the data from the smart meters, and then the feature extraction technique, AlexNet is used to address the curse of dimensionality. An actual dataset of Chinese smart meters is used in simulations to assess the efficacy of the suggested approach. To conduct a comparative analysis, various benchmark models are implemented as well. This proposed model achieves accuracy, precision, recall, and F1‐score, up to 86%, 89%, 86%, and 84%, respectively. [ABSTRACT FROM AUTHOR]

The growing availability of smart meter data has facilitated the development of energy-saving services like demand response, personalized energy feedback, and non-intrusive-load-monitoring applications, all of which heavily rely on advanced machine learning algorithms trained on energy consumption datasets. To ensure the accuracy and reliability of these services, real-world smart meter data collection is crucial. The Plegma dataset described in this paper addresses this need bfy providing whole- house aggregate loads and appliance-level consumption measurements at 10-second intervals from 13 different households over a period of one year. It also includes environmental data such as humidity and temperature, building characteristics, demographic information, and user practice routines to enable quantitative as well as qualitative analysis. Plegma is the first high-frequency electricity measurements dataset in Greece, capturing the consumption behavior of people in the Mediterranean area who use devices not commonly included in other datasets, such as AC and electric-water boilers. The dataset comprises 218 million readings from 88 installed meters and sensors. The collected data are available in CSV format. [ABSTRACT FROM AUTHOR]

The digitization of distribution power systems has revolutionized the way data are collected and analyzed. In this paper, the critical task of harnessing this information to identify irregularities and anomalies in electricity consumption is tackled. The focus is on detecting non-technical losses (NTLs) and energy theft within distribution networks. A comprehensive overview of the methodologies employed to uncover NTLs and energy theft is presented, leveraging measurements of electricity consumption. The most common scenarios and prevalent cases of anomalies and theft among consumers are identified. Additionally, statistical indicators tailored to specific anomalies are proposed. In this research paper, the practical implementation of numerous artificial intelligence (AI) algorithms, including the artificial neural network (ANN), ANFIS, autoencoder neural network, and K-mean clustering, is highlighted. These algorithms play a central role in our research, and our primary objective is to showcase their effectiveness in identifying NTLs. Real-world data sourced directly from distribution networks are utilized. Additionally, we carefully assess how well statistical methods work and compare them to AI techniques by testing them with real data. The artificial neural network (ANN) accurately identifies various consumer types, exhibiting a frequency error of 7.62%. In contrast, the K-means algorithm shows a slightly higher frequency error of 9.26%, while the adaptive neuro-fuzzy inference system (ANFIS) fails to detect the initial anomaly type, resulting in a frequency error of 11.11%. Our research suggests that AI can make finding irregularities in electricity consumption even more effective. This approach, especially when using data from smart meters, can help us discover problems and safeguard distribution networks. [ABSTRACT FROM AUTHOR]

Electrical load forecasting remains an ongoing challenge due to various factors, such as temperature and weather, which change day by day. In this age of Big Data, efficient handling of data and obtaining valuable information from raw data is crucial. Through the use of IoT devices and smart meters, we can capture data efficiently, whereas traditional methods may struggle with data management. The proposed solution consists of two levels for forecasting. The selected subsets of data are first fed into the "Daily Consumption Electrical Networks" (DCEN) network, which provides valid input to the "Intra Load Forecasting Networks" (ILFN) network. To address overfitting issues, we use classic or conventional neural networks. This research employs a three-tier architecture, which includes the cloud layer, fog layer, and edge servers. The classical state-of-the-art prediction schemes usually employ a two-tier architecture with classical models, which can result in low learning precision and overfitting issues. The proposed approach uses more weather features that were not previously utilized to predict the load. In this study, numerous experiments were conducted and found that support vector regression outperformed other methods. The results obtained were 5.055 for mean absolute percentage error (MAPE), 0.69 for root mean square error (RMSE), 0.37 for normalized mean square error (NRMSE), 0.0072 for mean squared logarithmic error (MSLE), and 0.86 for R2 score values. The experimental findings demonstrate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

The power system has undergone significant growth and faced considerable challenges in recent decades, marked by the surge in energy demand and advancements in smart grid technologies, including solar and wind energies, as well as the widespread adoption of electric vehicles. These developments have introduced a level of complexity for utilities, compounded by the rapid expansion of behind-the-meter (BTM) photovoltaic (PV) systems, each with its own unique design and characteristics, thereby impacting power grid stability and reliability. In response to these intricate challenges, this research focused on the development of a robust forecasting model for load generation. This precision forecasting is crucial for optimal planning, mitigating the adverse effects of PV systems, and reducing operational and maintenance costs. By addressing these key aspects, the goal is to enhance the overall resilience and efficiency of the power grid amidst the evolving landscape of energy and technological advancements. The authors propose a solution leveraging LSTM (long short-term memory) model for a forecasting horizon up to 168 hours. This approach incorporates combinations of K-means clustering, automated meter infrastructure (AMI) real-world PV load generation, weather data, and calculated solar positions to forecast the generation load at customer locations to achieve a 5.7% mean absolute error between the actual and the predicted generation load. [ABSTRACT FROM AUTHOR]

Electric power systems face heightened risks from climate change, on top of existing challenges like aging infrastructure, regulatory shifts, and cybersecurity threats. This paper explores how advanced technologies, including smart grids, artificial intelligence (AI), and machine learning, (ML), enhance the resilience of power systems against climate-driven extreme weather events. Drawing insights from resilience theory, the paper presents a state-of-the-art review of the literature on power system resilience, highlighting the escalating vulnerabilities of energy systems to weather-related disruptions. Although utilities currently use technologies like automated meter reading and advanced metering infrastructure to collect vital grid performance data, the lack of strategic collaboration often impedes effective data governance and sharing, thus undermining efficient responses to climate threats. The paper underscores the significance of distributed energy resources, long-duration energy storage, microgrids, and demand-side management. It further illustrates how AI and ML optimize smart grids to support these strategies. Proactive integration of smart grids with advanced technologies could significantly reduce climate-related costs compared to non-adaptive methods. Such proactive grid resilience strategies not only climate-proof energy infrastructure against climatic changes but also herald a modern, placed-based industrial transformation. Climate change exacerbates challenges in our energy systems, from aging infrastructure and a constantly shifting regulatory environment to cybersecurity risks and diversifying energy portfolios. Addressing these issues requires strategic investment in modern infrastructure, particularly smart grids enhanced by advanced technologies like artificial intelligence (AI) and machine learning (ML). These technologies are vital for enhancing power system resilience against climate impacts. Automated systems such as automated meter infrastructure (AMI) and supervisory control and data acquisition (SCADA) provide real-time data crucial for managing extreme weather events. AI and ML contribute to predictive maintenance, preventing failures and blackouts. They also forecast grid loads during severe weather, facilitating proactive power distribution management to prevent blackouts. This comprehensive improvement in situational awareness promotes economic growth in the energy sector and supports sustainable, climate-resilient transformation. AI and ML not only improve energy distribution and efficiency but also promote conservation efforts and ensure reliable energy amidst a changing climate. Collaboration among utility managers, regulators, and governments is key, focusing on data access, verification, and adaptability. Strategies should be tailored to each utility's unique challenges. Moreover, establishing technical standards is critical for enhancing power grid resilience against climate-induced extreme weather events. [ABSTRACT FROM AUTHOR]

In Internet of Things-based smart grids, smart meters record and report a massive number of power consumption data at certain intervals to the data center of the utility for load monitoring and energy management. Energy theft is a big problem for smart meters and causes non-technical losses. Energy theft attacks can be launched by malicious consumers by compromising the smart meters to report manipulated consumption data for less billing. It is a global issue causing technical and financial damage to governments and operators. Deep learning-based techniques can effectively identify consumers involved in energy theft through power consumption data. In this study, a hybrid convolutional neural network (CNN)-based energy-theft-detection system is proposed to detect data-tampering cyber-attack vectors. CNN is a commonly employed method that automates the extraction of features and the classification process. We employed CNN for feature extraction and traditional machine learning algorithms for classification. In this work, honest data were obtained from a real dataset. Six attack vectors causing data tampering were utilized. Tampered data were synthetically generated through these attack vectors. Six separate datasets were created for each attack vector to design a specialized detector tailored for that specific attack. Additionally, a dataset containing all attack vectors was also generated for the purpose of designing a general detector. Furthermore, the imbalanced dataset problem was addressed through the application of the generative adversarial network (GAN) method. GAN was chosen due to its ability to generate new data closely resembling real data, and its application in this field has not been extensively explored. The data generated with GAN ensured better training for the hybrid CNN-based detector on honest and malicious consumption patterns. Finally, the results indicate that the proposed general detector could classify both honest and malicious users with satisfactory accuracy. [ABSTRACT FROM AUTHOR]

The increasing demand for electricity in daily life highlights the need for Smart Cities (SC) to use energy efficiently. Both technical and Non‐Technical Losses (NTL), particularly those resulting from electricity theft, present powerful obstacles; NTL alone can reach billions of dollars. Although Machine Learning (ML) based approaches for NTL detection have been embraced by numerous utilities, there is still a lack of thorough analysis of these methods. Limited research exists on NTL identification evaluation criteria and unbalanced data management in the context of SC. This research compares ML algorithms and data balancing methods to optimize electricity consumption detection. The given research applied the 15 ML techniques of Logistic regression, Bernoulli naive Bayes, Gaussian naive Bayes, K‐Nearest Neighbour, perceptron, passive‐aggressive classifier, quadratic discriminant analysis, SGD classifier, ridge classifier, linear discriminant analysis, decision tree, nearest centroid classifier, multi‐nomial naive Bayes, complement naive Bayes and dummy classifier. While SMOTE, AdaSyn, NRAS, and CCR are considered for data balancing. AUC, F1‐score, and seven relevant performance metrics were used for comparison. We have also implemented SHapely Additive exPlanations (SHAP) for feature importance and model interpretation. Results show varying classifier performance with different balancing methods, emphasizing data preprocessing's role in NTL detection for smart grid security. [ABSTRACT FROM AUTHOR]

Demand side management (DSM) is widely utilized in smart grid for its reliable features, flexibility, and cost benefits that it offers to customers on reduction of the energy bill. In the smart grid, demand response aggregator, power customers, and utility operator all strive to increase their individual profits. However, it is extremely challenging to guarantee profits for all of the candidates simultaneously. In this paper, these criteria are employed to execute a problem with multiple objectives by combining the concept of DSM and dynamic economic emission dispatch considering uncertainties of renewable energy sources (RESs). The uncertainties of RESs can bring adverse effects on the grid operator. Thus, Weibull probability distribution function and lognormal probability distribution function are used to model the uncertainties of wind speed and solar irradiation, respectively, in this paper. Further, the multi-objective improved DSM scheme is optimized by Class Topper optimization algorithm. The objective here is to optimally schedule load demand and generation pattern simultaneously to improve load factor, minimize electricity bill and maximize the profits of all candidates of the day-ahead electricity market simultaneously. Error in the load forecasting model may lead to growing operational cost of energy generation. In this paper, a machine learning model using linear regression is used for short-term load forecasting (STLF) to forecast day-ahead load demand. The simulation results show the importance of the improved DSM scheme and the advantage of STLF, which further help to improve the economy and efficiency of the smart grid. [ABSTRACT FROM AUTHOR]

A smart grid is a modern power system that allows for bidirectional communication, driven mostly by the idea of demand responsiveness. Predicting the stability of the smart grid is necessary for improving its dependability and maximizing the efficacy and regularity of electricity delivery. Predicting smart grid stability is difficult owing to the various elements that impact it, including consumer and producer engagement, which may contribute to smart grid stability. This research work proposes machine learning (ML) and deep learning (DL) approaches for predicting smart grid sustainability. Five ML algorithms, namely support vector machine (SVM), decision tree (DT), K-nearest neighbor (KNN), random forest (RF), and logistic regression (LR), were applied for the prediction of smart grid stability. Later, the stacking ensemble and voting ensemble of ML algorithms were also applied for prediction. To further increase accuracy, a novel fusion model with DL artifical neural networks (ANN) and ML SVM was applied and achieved an accuracy of 98.92%. The experiment results show that the proposed model outperformed existing models for smart grid stability prediction. [ABSTRACT FROM AUTHOR]

Modern solutions for precise fault localisation in Low Voltage (LV) Distribution Networks (DNs) often rely on costly tools such as the micro-Phasor Measurement Unit (μ PMU), which is potentially impractical for the large number of nodes in LVDNs. This paper introduces a novel fault detection technique using a distribution network digital twin without the use of μ PMUs. The Digital Twin (DT) integrates data from Smart Meters (SMs) and network topology to create an accurate replica. In using SM voltage-magnitude readings, the pre-built twin compiles a database of fault scenarios and matches them with their unique voltage fingerprints. However, this SM-based voltage-only approach shows only a 70.7% accuracy in classifying fault type and location. Therefore, this research suggests using the cables' Currents Symmetrical Component (CSC). Since SMs do not provide direct current data, a Machine Learning (ML)-based regression method is proposed to estimate the cables' currents in the DT. Validation is performed on a 41-node LV distribution feeder in the Scottish network provided by the industry partner Scottish Power Energy Networks (SPEN). The results show that the current estimation regressor significantly improves fault localisation and identification accuracy to 95.77%. This validates the crucial role of a DT in distribution networks, thus enabling highly accurate fault detection when using SM voltage-only data, with further refinements being conducted through estimations of CSC. The proposed DT offers automated fault detection, thus enhancing customer connectivity and maintenance team dispatch efficiency without the need for additional expensive μ PMU on a densely-noded distribution network. [ABSTRACT FROM AUTHOR]

With the development of smart grid and energy Internet, more and more smart sensing devices are installed and used in the power system, thus forming the advanced metering infrastructure (AMI). It makes the power system generate massive data all the time, which may come from smart meters, digital protection devices and so on. Behavior evaluation is to filter out the selected tags that meet the type of user portrait from the user system through the known partial tags, and these similar tags together determine the user's behavior. How to make good use of the collected power big data is an important research topic in the field of power system. Using data mining technology to analyze power big data is a common research method to deal with power big data problems. To facilitate the staff to quickly understand the characteristics of the user, save service costs, improve user service satisfaction, and find the weak links of the power grid, this paper introduces the random forest algorithm, further researches on the basis of user portraits, combines database technology, machine learning algorithm and Logistics algorithm appropriately, constructs the user data sampling model based on big data, fully excavates the big data information of users and predicts the behavior of power users. According to the results of the forecast, it helps the power enterprises to correct and improve the relevant measures in the future. Experiments show that compared with the traditional Logistics model, the K-S value is increased by about 65.38%. The Gini coefficient is increased by about 12.60%, and the efficiency of the algorithm is improved by 5.26%. It has great advantages in stability and generalization. It has a better effect on power data sampling and forecasting, and helps power enterprises to improve market evaluation and corporate reputation. [ABSTRACT FROM AUTHOR]

Smart Grids (SG) encompass the utilization of large-scale data, advanced communication infrastructure, and enhanced efficiency in the management of electricity demand, distribution, and productivity through the application of machine learning techniques. The utilization of machine learning facilitates the creation and implementation of proactive and automated decision-making methods for smart grids. In this paper, we provide an experimental study to understand the power demands of consumers (domestic and commercial) in SGs. The power demand source is considered a smart plug reading dataset. This dataset is large dataset and consists of more than 850 user plug readings. From the dataset, we have extracted two different user data. Additionally, their hourly, daily, weekly, and monthly power demand is analysed individually. Next, these power demand patterns are utilized as a time series problem and the data is transformed into 5 neighbour problems to predict the next hour, day, week, and month power demand. To learn from the transformed data, Artificial Neural Network (ANN) and Linear Regression (LR) ML algorithms are used. According to the conducted experiments, we found that ANN provides more accurate prediction than LR Additionally, we observe that the prediction of hourly demand is more accurate than the prediction of daily, weekly, and monthly demand. Additionally, the prediction of each kind of pattern needs an individually refined model for performing with better accuracy. [ABSTRACT FROM AUTHOR]

With the development of smart meters and other intelligent electronic devices, more and more data‐driven fault location methods based on wide area measurement are emerging. However, these diagnostic methods for dealing with the whole tested system often appear complex. This paper presents an innovative subsystems‐based fault location strategy in distribution grid by the sparsity promoted Bayesian learning algorithm. To avoid taking measurement for the whole distribution system, the fault‐included subsystem is selected according to the distribution characteristics of negative sequence voltage. Then the data for fault location is measured by allocating meters in subsystem, which can reduce the number of required meters. For accurately estimating the fault location, a sparse prior is proposed for the Bayesian learning, which could improve the accuracy of the fault location algorithm by about 4%. The performance is tested on a 12.66‐kV, 69‐bus distribution system in response to various fault scenarios. The results show that the accuracy of the proposed method for the fault section location can reach 90%. It also verifies the robustness and accuracy for fault line location, faced different fault types, fault resistance, noise, etc. [ABSTRACT FROM AUTHOR]

Energy theft is a significant problem that needs to be addressed for effective energy management in smart cities. Smart meters are highly utilized in smart cities that help in monitoring the energy utilization level and provide information to the users. However, it is not able to detect energy theft or over-usage. Therefore, we have proposed a multi-objective diagnosing structure named an Energy Theft Prevention System (ETPS) to detect energy theft. The proposed system utilizes a combination of machine learning techniques Gated Recurrent Unit (GRU), Grey Wolf Optimization (GWO), Deep Recurrent Convolutional Neural Network (DDRCNN), and Long Short-Term Memory (LSTM). The statistical validation has been performed using the simple moving average (SMA) method. The results obtained from the simulation have been compared with the existing technique in terms of delivery ratio, throughput, delay, overhead, energy conversation, and network lifetime. The result shows that the proposed system is more effective than existing systems. [ABSTRACT FROM AUTHOR]

Electricity theft is a primary concern for utility providers, as it leads to substantial financial losses. To address the issue, a novel extreme gradient boosting (XGBoost)‐based model utilizing the consumers' electricity consumption patterns for analysis is proposed for electricity theft detection (ETD). To remove the imbalance in the real‐world electricity consumption dataset and ensure an even distribution of theft and non‐theft data instances, six different artificially created theft attacks were used. Moreover, the utilization of the XGBoost algorithm for classification, especially to identify malicious instances of electricity theft, yielded commendable accuracy rates and a minimal occurrence of false positives. The proposed model identifies electricity theft specific to the regions, utilizing electricity consumption parameters, and other variables as input features. The authors' model outperformed existing benchmarks like k‐neural networks, light gradient boost, random forest, support vector machine, decision tree, and AdaBoost. The simulation results using the false attacks for balancing the dataset have improved the proposed model's performance, achieving a precision, recall, and F1‐score of 96%, 95%, and 95%, respectively. The results of the detection rate and the false positive rate (FPR) of the proposed XGBoost‐based detection model have achieved 96% and 3%, respectively. [ABSTRACT FROM AUTHOR]

This paper proposes and implements a smart architecture for Home Energy Management Systems (HEMS) that enables interoperability among devices from different manufacturers. This is achieved through the use of standardized elements and the design of an innovative middleware. The system comprises a control unit that communicates with smart outlets using the Wireless Smart Ubiquitous Network (WI-SUN) Home Area Network (HAN) specification, while smart metering is achieved using the WI-SUN Field Area Network (FAN) specification. To manage important data, a web platform and mobile app were created. Additionally, machine learning techniques are utilized to identify energy consumption of individual appliances when only the aggregate energy consumption of the house is available. The architecture presented here supports real-time control of energy use and generation through HEMS, and new devices can be added transparently. Finally, a comparison of the proposed system with similar systems in literature highlights its many advantages in terms of functionality. [ABSTRACT FROM AUTHOR]

Smart microgrids are being increasingly deployed within the Department of Defense. The microgrid at Marine Corps Air Station (MCAS) Miramar is one such deployment that has fostered the integration of different technologies, including 5G and Advanced Metering Infrastructure (AMI). The objective of this paper is to develop an anomaly detection framework for the smart microgrid system at MCAS Miramar to enhance its cyber-resilience. We implement predictive analytics using machine learning to deal with cyber-uncertainties and threats within the microgrid environment. An autoencoder neural network is implemented to classify and identify specific cyber-attacks against this infrastructure. Both network traffic in the form of packet captures (PCAP) and time series data (from the AMI sensors) are considered. We train the autoencoder model on three traffic data sets: (1) Modbus TCP/IP PCAP data from the hardwired network apparatus of the smart microgrid, (2) experimentally generated 5G PCAP data that mimic traffic on the smart microgrid and (3) AMI smart meter sensor data provided by the Naval Facilities (NAVFAC) Engineering Systems Command. Distributed denial-of-service (DDoS) and false data injection attacks (FDIA) are synthetically generated. We show the effectiveness of the autoencoder on detecting and classifying these types of attacks in terms of accuracy, precision, recall, and F-scores. [ABSTRACT FROM AUTHOR]

In the smart grid, malicious consumers can hack their smart meters to report false power consumption readings to steal electricity. Developing a machine-learning based detector for identifying these readings is a challenge due to the unavailability of malicious datasets. Most of the existing works in the literature assume attacks to compute malicious data. These detectors are trained to identify these attacks, but they cannot identify new attacks, which creates a vulnerability. Very few papers in the literature tried to address this problem by investigating anomaly detectors trained solely on benign data, but they suffer from these limitations: (1) low detection accuracy and high false alarm; (2) the need for knowledge on the malicious data to compute good detection thresholds; and (3) they cannot capture the temporal correlations of the readings and do not address the class overlapping issue caused by some deceptive attacks. To address these limitations, this paper presents a deep support vector data description (DSVDD) based unsupervised detector for false data in smart grid. Time-series readings are transformed into images, and the detector is exclusively trained on benign images. Our experimental results demonstrate the superior performance of our detectors compared to existing approaches in the literature. Specifically, our proposed DSVDD-based schemes have exhibited improvements of 0.5% to 3% in terms of recall and 3% to 9% in terms of the Area Under the Curve (AUC) when compared to existing state-of-the-art detectors. [ABSTRACT FROM AUTHOR]

In Smart Energy Grids, the information flow used to make decisions is the result of fusion of different sources. Communication latency, possible sensor faults and inaccuracies, may negatively impact the data quality and hence the taken decisions. For these reasons, the construction of a robust representation of the input signals that replaces and/or corrects the inaccurate data is crucial for effective classification, anomaly detection and planning. Recent works on Data Fusion and data imputation suggest that the usage of other signals in the same context can empower the representation and can be a useful preprocessing task. In this work we describe an Autoencoder-based data fusion architecture with convolutional layers, skip connections and ad-hoc augmented training sets for data imputation applied to the power consumption measurements obtained by different sub-meters. Among the investigated architectures, the approach with the shared convolutional layers and an augmented dataset that consider missing data in the random positions and located in the central part (AE-A-ALL-CNN), is the most promising one. In presence of one half of the input signal, in the central part, completely erased, it improves the imputation capability, respect to two most employed approaches (denoising autoencoder and MICE) in the average of 12 %. [ABSTRACT FROM AUTHOR]

Today, the Internet of Things (IoT) has an important role for deploying power and energy management in the smart grids as emerging trend for managing power stability and consumption. In the IoT, smart grids has important role for managing power communication systems with safe data transformation using artificial intelligent approaches such as Machine Learning (ML), evolutionary computation and meta-heuristic algorithms. One of important issues to manage renewable energy consumption is intelligent aggregation of information based on smart metering and detecting the user behaviors for power and electricity consumption in the IoT. To achieve optimal performance for detecting this information, a context-aware prediction system is needed that can apply a resource management effectively for the renewable energy consumption for smart grids in the IoT. Also, prediction results from machine learning methods can be useful to manage optimal solutions for power generation activities, power transformation, smart metering at home and load balancing in smart grid networks. This paper aims to design a new periodical detecting, managing, allocating and analyzing useful information regarding potential renewable power and energy consumptions using a context-aware prediction approach and optimization-based machine learning method to overcome the problem. In the proposed architecture, a decision tree algorithm is provided to predict the grouped information based on important and high-ranked existing features. For evaluating the proposed architecture, some other well-known machine learning methods are compared to the evaluation results. Consequently, after analyzing various components by solving different smart grids datasets, the proposed architecture's capacity and supremacy are well determined among its traditional approaches. [ABSTRACT FROM AUTHOR]

The demand response program is an important feature of the smart grid. It attempts to reduce peak demand, improve the smart grid efficiency, and ensure system reliability. Implementing demand-response programs in residential and commercial buildings requires the use of smart meters and smart plugs. In this paper, we propose an architecture for a home-energy-management system based on the fog-computing paradigm, an Internet-of-Things-enabled smart plug, and a smart meter. The smart plug measures in real-time the root mean square (RMS) value of the current, frequency, power factor, active power, and reactive power. These readings are subsequently transmitted to the smart meter through the Zigbee network. Tiny machine learning algorithms are used at the smart meter to identify appliances automatically. The smart meter and smart plug were prototyped by using Raspberry Pi and Arduino, respectively. The smart plug's accuracy was quantified by comparing it to laboratory measurements. To assess the speed and precision of the small machine learning algorithm, a publicly accessible dataset was utilized. The obtained results indicate that the accuracy of both the smart meter and the smart plug exceeds 97% and 99%, respectively. The execution of the trained decision tree and support vector machine algorithms was verified on the Raspberry Pi 3 Model B Rev 1.2, operating at a clock speed of 600 MHz. The measured latency for the decision tree classifier's inference was 1.59 microseconds. In a practical situation, the time-of-use-based demand-response program can reduce the power cost by about 30%. [ABSTRACT FROM AUTHOR]

The performance and stability of the electric network are improved through smart grid technologies. The smart grid strongly rely on digital communication technologies creates security issues that must be addressed to distribute power efficiently and safely. For billing, load balancing, and energy management, the customer‐side smart meter regularly transmits the consumption reading to the system operator. However, dishonest customers created cyberattacks by entering fictitious readings of their electrical consumption in order to steal electricity for financial benefit. The distributed monitoring meter‐based network concept is utilized in this paper to closely monitor the losses. A two‐stage clustering‐based technique has also been suggested for the purpose of detecting theft. The approach can be detect the customer ID having abnormality in consumption pattern. To verify the effectiveness of the suggested strategy, numerical experiments on two datasets of smart meters have been conducted and four different types of attack patterns have been constructed. Simulation results show that the proposed scheme is very effective for detecting various types of attack patterns. In addition, the paper helps to predict how much power and financial loss the company will suffer as a result of multiple attacks. [ABSTRACT FROM AUTHOR]

Demand-response programs can help utilities manage rapidly evolving electric grids, but these programs are subject to the complexities of human behavior. This paper explores a novel method for uncovering heterogeneity in households. We use a machine-learning method known as a Conditional Inference Tree (c-tree) algorithm to categorize households based on their energy behavior characteristics collected via smart meters, and explore how this translates through into heterogeneity in their real-world response to a DR program. Using data from randomized controlled trial, we generate estimates of the changes in energy use caused by the program within each household group. Our results show that the c-tree approach differentiates households by their energy-use characteristics in a way that increases the spread in enrollment rates and critical peak reduction among household groups, compared with the spreads achieved via several conventional segmentation methods. Thus, the c-tree analysis enables the most tailored targeting of major potential energy savers and could provide the greatest increase in cost-effectiveness of household recruitment into DR programs. Our results also offer fresh insights into the relationships between household energy behavior characteristics – such as peak energy use and “structural winningness” (the ability to save money under a DR program without changing energy-use behaviors) – and household decisions about enrolling in DR programs and reducing energy use. Our research also demonstrates the potential of smart meter data, combined with machine learning and econometric methods, to provide significant value to utilities, program implementers, researchers, and other stakeholders.

Demand-response programs can help utilities manage rapidly evolving electric grids, but these programs are subject to the complexities of human behavior. This paper explores a novel method for uncovering heterogeneity in households. We use a machine-learning method known as a Conditional Inference Tree (c-tree) algorithm to categorize households based on their energy behavior characteristics collected via smart meters, and explore how this translates through into heterogeneity in their real-world response to a DR program. Using data from randomized controlled trial, we generate estimates of the changes in energy use caused by the program within each household group. Our results show that the c-tree approach differentiates households by their energy-use characteristics in a way that increases the spread in enrollment rates and critical peak reduction among household groups, compared with the spreads achieved via several conventional segmentation methods. Thus, the c-tree analysis enables the most tailored targeting of major potential energy savers and could provide the greatest increase in cost-effectiveness of household recruitment into DR programs. Our results also offer fresh insights into the relationships between household energy behavior characteristics – such as peak energy use and “structural winningness” (the ability to save money under a DR program without changing energy-use behaviors) – and household decisions about enrolling in DR programs and reducing energy use. Our research also demonstrates the potential of smart meter data, combined with machine learning and econometric methods, to provide significant value to utilities, program implementers, researchers, and other stakeholders.

The power system has undergone significant growth and faced considerable challenges in recent decades, marked by the surge in energy demand and advancements in smart grid technologies, including solar and wind energies, as well as the widespread adoption of electric vehicles. These developments have introduced a level of complexity for utilities, compounded by the rapid expansion of behind-the-meter (BTM) photovoltaic (PV) systems, each with its own unique design and characteristics, thereby impacting power grid stability and reliability. In response to these intricate challenges, this research focused on the development of a robust forecasting model for load generation. This precision forecasting is crucial for optimal planning, mitigating the adverse effects of PV systems, and reducing operational and maintenance costs. By addressing these key aspects, the goal is to enhance the overall resilience and efficiency of the power grid amidst the evolving landscape of energy and technological advancements. The authors propose a solution leveraging LSTM (long short-term memory) model for a forecasting horizon up to 168 hours. This approach incorporates combinations of K-means clustering, automated meter infrastructure (AMI) real-world PV load generation, weather data, and calculated solar positions to forecast the generation load at customer locations to achieve a 5.7% mean absolute error between the actual and the predicted generation load.

In a smart grid, the main goals are to provide grid stability, improve power system performance and security, and reduce operations, system maintenance, and planning costs. The prediction stability of smart grid (SG) systems is essential in terms of power loss minimization and the importance of adequate energy policies. SG systems must accurately predict the energy demand and ensure the right amount of energy is available at the right time. If the prediction is inaccurate, it can lead to costly energy production or usage errors and create considerable inefficiencies in the power grid. Due to this, this manuscript offers five different cascade methods to detect the stability of SG systems. Detecting the stability of SG systems enables the grid to respond quickly to changes in demand and supply, improves system reliability, reduces power outages, and increases the overall efficiency of the grid. The present work proposed five different cascade methods with pre-processing, training and testing division, and the classification stages of the classification procedure for estimating SG stability. In the first pre-processing stage, the SG dataset is pre-proceeded with the feature selection (Relief, Fast Correlation-Based Filter (FCBF), and supervised attribute filter). The resampling (the bootstrapping), the Fuzzy C-Means Clustering-Based Feature Weighting (FCMFW), the resampling then feature selection (supervised attribute filter), and the feature selection (supervised attribute filter), then FCMFW. In the second stage, the training and testing division stage, the SG dataset was separated into three test and training data methods before the classification algorithm: The 5 Fold Cross Validation (FVC), 10 FVC, and hold-out (50–50%). In the third stage, the classification stage, five different classification algorithms, including Naive Kernel Bayes, Linear Support Vector Machine (SVM), Weighted K-Nearest Neighbors, Begged Trees, and Narrow Neural Network classifying algorithms, are used to classify the SG dataset. The simulation results of this study demonstrated that the suggested cascade ML system had achieved significant accuracy in predicting SG stability. The best cascade method is the feature selection (supervised attribute filter) + FCMFW + 10 FCV and then performing the bagged trees algorithm; thus, the new approach affords an accuracy of 99.9%. Furthermore, due to the rapid growth of ML techniques, sensors, and smart meters technologies, with Machine to Machine communication via the internet of things (IoT), the real-time identification process is made practical with higher accuracy. For this reason, our future research will focus on an IoT-based SG system, an E-stability determination system. Thanks to the proposed cascade method, the SG dataset can be classified easily, quickly, and reliably. E-stability determination systems can help to fast detect, predict, and respond, which is an important application of IoT on the grid systems. [ABSTRACT FROM AUTHOR]

The smart grid (SG) ensures the flow of electricity and data between suppliers and consumers. The reliability and security of data also play an important role in the overall management. This can be achieved with the help of adaptive energy management (AEM). This research aims to highlight the big data issues and challenges faced by AEM employed in SG networks. In this paper, we will discuss the most commonly used data processing methods and will give a detailed comparison between the outputs of some of these methods. We consider a dataset of 50,000 instances from consumer smart meters and 10,000 attributes from previous fault data and 12 attributes. The comparison will tell us about the reliability, stability, and accuracy of the system by comparing the output of the various graphical plots of these methods. The accuracy percentage of the linear regression method is 98%; for the logistic regression method, it is 96%; and for K-Nearest Neighbors, it is 92%. The results show that the linear regression method applied gives the highest accuracy compared to logistic regression and K-Nearest Neighbors methods for prediction analysis of big data in SGs. This will ensure their use in future research in this field. [ABSTRACT FROM AUTHOR]

For many years, energy monitoring at the most disaggregate level has been mainly sought through the idea of Non-Intrusive Load Monitoring (NILM). Developing a practical application of this concept in the residential sector can be impeded by the technical characteristics of case studies. Accordingly, several databases, mainly from Europe and the US, have been publicly released to enable basic research to address NILM issues raised by their challenging features. Nevertheless, the resultant enhancements are limited to the properties of these datasets. Such a restriction has caused NILM studies to overlook residential scenarios related to geographically-specific regions and existent practices to face unexplored situations. This paper presents applied research on NILM in Quebec residences to reveal its barriers to feasible implementations. It commences with a concise discussion about a successful NILM idea to highlight its essential requirements. Afterward, it provides a comparative statistical analysis to represent the specificity of the case study by exploiting real data. Subsequently, this study proposes a combinatory approach to load identification that utilizes the promise of sub-meter smart technologies and integrates the intrusive aspect of load monitoring with the non-intrusive one to alleviate NILM difficulties in Quebec residences. A load disaggregation technique is suggested to manifest these complications based on supervised and unsupervised machine learning designs. The former is aimed at extracting overall heating demand from the aggregate one while the latter is designed for disaggregating the residual load. The results demonstrate that geographically-dependent cases create electricity consumption scenarios that can deteriorate the performance of existing NILM methods. From a realistic standpoint, this research elaborates on critical remarks to realize viable NILM systems, particularly in Quebec houses. [ABSTRACT FROM AUTHOR]

Greater variation in electrical load should be expected in the future due to the increasing penetration of electric vehicles, photovoltaics, storage, and other technologies. The adoption of these technologies will vary by area and time, and if not identified early and managed by electric utilities, these new customer needs could result in power quality, reliability, and protection issues. Furthermore, comprehensively studying the uncertainty and variation in the load on circuit elements over periods of several months has the potential to increase the efficient use of traditional resources, non-wires alternatives, and microgrids to better serve customers. To increase the understanding of electrical load, the authors propose a multistep, attention-focused, and efficient machine learning process to provide probabilistic forecasts of distribution transformer load for several months into the future. The method uses the solar irradiance, temperature, dew point, time of day, and other features to achieve up to an 86% coefficient of determination (R2). [ABSTRACT FROM AUTHOR]

Advanced metering infrastructure (AMI) is one of the core aspects of the smart grid, and offers numerous possible benefits, such as load control and demand response. AMI enables two-way communication, but it is vulnerable to electricity theft. Due to the tempering of the smart meter, the abnormal pattern of fraud becomes difficult to detect, which introduces the increment of false data consumption. The majority of existing methods depend on factors such as predefined limits, extra information requirements, and the desire for labelled datasets. These factors are difficult to realize or have a poor degree of identification. This paper integrates two novel techniques to detect the False Data Injection attack. One is Principal Component Analysis, which is based on feature correlation, second is an unsupervised learning based technique Density-Based Spatial Clustering of Applications with Noise which helps to identify data patterns to detect outliers from a huge number of load profiles. The combination makes the proposed technique an appropriate tool for detecting an arbitrary pattern attack in high-dimensional data. Four different attack scenarios are analyzed on the Irish Science Data Archive smart meter data set. The efficacy of proposed theft detection method is evaluated by comparing the AUC, mAP, and time with those of other clustering approaches. The detection rate of the proposed scheme has been compared with the other approaches in the literature. The results demonstrate that the detection rate is substantially higher than that of other theft detection methods. Finally, the influence of varied abnormality ratios has been investigated. [ABSTRACT FROM AUTHOR]

The most common methods to detect non-technical losses involve Deep Learning-based classifiers and samples of consumption remotely collected several times a day through Smart Meters (SMs) and Advanced Metering Infrastructure (AMI). This approach requires a huge amount of data, and training is computationally expensive. However, most energy meters in emerging countries such as Brazil are technologically limited. These devices can measure only the accumulated energy consumption monthly. This work focuses on detecting energy theft in scenarios without AMI and SM. We propose a strategy called HyMOTree intended for the hyperparameter tuning of tree-based algorithms using different multiobjective optimization strategies. Our main contributions are associating different multiobjective optimization strategies to improve the classifier performance and analyzing the model's performance given different probability cutoff operations. HyMOTree combines NSGA-II and GDE-3 with Decision Tree, Random Forest, and XGboost. A dataset provided by a Brazilian power distribution company CPFL ENERGIA™ was used, and the SMOTE technique was applied to balance the data. The results show that HyMOTree performed better than the random search method, and then, the combination between Random Forest and NSGA-II achieved 0.95 and 0.93 for Precision and F1-Score, respectively. Field studies showed that inspections guided by HyMOTree achieved an accuracy of 76%. [ABSTRACT FROM AUTHOR]

Smart meters are rapidly installing by utility providers to improve the reliability and performance of Smart Grid. Utility providers analyze real-time smart meter data to monitor, predict, generate and distribute power. The customer's real-time activity and power usage can be revealed by analyzing the smart meter data. Therefore, the security and privacy of the data is a crucial issue for the smart grid. This paper proposes a secure and privacy-preserving data aggregation and classification (SP-DAC) model based on fog and cloud architecture. Data is aggregated at the fog node in the SP-DAC model, and classification is performed at the outsourced cloud with three machine learning classifiers. Simulation results analyze the cryptographic costs and classification performance. Real-world smart meter dataset "UMass Smart" is taken for experiments and classification accuracy, precision, recall, and F1 score achieved upto 88%, 87%, 90%, and 88%, respectively. The comparison with existing models shows the superiority of the SP-DAC model in terms of features and parameters. [ABSTRACT FROM AUTHOR]

The rising interest in the security of network infrastructure, including edge devices, the Internet of Things, and smart grids, has led to the development of numerous machine learning-based approaches that promise improvement to existing threat detection solutions. Among the popular methods to ensuring cybersecurity is the use of data science techniques and big data to analyse online threats and current trends. One important factor is that these techniques can identify trends, attacks, and events that are invisible or not easily detectable even to a network administrator. The goal of this paper is to suggest the optimal method for feature selection and to find the most suitable method to compare results between different studies in the context of imbalance datasets and threat detection in ICT. Furthermore, as part of this paper, the authors present the state of the data science discipline in the context of the ICT industry, in particular, its applications and the most frequently employed methods of data analysis. Based on these observations, the most common errors and shortcomings in adopting best practices in data analysis have been identified. The improper usage of imbalanced datasets is one of the most frequently occurring issues. This characteristic of data is an indispensable aspect in the case of the detection of infrequent events. The authors suggest several solutions that should be taken into account while conducting further studies related to the analysis of threats and trends in smart grids. [ABSTRACT FROM AUTHOR]

Today we are living in an era where everything is changing to be smart, whether it be a smart home, smart industries, smart irrigation, or a smart meter, where the word smart refers to the involvement of the Internet of Things (IoT). The increased use of IoT infrastructure in these fields has led to the failure of the nodes, increase in threats, attacks, abnormalities, and spying, which is the primary concern and an important domain of an IoT. The main objective of this paper is to use a supervised learning model to predict anomalies in the historical data which can later be incorporated into real-world scenarios to block the upcoming anomalies and attacks. This paper predicts the anomalies on the 350 K data set using the Machine Learning models and compares its performance based on the state of arts. In this paper, two different approaches are used based on the analysis done on the dataset. The classification algorithms were applied to the whole dataset in the first, and then the same classification algorithms were applied after excluding the data points having binary values (0 and 1) in the feature "value" and have achieved an average of 99.4% accuracy for the first case and 99.99% accuracy for the later. [ABSTRACT FROM AUTHOR]

Detecting energy consumption anomalies is a popular topic of industrial research, but there is a noticeable lack of research reported in the literature on energy consumption anomalies for road lighting systems. However, there is a need for such research because the lighting system, a key element of the Smart City concept, creates new monitoring opportunities and challenges. This paper examines algorithms based on the deep learning method using the Autoencoder model with LSTM and 1D Convolutional networks for various configurations and training periods. The evaluation of the algorithms was carried out based on real data from an extensive lighting control system. A practical approach was proposed using real-time, unsupervised algorithms employing limited computing resources that can be implemented in industrial devices designed to control intelligent city lighting. An anomaly detection algorithm based on classic LSTM networks, single-layer and multi-layer, was used for comparison purposes. Error matrix calculus was used to assess the quality of the models. It was shown that based on the Autoencoder method, it is possible to construct an algorithm that correctly detects anomalies in power measurements of lighting systems, and it is possible to build a model so that the algorithm works correctly regardless of the season of the year.