Search

To solve the problem of feature selection and error correction after mode decomposition and improve the ability of power load forecasting models to capture complex time series information, a two-stage short-term power load forecasting method based on recursive feature elimination with a cross validation (RFECV) algorithm and time convolution network–efficient channel attention mechanism–long short-term memory network (TCN–ECA–LSTM) is presented. First, the load sequence is decomposed into a relatively stable set of modal components using variational mode decomposition. Then, the RFECV-based method filters the feature set of each modal component to construct the best feature set. Finally, a two-stage prediction model based on TCN–ECA–LSTM is established. The first stage predicts each modal component and the second stage reconstructs the load forecast based on the predicted value of the previous stage. This paper takes actual data from New South Wales, Australia, as an example, and the results show that the method proposed in this paper can build the feature set reliably and efficiently and has a higher accuracy than the conventional prediction model. [ABSTRACT FROM AUTHOR]

A large proportion of photovoltaic (PV) power generation is connected to the power grid, and its volatility and stochasticity have significant impacts on the power system. Accurate PV power forecasting is of great significance in optimizing the safe operation of the power grid and power market transactions. In this paper, a novel dual-channel PV power forecasting method based on a temporal convolutional network (TCN) is proposed. The method deeply integrates the PV station feature data with the model computing mechanism through the dual-channel model architecture; utilizes the combination of multihead attention (MHA) and TCN to extract the multidimensional spatio-temporal features between other meteorological variables and the PV power; and utilizes a single TCN to fully extract the temporal constraints of the power sequence elements. The weighted fusion of the dual-channel feature data ultimately yields the ideal forecasting results. The experimental data in this study are from a 26.52 kW PV power plant in central Australia. The experiments were carried out over seven different input window widths, and the two models that currently show superior performance within the field of PV power forecasting: the convolutional neural network (CNN), and the convolutional neural network combined with a long and short-term memory network (CNN_LSTM), are used as the baseline models. The experimental results show that the proposed model and the baseline models both obtained the best forecasting performance over a 1-day input window width, while the proposed model exhibited superior forecasting performance compared to the baseline model. It also shows that designing model architectures that deeply integrate the data input method with the model mechanism has research potential in the field of PV power forecasting. [ABSTRACT FROM AUTHOR]

The prevalence of cybercrime has emerged as a critical issue in contemporary society because of its far-reaching financial, social, and psychological implications. The negative effects of cyber-attacks extend beyond financial losses and disrupt people's lives on social and psychological levels. Conventional practice involves cyber experts sourcing data from various outlets and applying personal discernment and rational inference to manually formulate cyber intelligence specific to a country. This traditional approach introduces personal bias towards the country-level cyber reports. However, this paper reports a novel approach where country-level cyber intelligence is automatically generated with artificial intelligence (AI), employing cyber-related social media posts and open-source cyber-attack statistics. Our innovative cyber threat intelligence solution examined 37,386 tweets from 30,706 users in 54 languages using sentiment analysis, translation, term frequency–inverse document frequency (TF-IDF), latent Dirichlet allocation (LDA), N-gram, and Porter stemming. Moreover, the presented study utilized 238,220 open-intelligence cyber-attack statistics from eight different web links, to create a historical cyber-attack dataset. Subsequently, AI-based algorithms, like convolutional neural network (CNN), and exponential smoothing were used for AI-driven insights. With the confluence of the voluminous Twitter-derived data and the array of open-intelligence cyber-attack statistics, orchestrated by the AI-driven algorithms, the presented approach generated seven-dimensional cyber intelligence for Australia and China in complete automation. Finally, the topic analysis on the cyber-related social media messages revealed seven main themes for both Australia and China. This methodology possesses the inherent capability to effortlessly engender cyber intelligence for any country, employing an autonomous modality within the realm of pervasive computational platforms. [ABSTRACT FROM AUTHOR]

Data pre-processing for developing a generalised land use and land cover (LULC) deep learning model using earth observation data is important for the classification of a different date and/or sensor. However, it is unclear how to approach deep learning segmentation problems in earth observation data. In this paper, we trialled different methods of data preparation for Convolutional Neural Network (CNN) training and semantic segmentation of LULC features within aerial photography over the Wet Tropics and Atherton Tablelands, Queensland, Australia. This was conducted by trialling and ranking various training patch selection sampling strategies, patch and batch sizes, data augmentations and scaling and inference strategies. Our results showed: a stratified random sampling approach for producing training patches counteracted class imbalances; a smaller number of larger patches (small batch size) improves model accuracy; data augmentations and scaling are imperative in creating a generalised model able to accurately classify LULC features in imagery from a different date and sensor; and producing the output classification by averaging multiple grids of patches and three rotated versions of each patch produced a more accurate and aesthetic result. Combining the findings from the trials, we fully trained five models on the 2018 training image and applied the model to the 2015 test image. The output LULC classifications achieved an average kappa of 0.84, user accuracy of 0.81, and producer accuracy of 0.87. Future research using CNNs and earth observation data should implement the findings of this project to increase LULC model accuracy and transferability. [ABSTRACT FROM AUTHOR]

There is a long history of coastal erosion caused by frequent storm surges in the coastal regions of Australia, which imposes great threats to communities and infrastructures alongside the beach. Old Bar Beach, New South Wales, Australia, is one such hotspot famous for its extreme coastal erosion. To apply remedial measures such as beach nourishment effectively and economically, estimating/reconstructing the subsurface hydrogeology over the coastal areas is essential. A geophysical tool such as a ground-penetrating radar (GPR) which works on the principle of reflecting electromagnetic (EM) waves, can be conveniently deployed to delineate the soil and rock profiling, water-table depth, bedrock depth, and the subsurface structural features. Here, DeepLabv3+ architecture based newly developed deep convolutional neural networks (DCNNs) were used to establish an inherent non-linear relationship between the GPR data and the EM wave velocity. The presented DCNNs have a lesser number of layers, a lesser number of trainable (learnable) parameters, a high convergence rate and, at the same time, achieve prediction accuracy comparable to that of well-established DeepLabv3+ networks, having high trainable parameters and a relatively low convergence rate. Here, firstly the DCNNs were trained and validated on small 1D datasets. Each dataset contains a 1D GPR trace and a corresponding EM velocity model. The DCNNs turned out to be quite promising in the 1D case, with training, validation, and testing accuracy of approximately 95%, 94%, and 95%, respectively. Secondly, 1D trained weights were applied to 2D synthetic GPR data for EM velocity prediction, and the accuracy of prediction achieved was approximately 95%. Seeing the excellent performance of the DCNNs in the 2D prediction case using 1D trained weights, a large amount of 1D synthetic datasets (approximately 1.2 million) were generated and gaussian noise was added to it to replicate the real field scenario. Thirdly, topographically corrected GPR data acquired over the Old Bar Beach were inverted using the DCNNs trained on 1.2 million 1D synthetic datasets to obtain the subsurface high-resolution, high-precision EM velocity, and ε r distribution information to understand the hydrogeology over the beach. The findings presented in this paper agree well with the previous hydrogeological studies carried out using GPR. Our findings show that DCNNs, along with GPR, can be successfully used in coastal environments for the quick and accurate hydrogeological investigation required for the implementation of coastal erosion mitigation methods such as beach nourishment. [ABSTRACT FROM AUTHOR]

High-precision vector magnetic field detection has been widely used in the fields of celestial magnetic field detection, aeromagnetic detection, marine magnetic field detection and geomagnetic navigation. Due to the large amount of data, the 3D inversion of high-precision magnetic gradient vector data often involves a large number of computational requirements and is very time-consuming. In this paper, a 3D magnetic gradient tensor (MGT) inversion method is developed, based on using a convolutional neural network (CNN) to automatically predict physical parameters from the 2D images of MGT. The information of geometry, depth and parameters such as magnetic inclination (I), magnetic declination (D) and magnetization susceptibility of magnetic anomalies is extracted, and a 3D model is obtained by comprehensive analysis. The method first obtains sufficient MGT data samples by forward modeling of different magnetic anomalies. Then, we use an improved CNN with shear layers to achieve the prediction of each magnetic parameter. The reliability of the algorithm is verified by numerical simulations of synthetic models of multiple magnetic anomalies. MGT data of the Tallawang magnetite diorite deposit in Australia are also predicted by using this method to obtain a slab model that matches the known geological information. The effects of sample size and noise level on the prediction accuracy are discussed. Compared with single-component prediction, the results of multi-component joint prediction are more reliable. From the numerical model study and the field data validation, we demonstrate the capability of using CNNs for inversing MGT data. [ABSTRACT FROM AUTHOR]

Accurate and comparable annual mapping is critical to understanding changing vegetation distribution and informing land use planning and management. A U-Net convolutional neural network (CNN) model was used to map natural vegetation and forest types based on annual Landsat geomedian reflectance composite images for a 500 km × 500 km study area in southeastern Australia. The CNN was developed using 2018 imagery. Label data were a ten-class natural vegetation and forest classification (i.e., Acacia, Callitris, Casuarina, Eucalyptus, Grassland, Mangrove, Melaleuca, Plantation, Rainforest and Non-Forest) derived by combining current best-available regional-scale maps of Australian forest types, natural vegetation and land use. The best CNN generated using six Landsat geomedian bands as input produced better results than a pixel-based random forest algorithm, with higher overall accuracy (OA) and weighted mean F1 score for all vegetation classes (93 vs. 87% in both cases) and a higher Kappa score (86 vs. 74%). The trained CNN was used to generate annual vegetation maps for 2000–2019 and evaluated for an independent test area of 100 km × 100 km using statistics describing accuracy regarding the label data and temporal stability. Seventy-six percent of pixels did not change over the 20 years (2000–2019), and year-on-year results were highly correlated (94–97% OA). The accuracy of the CNN model was further verified for the study area using 3456 independent vegetation survey plots where the species of interest had ≥ 50% crown cover. The CNN showed an 81% OA compared with the plot data. The model accuracy was also higher than the label data (76%), which suggests that imperfect training data may not be a major obstacle to CNN-based mapping. Applying the CNN to other regions would help to test the spatial transferability of these techniques and whether they can support the automated production of accurate and comparable annual maps of natural vegetation and forest types required for national reporting. [ABSTRACT FROM AUTHOR]

Fault detection is an important step in subsurface interpretation and reservoir characterization from 3D seismic images. Due to the numerous and complex fault structures in seismic images, manual seismic interpretation is time-consuming and requires intensive work. We applied a pre-trained CNN model to predict faults from the 3D seismic volume of the Poseidon field in the Browse Basin, Australia. This field is highly structured with complex normal faulting throughout the targeted Plover Formations. Our motivation for this work is to compare machine-learning-based fault prediction to user-interpreted fault identification supported by seismic variance attributes. We found reasonably satisfactory results using CNN with an improved fault probability volume that outperforms variance technology. Therefore, we propose that this workflow could reduce time and be able to predict faults quite accurately in most structurally complex areas. [ABSTRACT FROM AUTHOR]

The exacerbation of wildfires, attributed to the effects of climate change, presents substantial risks to ecological systems, infrastructure, and human well-being. In the context of the Sustainable Development Goals (SDGs), particularly those related to climate action, prioritizing the assessment and management of the occurrence and intensity of extensive wildfires is of utmost importance. In recent times, there has been a significant increase in the frequency and severity of widespread wildfires worldwide, affecting several locations, including Australia, Italy, and the United States of America. The presence of complex phenomena marked by limited predictability leads to significant negative impacts on biodiversity and human lives. The utilization of satellite-derived data with neural networks, such as convolutional neural networks (CNNs), is a potentially advantageous approach for augmenting the monitoring capabilities of wildfires. This research examines the generalization capability of four neural network models, namely the fully connected (FC), one-dimensional (1D) CNN, two-dimensional (2D) CNN, and three-dimensional (3D) CNN model. Each model's performance, as measured by accuracy, recall, and F1 scores, is assessed through K-fold cross-validation. Subsequently, T-statistics and p-values are computed based on these metrics to conduct a statistical comparison among the different models, allowing us to quantify the degree of similarity or dissimilarity between them. By using training data from Australia and Sicily, the performances of the trained model are evaluated on the test dataset from Oregon. The results are promising, with cross-validation on the training dataset producing mean precision, recall, and F1 scores ranging between approximately 0.97 and 0.98. Especially, the fully connected model has superior generalization capabilities, whilst the 3D CNN offers more refined and less distorted classifications. However, certain issues, such as false fire detection and confusion between smoke and shadows, persist. The aforementioned methodologies offer significant perspectives on the capabilities of neural network technologies in supporting the detection and management of wildfires. These approaches address the crucial matter of domain transferability and the associated dependability of predictions in new regions. This study makes a valuable contribution to the ongoing efforts in climate change by assisting in monitoring and managing wildfires. [ABSTRACT FROM AUTHOR]

The prediction of sea level rise is extremely important for improved future climate change mitigation and adaptation strategies. This study uses a hybrid convolutional neural Network (CNN) and a bidirectional long short-term (BiLSTM) model with successive variational mode decomposition (SVMD) to predict the absolute sea level for two study sites in Australia (Port Kembla and Milner Bay). More importantly, the sea level measurements using a tide gauge were corrected using Global Navigation Satellite System (GNSS) measurements of the vertical land movement (VLM). The SVMD-CNN-BiLSTM model was benchmarked by a multi-layer perceptron (MLP), support vector regression (SVR) and gradient boosting (GB). The SVMD-CNN-BiLSTM model outperformed all the comparative models with high correlation values of more than 0.95 for Port Kembla and Milner Bay. Similarly, the SVMD-CNN-BiLSTM model achieved the highest values for the Willmott index, the Nash–Sutcliffe index and the Legates and McCabe index for both study sites. The projected linear trend showed the expected annual mean sea rise for 2030. Using the current trend, Port Kembla was projected to have an MSL value of 1.03 m with a rate rise of approx. 4.5 mm/year. The rate of the MSL for Milner Bay was comparatively lower with a value of approx. 2.75 mm/year and an expected MSL value of 1.27 m for the year 2030. [ABSTRACT FROM AUTHOR]

Satellite imagery is the only feasible approach to annual monitoring and reporting on land cover change. Unfortunately, conventional pixel-based classification methods based on spectral response only (e.g., using random forests algorithms) have shown a lack of spatial and temporal stability due, for instance, to variability between individual pixels and changes in vegetation condition, respectively. Machine learning methods that consider spatial patterns in addition to reflectance can address some of these issues. In this study, a convolutional neural network (CNN) model, U-Net, was trained for a 500 km × 500 km region in southeast Australia using annual Landsat geomedian data for the relatively dry and wet years of 2018 and 2020, respectively. The label data for model training was an eight-class classification inferred from a static land-use map, enhanced using forest-extent mapping. Here, we wished to analyse the benefits of CNN-based land cover mapping and reporting over 34 years (1987–2020). We used the trained model to generate annual land cover maps for a 100 km × 100 km tile near the Australian Capital Territory. We developed innovative diagnostic methods to assess spatial and temporal stability, analysed how the CNN method differs from pixel-based mapping and compared it with two reference land cover products available for some years. Our U-Net CNN results showed better spatial and temporal stability with, respectively, overall accuracy of 89% verses 82% for reference pixel-based mapping, and 76% of pixels unchanged over 33 years. This gave a clearer insight into where and when land cover change occurred compared to reference mapping, where only 30% of pixels were conserved. Remaining issues include edge effects associated with the CNN method and a limited ability to distinguish some land cover types (e.g., broadacre crops vs. pasture). We conclude that the CNN model was better for understanding broad-scale land cover change, use in environmental accounting and natural resource management, whereas pixel-based approaches sometimes more accurately represented small-scale changes in land cover. [ABSTRACT FROM AUTHOR]

Land cover mapping from satellite images has progressed from visual and statistical approaches to Random Forests (RFs) and, more recently, advanced image recognition techniques such as convolutional neural networks (CNNs). CNNs have a conceptual benefit over RFs in recognising spatial feature context, but potentially at the cost of reduced spatial detail. We tested the use of CNNs for improved land cover mapping based on Landsat data, compared with RFs, for a study area of approximately 500 km × 500 km in southeastern Australia. Landsat 8 geomedian composite surface reflectances were available for 2018. Label data were a simple nine-member land cover classification derived from reference land use mapping (Catchment Scale Land Use of Australia—CLUM), and further enhanced by using custom forest extent mapping (Forests of Australia). Experiments were undertaken testing U-Net CNN for segmentation of Landsat 8 geomedian imagery to determine the optimal combination of input Landsat 8 bands. The results were compared with those from a simple autoencoder as well as an RF model. Segmentation test results for the best performing U-Net CNN models produced an overall accuracy of 79% and weighted-mean F1 score of 77% (9 band input) or 76% (6 band input) for a simple nine-member land cover classification, compared with 73% and 68% (6 band input), respectively, for the best RF model. We conclude that U-Net CNN models can generate annual land cover maps with good accuracy from proxy training data, and can also be used for quality control or improvement of existing land cover products. [ABSTRACT FROM AUTHOR]

Digital agriculture services can greatly assist growers to monitor their fields and optimize their use throughout the growing season. Thus, knowing the exact location of fields and their boundaries is a prerequisite. Unlike property boundaries, which are recorded in local council or title records, field boundaries are not historically recorded. As a result, digital services currently ask their users to manually draw their field, which is time-consuming and creates disincentives. Here, we present a generalized method, hereafter referred to as DECODE (DEtect, COnsolidate, and DElinetate), that automatically extracts accurate field boundary data from satellite imagery using deep learning based on spatial, spectral, and temporal cues. We introduce a new convolutional neural network (FracTAL ResUNet) as well as two uncertainty metrics to characterize the confidence of the field detection and field delineation processes. We finally propose a new methodology to compare and summarize field-based accuracy metrics. To demonstrate the performance and scalability of our method, we extracted fields across the Australian grains zone with a pixel-based accuracy of 0.87 and a field-based accuracy of up to 0.88 depending on the metric. We also trained a model on data from South Africa instead of Australia and found it transferred well to unseen Australian landscapes. We conclude that the accuracy, scalability and transferability of DECODE shows that large-scale field boundary extraction based on deep learning has reached operational maturity. This opens the door to new agricultural services that provide routine, near-real time field-based analytics. [ABSTRACT FROM AUTHOR]