Search

This paper introduces a novel methodology for analyzing three-way array data with a multi-group structure. Three-way arrays are commonly observed in various domains, including image analysis, chemometrics, and real-world applications. In this paper, we use a practical case study of process modeling in additive manufacturing, where batches are structured according to multiple groups. Vast volumes of data for multiple variables and process stages are recorded by sensors installed on the production line for each batch. For these three-way arrays, the link between the final product and the observations creates a grouping structure in the observations. This grouping may hamper gaining insight into the process if only some of the groups dominate the controlled variability of the products. In this study, we develop an extension of the PARAFAC model that takes into account the grouping structure of three-way data sets. With this extension, it is possible to estimate a model that is representative of all the groups simultaneously by finding their common structure. The proposed model has been applied to three simulation data sets and a real manufacturing case study. The capability to find the common structure of the groups is compared to PARAFAC and the insights into the importance of variables delivered by the models are discussed., Validerad;2024;Nivå 2;2024-03-06 (hanlid);Full text license: CC BY

Online active learning is a paradigm in machine learning that aims to select the most informative data points to label from a data stream. The problem of minimizing the cost associated with collecting labeled observations has gained a lot of attention in recent years, particularly in real-world applications where data is only available in an unlabeled form. Annotating each observation can be time-consuming and costly, making it difficult to obtain large amounts of labeled data. To overcome this issue, many active learning strategies have been proposed in the last decades, aiming to select the most informative observations for labeling in order to improve the performance of machine learning models. These approaches can be broadly divided into two categories: static pool-based and stream-based active learning. Pool-based active learning involves selecting a subset of observations from a closed pool of unlabeled data, and it has been the focus of many surveys and literature reviews. However, the growing availability of data streams has led to an increase in the number of approaches that focus on online active learning, which involves continuously selecting and labeling observations as they arrive in a stream. This work aims to provide an overview of the most recently proposed approaches for selecting the most informative observations from data streams in real time. We review the various techniques that have been proposed and discuss their strengths and limitations, as well as the challenges and opportunities that exist in this area of research., Validerad;2024;Nivå 2;2024-04-02 (hanlid);Funder: DTU Strategic Alliances Fund;Full text license: CC BY 4.0

In most data analytic applications in manufacturing, understanding the data-driven models plays a crucial role in complementing the engineering knowledge about the production process. Identifying relevant input variables, rather than only predicting the response through some “black-box” model, is of great interest in many applications. There is, therefore, a growing focus on describing the contributions of the input variables to the model in the form of “variable importance”, which is readily available in certain machine learning methods such as random forest (RF). Once a ranking based on the importance measure of the variables is established, the question of how many variables are truly relevant in predicting the output variable rises. In this study, we focus on the Boruta algorithm, which is a wrapper around the RF model. It is a variable selection tool that assesses the variable importance measure for the RF model. It has been previously shown in the literature that the correlation among the input variables, which is often a common occurrence in high dimensional data, distorts and overestimates the importance of variables. The Boruta algorithm is also affected by this resulting in a larger set of input variables deemed important. To overcome this issue, in this study, we propose an extension of the Boruta algorithm for the correlated data by exploiting the conditional importance measure. This extension greatly improves the Boruta algorithm in the case of high correlation among variables and provides a more precise ranking of the variables that significantly contribute to the response. We believe this approach can be used in many industrial applications by providing more transparency and understanding of the process., Validerad;2024;Nivå 2;2024-02-14 (sofila);Full text license: CC BY-NC 4.0

In many industrial applications, obtaining labeled observations is not straightforward as it often requires the intervention of human experts or the use of expensive testing equipment. In these circumstances, active learning can be highly beneficial in suggesting the most informative data points to be used when fitting a model. Reducing the number of observations needed for model development alleviates both the computational burden required for training and the operational expenses related to labeling. Online active learning, in particular, is useful in high-volume production processes where the decision about the acquisition of the label for a data point needs to be taken within an extremely short time frame. However, despite the recent efforts to develop online active learning strategies, the behavior of these methods in the presence of outliers has not been thoroughly examined. In this work, we investigate the performance of online active linear regression in contaminated data streams. Our study shows that the currently available query strategies are prone to sample outliers, whose inclusion in the training set eventually degrades the predictive performance of the models. To address this issue, we propose a solution that bounds the search area of a conditional D-optimal algorithm and uses a robust estimator. Our approach strikes a balance between exploring unseen regions of the input space and protecting against outliers. Through numerical simulations, we show that the proposed method is effective in improving the performance of online active learning in the presence of outliers, thus expanding the potential applications of this powerful tool., Validerad;2024;Nivå 2;2024-02-14 (sofila);Funder: DTU Strategic Alliances Fund;Full text license: CC BY 4.0

Online active learning is a paradigm in machine learning that aims to select the most informative data points to label from a data stream. The problem of minimizing the cost associated with collecting labeled observations has gained a lot of attention in recent years, particularly in real-world applications where data is only available in an unlabeled form. Annotating each observation can be time-consuming and costly, making it difficult to obtain large amounts of labeled data. To overcome this issue, many active learning strategies have been proposed in the last decades, aiming to select the most informative observations for labeling in order to improve the performance of machine learning models. These approaches can be broadly divided into two categories: static pool-based and stream-based active learning. Pool-based active learning involves selecting a subset of observations from a closed pool of unlabeled data, and it has been the focus of many surveys and literature reviews. However, the growing availability of data streams has led to an increase in the number of approaches that focus on online active learning, which involves continuously selecting and labeling observations as they arrive in a stream. This work aims to provide an overview of the most recently proposed approaches for selecting the most informative observations from data streams in real time. We review the various techniques that have been proposed and discuss their strengths and limitations, as well as the challenges and opportunities that exist in this area of research.

Injection molding is one of the most important processes for the mass production of plastic parts. In recent years, many researchers have focused on predicting the occurrence and intensity of defects in injected molded parts, as well as the optimization of process parameters to avoid such defects. One of the most frequent defects of manufactured parts is blush, which usually occurs around the gate location. In this study, to identify the effective parameters on blush formation, eight design parameters with effect probability on the influence of this defect have been investigated. Using a combination of design of experiments (DOE), finite element analysis (FEA), and ANOVA, the most significant parameters have been identified (runner diameter, holding pressure, flow rate, and melt temperature). Furthermore, to provide an efficient predictive model, machine learning methods such as basic artificial neural networks, their combination with genetic algorithms, and particle swarm optimization have been applied and their performance analyzed. It was found that the basic artificial neural network (ANN), with an average accuracy error of 1.3%, provides the closest predictions to the FEA results. Additionally, the process parameters were optimized using ANOVA and a genetic algorithm, which resulted in a significant reduction in the blush defect area.

We present a unified modeling framework for Time-Based Maintenance (TBM) and ConditionBased Maintenance (CBM) for optimization of replacements in multi-component systems. The considered system has a K-out-of-N reliability structure, and components deteriorate according to a multivariate gamma process with L´evy copula dependence. The TBM and CBM models are formulated as Markov Decision Processes (MDPs), and optimal policies are found using dynamic programming. Solving the CBM model requires that the continuous deterioration process is discretized. We therefore investigate the discretization level required for obtaining a near-optimal policy. Our results indicate that a coarser discretization level than previously suggested in the literature is adequate, indicating that dynamic programming is a feasible approach for optimization in multi-component systems. We further demonstrate this through empirical results for the size limit of the MDP models when solved with an optimized implementation of modified policy iteration. The TBM model can generally be solved with more components than the CBM model, since the former has a sparser state transition structure. In the special case of independent component deterioration, transition probabilities can be calculated efficiently at runtime. This reduces the memory requirements substantially. For this case, we also achieved a tenfold speedup when using ten processors in a parallel implementation of algorithm. Altogether, our results show that the computational requirements for systems with independent component deterioration increase at a slower rate than for systems with stochastic dependence.

Implementation of digital, intelligent control systems have traditionally not been easy because of various reasons including harsh temperature conditions, standardized measurements, and conventional mindset in foundries. However, it is possible to digitalize and control the foundry industry by exploiting the modern-day technological tools. The present project presents an integrated physics-based and statistical modelling approach to produce models that forms the fundamental building blocks for digitalization of a continuous casting foundry. Real life online experimentation is a crucial step across the progress of the project to validate the science-based models and to produce data for statistical models.

INTRODUCTION: The current process for generating evidence in pharmacovigilance has several limitations, which often lead to delays in the evaluation of drug-associated risks.OBJECTIVES: In this study, we proposed and tested a near real-time epidemiological surveillance system using sequential, cumulative analyses focusing on the detection and preliminary risk quantification of potential safety signals following initiation of selective serotonin reuptake inhibitors (SSRIs) and serotonin-norepinephrine reuptake inhibitors (SNRIs).METHODS: We emulated an active surveillance system in an historical setting by conducting repeated annual cohort studies using nationwide Danish healthcare data (1996-2016). Outcomes were selected from the European Medicines Agency's Designated Medical Event list, summaries of product characteristics, and the literature. We followed patients for a maximum of 6 months from treatment initiation to the event of interest or censoring. We performed Cox regression analyses adjusted for standard sets of covariates. Potential safety signals were visualized using heat maps and cumulative hazard ratio (HR) plots over time.RESULTS: In the total study population, 969,667 new users were included and followed for 461,506 person-years. We detected potential safety signals with incidence rates as low as 0.9 per 10,000 person-years. Having eight different exposure drugs and 51 medical events, we identified 31 unique combinations of potential safety signals with a positive association to the event of interest in the exposed group. We proposed that these signals were designated for further evaluation once they appeared in a prospective setting. In total, 21 (67.7%) of these were not present in the current summaries of product characteristics.CONCLUSION: The study demonstrated the feasibility of performing epidemiological surveillance using sequential, cumulative analyses. Larger populations are needed to evaluate rare events and i

The motivation of the Industrial PhD project is to create a fast and reliable closed-loop control system for Tasso’s continuous casting unit that will increase the company’s product quality and production rate. The objective of the PhD is to acquire knowledge and develop the critical process parameters, which will aid in identifying appropriate locations for on-line sensors. The methodology adopted to achieve this would be numerical modelling (thermal) of the HCC process that will give the complete picture of the intricacies of the casting process. The next part of the project will deal with processing, analysing and optimising the process parameters, including some design parameters, of the HCC process to achieve the overall goal. The latter would be done through statistical modelling of the process parameters, either through response surface methodologies or through machine learning tools.

Introduction: The current process for generating evidence in pharmacovigilance has several limitations, which often lead to delays in the evaluation of drug-associated risks. Objectives: In this study, we proposed and tested a near real-time epidemiological surveillance system using sequential, cumulative analyses focusing on the detection and preliminary risk quantification of potential safety signals following initiation of selective serotonin reuptake inhibitors (SSRIs) and serotonin-norepinephrine reuptake inhibitors (SNRIs). Methods: We emulated an active surveillance system in an historical setting by conducting repeated annual cohort studies using nationwide Danish healthcare data (1996–2016). Outcomes were selected from the European Medicines Agency's Designated Medical Event list, summaries of product characteristics, and the literature. We followed patients for a maximum of 6 months from treatment initiation to the event of interest or censoring. We performed Cox regression analyses adjusted for standard sets of covariates. Potential safety signals were visualized using heat maps and cumulative hazard ratio (HR) plots over time. Results: In the total study population, 969,667 new users were included and followed for 461,506 person-years. We detected potential safety signals with incidence rates as low as 0.9 per 10,000 person-years. Having eight different exposure drugs and 51 medical events, we identified 31 unique combinations of potential safety signals with a positive association to the event of interest in the exposed group. We proposed that these signals were designated for further evaluation once they appeared in a prospective setting. In total, 21 (67.7%) of these were not present in the current summaries of product characteristics. Conclusion: The study demonstrated the feasibility of performing epidemiological surveillance using sequential, cumulative analyses. Larger populations are needed to evaluate rare events and infrequently used antidep

Aim: To summarize the evidence on the performance of artificial intelligence vs. traditional pharmacoepidemiological techniques. Methods: Ovid MEDLINE (01/1950 to 05/2019) was searched to identify observational studies, meta-analyses, and clinical trials using artificial intelligence techniques having a drug as the exposure or the outcome of the study. Only studies with an available full text in the English language were evaluated. Results: In all, 72 original articles and five reviews were identified via Ovid MEDLINE of which 19 (26.4%) compared the performance of artificial intelligence techniques with traditional pharmacoepidemiological methods. In total, 44 comparisons have been performed in articles that aimed at 1) predicting the needed dosage given the patient’s characteristics (31.8%), 2) predicting the clinical response following a pharmacological treatment (29.5%), 3) predicting the occurrence/severity of adverse drug reactions (20.5%), 4) predicting the propensity score (9.1%), 5) identifying subpopulation more at risk of drug inefficacy (4.5%), 6) predicting drug consumption (2.3%), and 7) predicting drug-induced lengths of stay in hospital (2.3%). In 22 out of 44 (50.0%) comparisons, artificial intelligence performed better than traditional pharmacoepidemiological techniques. Random forest (seven out of 11 comparisons; 63.6%) and artificial neural network (six out of 10 comparisons; 60.0%) were the techniques that in most of the comparisons outperformed traditional pharmacoepidemiological methods. Conclusion: Only a small fraction of articles compared the performance of artificial intelligence techniques with traditional pharmacoepidemiological methods and not all artificial intelligence techniques have been compared in a Pharmacoepidemiological setting. However, in 50% of comparisons, artificial intelligence performed better than pharmacoepidemiological techniques.

Railway track maintenance and renewal are vital for railway safety, train punctuality, and travel comfort. Therefore, having cost-effective maintenance is critical in managing railway infrastructure assets. There has been a considerable amount of research performed on mathematical and decision support models for improving the application of railway track maintenance planning and scheduling. This article reviews the literature in decision support models for railway track maintenance planning and scheduling and transforms the results into a problem taxonomy. Furthermore, the article discusses current approaches in optimising maintenance planning and scheduling, research trends, and possible gaps in the related decision-making models.

The current work addresses an industrial problem related to injection moulding manufacturing with focus on mould wear-out prediction. Real data sets are provided by an industrial partner that uses a multitude of moulds with different shapes and sizes in its production. An analysis of the data is presented and begins with clustering the moulds based on their characteristics and pre-chosen running settings. Using the results of the clustering, the mould wear-out is modelled using Kaplan-Meier survival curves. Furthermore, a random survival forest model is fitted for comparison and model performance is assessed. The main novelty of the case study is the implementation of mould wear-out prediction in real-time with the outcomes presented in terms of conditional survival curves including a proposed early warning system. For visualization and further industrial implementation, an R Shiny dashboard is developed and presented.

Aim: To perform a systematic review on the application of artificial intelligence (AI) based knowledge discovery techniques in pharmacoepidemiology. Study Eligibility Criteria: Clinical trials, meta-analyses, narrative/systematic review, and observational studies using (or mentioning articles using) artificial intelligence techniques were eligible. Articles without a full text available in the English language were excluded. Data Sources: Articles recorded from 1950/01/01 to 2019/05/06 in Ovid MEDLINE were screened. Participants: Studies including humans (real or simulated) exposed to a drug. Results: In total, 72 original articles and 5 reviews were identified via Ovid MEDLINE. Twenty different knowledge discovery methods were identified, mainly from the area of machine learning (66/72; 91.7%). Classification/regression (44/72; 61.1%), classification/regression + model optimization (13/72; 18.0%), and classification/regression + features selection (12/72; 16.7%) were the three most frequent tasks in reviewed literature that machine learning methods has been applied to solve. The top three used techniques were artificial neural networks, random forest, and support vector machines models. Conclusions: The use of knowledge discovery techniques of artificial intelligence techniques has increased exponentially over the years covering numerous sub-topics of pharmacoepidemiology. Systematic Review Registration: Systematic review registration number in PROSPERO: CRD42019136552.

Solids-flux theory and state point analysis (SPA) are used for the design, operation and control of secondary settling tanks (SSTs). The objectives of this study are to assess uncertainties, propagating from flow and solids loading boundary conditions as well as compression settling behaviour to the calculation of the limiting flux (JL) and the limiting solid concentration (XL). The interpreted computational fluid dynamics (iCFD) simulation model is used to predict 1-D local concentrations and limiting solids fluxes as a function of loading and design boundary conditions. A two-level fractional factorial design of experiments is used to infer the relative significance of factors unaccounted for in conventional SPA. To move away from using semi-arbitrary safety factors, a practical approach is proposed to calculate the maximum SST capacity by employing a factor of 23% and a regression meta-model to correct values of JL and XL, respectively – critical to abate hydraulic effects under wet-weather flow conditions.

The concurrent use of statistical process control and engineering process control involves monitoring manipulated and controlled variables. One multivariate control chart may handle the statistical monitoring of all variables, but observing the manipulated and controlled variables in separate control charts may improve understanding of how disturbances and the controller performance affect the process. In this article, we illustrate how step and ramp disturbances manifest themselves in a single-input–single-output system by studying their resulting signatures in the controlled and manipulated variables. The system is controlled by variations of the widely used proportional-integral-derivative(PID) control scheme. Implications for applying control charts for these scenarios are discussed.

Manufacturing has been rejuvenated by automation and digitalization. This has brought forth the new industrial era also called Industry 4.0. During the last few years, we have collaborated with companies from various industries that have all been going through this transformation. Through these collaborations, we have collected numerous examples of (sometimes troublesome) experiences with Big Data applications of production analytics. These experiences reflect the current state of production data and the challenges it poses. Our goal in this paper is to share those experiences and lessons learned in dealing with practical issues from data acquisition to data management and finally to data analytics.

With the emergence of Industry 4.0 and Big Data initiatives there is a renewed interest in leveraging the vast amounts of data collected in (bio)chemical processes to improve their operations. The objective of this manuscript is to provide a perspective of the current status of Big Data-based process control methodologies and the most effective path to further embed these methodologies in the control of (bio)chemical processes. Therefore, this manuscript provides an overview of operational requirements, the availability and the nature of data, and the role of the control structure hierarchy in (bio)chemical processes and how they constrain this endeavor. The current state of the seemingly competing methodologies of Statistical Process Monitoring and (Engineering) Process Control is examined together with hybrid methodologies that are attempting to combine tools and techniques that belong to either camp. The technical and economic considerations of a deeper integration between the two approaches is then explored and a path forward is proposed.

Det övergripande syftet med detta projekt har varit att optimera järnvägsunderhållsplanering genom att kombinera statistisk analys av underhållsbehov med modeller för optimerad underhållsplanering. Projektgruppen har arbetat mot syftet via två arbetspaket. Det första arbetspaketet har nyttjat ett datadrivet arbetssätt för att prediktera underhållsbehovet (eller anläggningstillståndet) baserat på tillgängliga spårgeometridata insamlade via mätvagnar. Det andra arbetspaketet har fokuserat på att optimera planering och schemaläggning av underhållsåtgärder för en given sektion och en given tidshorisont, under beaktande av kostnader och säkerhet. De två arbetspaketen har anslutits genom att planering och chemaläggningsmodellering av underhållsåtgärder har baserats på sannolikheten för att geometriavvikelser för ett segment överskrider ett tröskelvärde, exempelvis underhållsgränsen UH1. Detta dokument sammanfattar arbetet och resultaten av de två arbetspaketen och hur de har kombinerats och länkats för att uppnå projektsyftet. I detta projekt användes data från Stambanan genom övre Norrland (del av Malmbanan), bandel 119, dvs. sträckan Boden-Luleå som fallstudieobjekt. Det underhållsarbete som vi har nyttjat för att exemplifiera arbetssättet har varit spårriktning., Samordnad, effektiv planering av järnvägsinfrastrukturunderhåll

Engineering process control and high-dimensional, time-dependent data present great methodological challenges when applying statistical process control (SPC) and design of experiments (DoE) in continuous industrial processes. Process simulators with an ability to mimic these challenges are instrumental in research and education. This article focuses on the revised Tennessee Eastman process simulator providing guidelines for its use as a testbed for SPC and DoE methods. We provide flowcharts that can support new users to get started in the Simulink/Matlab framework, and illustrate how to run stochastic simulations for SPC and DoE applications using the Tennessee Eastman process.