Search

Motivation: New application areas of survival analysis as for example based on micro-array expression data call for novel tools able to handle high-dimensional data. While classical (semi-) parametric techniques as based on likelihood or partial likelihood functions are omnipresent in clinical studies, they are often inadequate for modelling in case when there are less observations than features in the data. Support vector machines (svms) and extensions are in general found particularly useful for such cases, both conceptually (non-parametric approach), computationally (boiling down to a convex program which can be solved efficiently), theoretically (for its intrinsic relation with learning theory) as well as empirically. This article discusses such an extension of svms which is tuned towards survival data. A particularly useful feature is that this method can incorporate such additional structure as additive models, positivity constraints of the parameters or regression constraints.Results: Besides discussion of the proposed methods, an empirical case study is conducted on both clinical as well as micro-array gene expression data in the context of cancer studies. Results are expressed based on the logrank statistic, concordance index and the hazard ratio. The reported performances indicate that the present method yields better models for high-dimensional data, while it gives results which are comparable to what classical techniques based on a proportional hazard model give for clinical data.Contact: vanya.vanbelle@esat.kuleuven.beSupplementary information: Supplementary data are available at Bioinformatics online. [ABSTRACT FROM PUBLISHER]

The article presents a study which examines whether intravenous contrast ultrasound is superior in determining the difference between benign and malignant adnexal masses with complex ultrasound morphology compared with gray-scale or power Doppler ultrasound. It assesses the intravenous contrast ultrasound characteristics obtained by contrast-tuned imaging (CnTI) and the contrast medium SonoVue. Results show that ultrasound contrast examination is not superior to conventional ultrasound.

Abstract Background Elevated levels of matrix metalloproteinases have been found to associate with poor prognosis in various carcinomas. This study aimed at evaluating plasma levels of MMP1, MMP8 and MMP13 as diagnostic and prognostic markers of breast cancer. Methods A total of 208 breast cancer patients, of which 21 with inflammatory breast cancer, and 42 healthy controls were included. Plasma MMP1, MMP8 and MMP13 levels were measured using ELISA and correlated with clinicopathological characteristics. Results Median plasma MMP1 levels were higher in controls than in breast cancer patients (3.45 vs. 2.01 ng/ml), while no difference was found for MMP8 (10.74 vs. 10.49 ng/ml). ROC analysis for MMP1 revealed an AUC of 0.67, sensitivity of 80% and specificity of 24% at a cut-off value of 4.24 ng/ml. Plasma MMP13 expression could not be detected. No correlation was found between MMP1 and MMP8 levels. We found a trend of lower MMP1 levels with increasing tumour size (p = 0.07); and higher MMP8 levels with premenopausal status (p = 0.06) and NPI (p = 0.04). The median plasma MMP1 (p = 0.02) and MMP8 (p = 0.007) levels in the non-inflammatory breast cancer patients were almost twice as high as those found in the inflammatory breast cancer patients. Intriguingly, plasma MMP8 levels were positively associated with lymph node involvement but showed a negative correlation with the risk of distant metastasis. Both controls and lymph node negative patients (pN0) had lower MMP8 levels than patients with moderate lymph node involvement (pN1, pN2) (p = 0.001); and showed a trend for higher MMP8 levels compared to patients with extensive lymph node involvement (pN3) and a strong predisposition to distant metastasis (p = 0.11). Based on the hypothesis that blood and tissue protein levels are in reverse association, these results suggest that MMP8 in the tumour may have a protective effect against lymph node metastasis. Conclusion In summary, we observed differences in MMP1 and MMP8 plasma levels between healthy controls and breast cancer patients as well as between breast cancer patients. Interestingly, our results suggest that MMP8 may affect the metastatic behaviour of breast cancer cells through protection against lymph node metastasis, underlining the importance of anti-target identification in drug development.

Background: Elevated levels of matrix metalloproteinases have been found to associate with poor prognosis in various carcinomas. This study aimed at evaluating plasma levels of MMP1, MMP8 and MMP13 as diagnostic and prognostic markers of breast cancer.Methods: A total of 208 breast cancer patients, of which 21 with inflammatory breast cancer, and 42 healthy controls were included. Plasma MMP1, MMP8 and MMP13 levels were measured using ELISA and correlated with clinicopathological characteristics.Results: Median plasma MMP1 levels were higher in controls than in breast cancer patients (3.45 vs. 2.01 ng/ml), while no difference was found for MMP8 (10.74 vs. 10.49 ng/ml). ROC analysis for MMP1 revealed an AUC of 0.67, sensitivity of 80% and specificity of 24% at a cut-off value of 4.24 ng/ml. Plasma MMP13 expression could not be detected. No correlation was found between MMP1 and MMP8 levels. We found a trend of lower MMP1 levels with increasing tumour size (p = 0.07); and higher MMP8 levels with premenopausal status (p = 0.06) and NPI (p = 0.04). The median plasma MMP1 (p = 0.02) and MMP8 (p = 0.007) levels in the non-inflammatory breast cancer patients were almost twice as high as those found in the inflammatory breast cancer patients. Intriguingly, plasma MMP8 levels were positively associated with lymph node involvement but showed a negative correlation with the risk of distant metastasis. Both controls and lymph node negative patients (pN0) had lower MMP8 levels than patients with moderate lymph node involvement (pN1, pN2) (p = 0.001); and showed a trend for higher MMP8 levels compared to patients with extensive lymph node involvement (pN3) and a strong predisposition to distant metastasis (p = 0.11). Based on the hypothesis that blood and tissue protein levels are in reverse association, these results suggest that MMP8 in the tumour may have a protective effect against lymph node metastasis.Conclusion: In summary, we observed differences in MMP1 and MMP8 plasma levels between healthy controls and breast cancer patients as well as between breast cancer patients. Interestingly, our results suggest that MMP8 may affect the metastatic behaviour of breast cancer cells through protection against lymph node metastasis, underlining the importance of anti-target identification in drug development. [ABSTRACT FROM AUTHOR]

Over the last decades, clinical decision support systems have been gaining importance. They help clinicians to make effective use of the overload of available information to obtain correct diagnoses and appropriate treatments. However, their power often comes at the cost of a black box model which cannot be interpreted easily. This interpretability is of paramount importance in a medical setting with regard to trust and (legal) responsibility. In contrast, existing medical scoring systems are easy to understand and use, but they are often a simplified rule-of-thumb summary of previous medical experience rather than a well-founded system based on available data. Interval Coded Scoring (ICS) connects these two approaches, exploiting the power of sparse optimization to derive scoring systems from training data. The presented toolbox interface makes this theory easily applicable to both small and large datasets. It contains two possible problem formulations based on linear programming or elastic net. Both allow to construct a model for a binary classification problem and establish risk profiles that can be used for future diagnosis. All of this requires only a few lines of code. ICS differs from standard machine learning through its model consisting of interpretable main effects and interactions. Furthermore, insertion of expert knowledge is possible because the training can be semi-automatic. This allows end users to make a trade-off between complexity and performance based on cross-validation results and expert knowledge. Additionally, the toolbox offers an accessible way to assess classification performance via accuracy and the ROC curve, whereas the calibration of the risk profile can be evaluated via a calibration curve. Finally, the colour-coded model visualization has particular appeal if one wants to apply ICS manually on new observations, as well as for validation by experts in the specific application domains. The validity and applicability of the toolbox is demonstrated by comparing it to standard Machine Learning approaches such as Naive Bayes and Support Vector Machines for several real-life datasets. These case studies on medical problems show its applicability as a decision support system. ICS performs similarly in terms of classification and calibration. Its slightly lower performance is countered by its model simplicity which makes it the method of choice if interpretability is a key issue., Competing Interests: Lieven Billiet and Sabine Van Huffel are affiliated with imec Leuven through a research collaboration., (©2018 Billiet et al.)

Problem Setting: Support vector machines (SVMs) are very popular tools for classification, regression and other problems. Due to the large choice of kernels they can be applied with, a large variety of data can be analysed using these tools. Machine learning thanks its popularity to the good performance of the resulting models. However, interpreting the models is far from obvious, especially when non-linear kernels are used. Hence, the methods are used as black boxes. As a consequence, the use of SVMs is less supported in areas where interpretability is important and where people are held responsible for the decisions made by models., Objective: In this work, we investigate whether SVMs using linear, polynomial and RBF kernels can be explained such that interpretations for model-based decisions can be provided. We further indicate when SVMs can be explained and in which situations interpretation of SVMs is (hitherto) not possible. Here, explainability is defined as the ability to produce the final decision based on a sum of contributions which depend on one single or at most two input variables., Results: Our experiments on simulated and real-life data show that explainability of an SVM depends on the chosen parameter values (degree of polynomial kernel, width of RBF kernel and regularization constant). When several combinations of parameter values yield the same cross-validation performance, combinations with a lower polynomial degree or a larger kernel width have a higher chance of being explainable., Conclusions: This work summarizes SVM classifiers obtained with linear, polynomial and RBF kernels in a single plot. Linear and polynomial kernels up to the second degree are represented exactly. For other kernels an indication of the reliability of the approximation is presented. The complete methodology is available as an R package and two apps and a movie are provided to illustrate the possibilities offered by the method., Competing Interests: The authors have declared that no competing interests exist.

Objective: Risk prediction models can assist clinicians in making decisions. To boost the uptake of these models in clinical practice, it is important that end-users understand how the model works and can efficiently communicate its results. We introduce novel methods for interpretable model visualization., Methods: The proposed visualization techniques are applied to two prediction models from the Framingham Heart Study for the prediction of intermittent claudication and stroke after atrial fibrillation. We represent models using color bars, and visualize the risk estimation process for a specific patient using patient-specific contribution charts., Results: The color-based model representations provide users with an attractive tool to instantly gauge the relative importance of the predictors. The patient-specific representations allow users to understand the relative contribution of each predictor to the patient's estimated risk, potentially providing insightful information on which to base further patient management. Extensions towards non-linear models and interactions are illustrated on an artificial dataset., Conclusion: The proposed methods summarize risk prediction models and risk predictions for specific patients in an alternative way. These representations may facilitate communication between clinicians and patients.

Objective: To propose a new flexible and sparse classifier that results in interpretable decision support systems., Methods: Support vector machines (SVMs) for classification are very powerful methods to obtain classifiers for complex problems. Although the performance of these methods is consistently high and non-linearities and interactions between variables can be handled efficiently when using non-linear kernels such as the radial basis function (RBF) kernel, their use in domains where interpretability is an issue is hampered by their lack of transparency. Many feature selection algorithms have been developed to allow for some interpretation but the impact of the different input variables on the prediction still remains unclear. Alternative models using additive kernels are restricted to main effects, reducing their usefulness in many applications. This paper proposes a new approach to expand the RBF kernel into interpretable and visualizable components, including main and two-way interaction effects. In order to obtain a sparse model representation, an iterative l1-regularized parametric model using the interpretable components as inputs is proposed., Results: Results on toy problems illustrate the ability of the method to select the correct contributions and an improved performance over standard RBF classifiers in the presence of irrelevant input variables. For a 10-dimensional x-or problem, an SVM using the standard RBF kernel obtains an area under the receiver operating characteristic curve (AUC) of 0.947, whereas the proposed method achieves an AUC of 0.997. The latter additionally identifies the relevant components. In a second 10-dimensional artificial problem, the underlying class probability follows a logistic regression model. An SVM with the RBF kernel results in an AUC of 0.975, as apposed to 0.994 for the presented method. The proposed method is applied to two benchmark datasets: the Pima Indian diabetes and the Wisconsin Breast Cancer dataset. The AUC is in both cases comparable to those of the standard method (0.826 versus 0.826 and 0.990 versus 0.996) and those reported in the literature. The selected components are consistent with different approaches reported in other work. However, this method is able to visualize the effect of each of the components, allowing for interpretation of the learned logic by experts in the application domain., Conclusions: This work proposes a new method to obtain flexible and sparse risk prediction models. The proposed method performs as well as a support vector machine using the standard RBF kernel, but has the additional advantage that the resulting model can be interpreted by experts in the application domain., (Copyright © 2013 Elsevier B.V. All rights reserved.)

Study Question: What is the performance of a simple scoring system to predict whether women will have an ongoing viable intrauterine pregnancy beyond the first trimester?, Summary Answer: A simple scoring system using demographic and initial ultrasound variables accurately predicts pregnancy viability beyond the first trimester with an area under the curve (AUC) in a receiver operating characteristic curve of 0.924 [95% confidence interval (CI) 0.900-0.947] on an independent test set., What Is Known Already: Individual demographic and ultrasound factors, such as maternal age, vaginal bleeding and gestational sac size, are strong predictors of miscarriage. Previous mathematical models have combined individual risk factors with reasonable performance. A simple scoring system derived from a mathematical model that can be easily implemented in clinical practice has not previously been described for the prediction of ongoing viability., Study Design, Size and Duration: This was a prospective observational study in a single early pregnancy assessment centre during a 9-month period., Participants/materials, Setting and Methods: A cohort of 1881 consecutive women undergoing transvaginal ultrasound scan at a gestational age <84 days were included. Women were excluded if the first trimester outcome was not known. Demographic features, symptoms and ultrasound variables were tested for their influence on ongoing viability. Logistic regression was used to determine the influence on first trimester viability from demographics and symptoms alone, ultrasound findings alone and then from all the variables combined. Each model was developed on a training data set, and a simple scoring system was derived from this. This scoring system was tested on an independent test data set., Main Results and the Role of Chance: The final outcome based on a total of 1435 participants was an ongoing viable pregnancy in 885 (61.7%) and early pregnancy loss in 550 (38.3%) women. The scoring system using significant demographic variables alone (maternal age and amount of bleeding) to predict ongoing viability gave an AUC of 0.724 (95% CI = 0.692-0.756) in the training set and 0.729 (95% CI = 0.684-0.774) in the test set. The scoring system using significant ultrasound variables alone (mean gestation sac diameter, mean yolk sac diameter and the presence of fetal heart beat) gave an AUC of 0.873 (95% CI = 0.850-0.897) and 0.900 (95% CI = 0.871-0.928) in the training and the test sets, respectively. The final scoring system using demographic and ultrasound variables together gave an AUC of 0.901 (95% CI = 0.881-0.920) and 0.924 (CI = 0.900-0.947) in the training and the test sets, respectively. After defining the cut-off at which the sensitivity is 0.90 on the training set, this model performed with a sensitivity of 0.92, specificity of 0.73, positive predictive value of 84.7% and negative predictive value of 85.4% in the test set., Limitations, Reasons for Caution: BMI and smoking variables were a potential omission in the data collection and might further improve the model performance if included. A further limitation is the absence of information on either bleeding or pain in 18% of women. Caution should be exercised before implementation of this scoring system prior to further external validation studies, Wider Implications of the Findings: This simple scoring system incorporates readily available data that are routinely collected in clinical practice and does not rely on complex data entry. As such it could, unlike most mathematical models, be easily incorporated into normal early pregnancy care, where women may appreciate an individualized calculation of the likelihood of ongoing pregnancy viability., Study Funding/competing Interest(s): Research by V.V.B. supported by Research Council KUL: GOA MaNet, PFV/10/002 (OPTEC), several PhD/postdoc & fellow grants; IWT: TBM070706-IOTA3, PhD Grants; IBBT; Belgian Federal Science Policy Office: IUAP P7/(DYSCO, `Dynamical systems, control and optimization', 2012-2017). T.B. is supported by the Imperial Healthcare NHS Trust NIHR Biomedical Research Centre., Trial Registration Number: Not applicable.

The discriminative ability of risk models for dichotomous outcomes is often evaluated with the concordance index (c-index). However, many medical prediction problems are polytomous, meaning that more than two outcome categories need to be predicted. Unfortunately such problems are often dichotomized in prediction research. We present a perspective on the evaluation of discriminative ability of polytomous risk models, which may instigate researchers to consider polytomous prediction models more often. First, we suggest a "discrimination plot" as a tool to visualize the model's discriminative ability. Second, we discuss the use of one overall polytomous c-index versus a set of dichotomous measures to summarize the performance of the model. Third, we address several aspects to consider when constructing a polytomous c-index. These involve the assessment of concordance in pairs versus sets of patients, weighting by outcome prevalence, the value related to models with random performance, the reduction to the dichotomous c-index for dichotomous problems, and interpretation. We illustrate these issues on case studies dealing with ovarian cancer (four outcome categories) and testicular cancer (three categories). We recommend the use of a discrimination plot together with an overall c-index such as the Polytomous Discrimination Index. If the overall c-index suggests that the model has relevant discriminative ability, pairwise c-indexes for each pair of outcome categories are informative. For pairwise c-indexes we recommend the 'conditional-risk' method which is consistent with the analytical approach of the multinomial logistic regression used to develop polytomous risk models.

Axillary lymph node involvement is an important prognostic factor for breast cancer survival but is confounded by the number of nodes examined. We compare the performance of the log odds prognostic index (Lpi), using a ratio of the positive versus negative lymph nodes, with the Nottingham Prognostic Index (NPI) for short-term breast cancer specific disease free survival. A total of 1818 operable breast cancer patients treated in the University Hospital of Leuven between 2000 and 2005 were included. The performance of the NPI and Lpi were compared on two levels: calibration and discrimination. The latter was evaluated using the concordance index (cindex), the number of patients in the extreme groups, and difference in event rates between these. The NPI had a significant higher cindex, but a significant lower percentage of patients in the extreme risk groups. After updating both indices, no significant differences between NPI and Lpi were noted.