1. Comparative performances of machine learning methods for classifying Crohn Disease patients using genome-wide genotyping data
- Author
-
Romagnoni, A., Jegou, S., Van Steen, K., Wainrib, G., Hugot, J. -P., Peyrin-Biroulet, L., Chamaillard, M., Colombel, J. -F., Cottone, M., D'Amato, M., D'Inca, R., Halfvarson, J., Henderson, P., Karban, A., Kennedy, N. A., Khan, M. A., Lemann, M., Levine, A., Massey, D., Milla, M., S. M. E., Ng, Oikonomou, I., Peeters, H., Proctor, D. D., Rahier, J. -F., Rutgeerts, P., Seibold, F., Stronati, L., Taylor, K. M., Torkvist, L., Ublick, K., Van Limbergen, J., Van Gossum, A., Vatn, M. H., Zhang, H., Zhang, W., Andrews, J. M., Bampton, P. A., Barclay, M., Florin, T. H., Gearry, R., Krishnaprasad, K., Lawrance, I. C., Mahy, G., Montgomery, G. W., Radford-Smith, G., Roberts, R. L., Simms, L. A., Hanigan, K., Croft, A., Amininijad, L., Cleynen, I., Dewit, O., Franchimont, D., Georges, M., Laukens, D., Theatre, E., Vermeire, S., Aumais, G., Baidoo, L., Barrie, A. M., Beck, K., Bernard, E. -J., Binion, D. G., Bitton, A., Brant, S. R., Cho, J. H., Cohen, A., Croitoru, K., Daly, M. J., Datta, L. W., Deslandres, C., Duerr, R. H., Dutridge, D., Ferguson, J., Fultz, J., Goyette, P., Greenberg, G. R., Haritunians, T., Jobin, G., Katz, S., Lahaie, R. G., Mcgovern, D. P., Nelson, L., S. M., Ng, Ning, K., Pare, P., Regueiro, M. D., Rioux, J. D., Ruggiero, E., Schumm, L. P., Schwartz, M., Scott, R., Sharma, Y., Silverberg, M. S., Spears, D., Steinhart, A. H., Stempak, J. M., Swoger, J. M., Tsagarelis, C., Zhang, C., Zhao, H., Aerts, J., Ahmad, T., Arbury, H., Attwood, A., Auton, A., Ball, S. G., Balmforth, A. J., Barnes, C., Barrett, J. C., Barroso, I., Barton, A., Bennett, A. J., Bhaskar, S., Blaszczyk, K., Bowes, J., Brand, O. J., Braund, P. S., Bredin, F., Breen, G., Brown, M. J., Bruce, I. N., Bull, J., Burren, O. S., Burton, J., Byrnes, J., Caesar, S., Cardin, N., Clee, C. M., Coffey, A. J., MC Connell, J., Conrad, D. F., Cooper, J. D., Dominiczak, A. F., Downes, K., Drummond, H. E., Dudakia, D., Dunham, A., Ebbs, B., Eccles, D., Edkins, S., Edwards, C., Elliot, A., Emery, P., Evans, D. M., Evans, G., Eyre, S., Farmer, A., Ferrier, I. N., Flynn, E., Forbes, A., Forty, L., Franklyn, J. A., Frayling, T. M., Freathy, R. M., Giannoulatou, E., Gibbs, P., Gilbert, P., Gordon-Smith, K., Gray, E., Green, E., Groves, C. J., Grozeva, D., Gwilliam, R., Hall, A., Hammond, N., Hardy, M., Harrison, P., Hassanali, N., Hebaishi, H., Hines, S., Hinks, A., Hitman, G. A., Hocking, L., Holmes, C., Howard, E., Howard, P., Howson, J. M. M., Hughes, D., Hunt, S., Isaacs, J. D., Jain, M., Jewell, D. P., Johnson, T., Jolley, J. D., Jones, I. R., Jones, L. A., Kirov, G., Langford, C. F., Lango-Allen, H., Lathrop, G. M., Lee, J., Lee, K. L., Lees, C., Lewis, K., Lindgren, C. M., Maisuria-Armer, M., Maller, J., Mansfield, J., Marchini, J. L., Martin, P., Massey, D. C., Mcardle, W. L., Mcguffin, P., Mclay, K. E., Mcvean, G., Mentzer, A., Mimmack, M. L., Morgan, A. E., Morris, A. P., Mowat, C., Munroe, P. B., Myers, S., Newman, W., Nimmo, E. R., O'Donovan, M. C., Onipinla, A., Ovington, N. R., Owen, M. J., Palin, K., Palotie, A., Parnell, K., Pearson, R., Pernet, D., Perry, J. R., Phillips, A., Plagnol, V., Prescott, N. J., Prokopenko, I., Quail, M. A., Rafelt, S., Rayner, N. W., Reid, D. M., Renwick, A., Ring, S. M., Robertson, N., Robson, S., Russell, E., Clair, D. S., Sambrook, J. G., Sanderson, J. D., Sawcer, S. J., Schuilenburg, H., Scott, C. E., Seal, S., Shaw-Hawkins, S., Shields, B. M., Simmonds, M. J., Smyth, D. J., Somaskantharajah, E., Spanova, K., Steer, S., Stephens, J., Stevens, H. E., Stirrups, K., Stone, M. A., Strachan, D. P., Su, Z., Symmons, D. P. M., Thompson, J. R., Thomson, W., Tobin, M. D., Travers, M. E., Turnbull, C., Vukcevic, D., Wain, L. V., Walker, M., Walker, N. M., Wallace, C., Warren-Perry, M., Watkins, N. A., Webster, J., Weedon, M. N., Wilson, A. G., Woodburn, M., Wordsworth, B. P., Yau, C., Young, A. H., Zeggini, E., Brown, M. A., Burton, P. R., Caulfield, M. J., Compston, A., Farrall, M., Gough, S. C. L., Hall, A. S., Hattersley, A. T., Hill, A. V. S., Mathew, C. G., Pembrey, M., Satsangi, J., Stratton, M. R., Worthington, J., Hurles, M. E., Duncanson, A., Ouwehand, W. H., Parkes, M., Rahman, N., Todd, J. A., Samani, N. J., Kwiatkowski, D. P., Mccarthy, M. I., Craddock, N., Deloukas, P., Donnelly, P., Blackwell, J. M., Bramon, E., Casas, J. P., Corvin, A., Jankowski, J., Markus, H. S., Palmer, C. N., Plomin, R., Rautanen, A., Trembath, R. C., Viswanathan, A. C., Wood, N. W., Spencer, C. C. A., Band, G., Bellenguez, C., Freeman, C., Hellenthal, G., Pirinen, M., Strange, A., Blackburn, H., Bumpstead, S. J., Dronov, S., Gillman, M., Jayakumar, A., Mccann, O. T., Liddle, J., Potter, S. C., Ravindrarajah, R., Ricketts, M., Waller, M., Weston, P., Widaa, S., Whittaker, P., Romagnoni, A., Jegou, S., Van Steen, K., Wainrib, G., Hugot, J. -P., Peyrin-Biroulet, L., Chamaillard, M., Colombel, J. -F., Cottone, M., D'Amato, M., D'Inca, R., Halfvarson, J., Henderson, P., Karban, A., Kennedy, N. A., Khan, M. A., Lemann, M., Levine, A., Massey, D., Milla, M., Ng, S. M. E., Oikonomou, I., Peeters, H., Proctor, D. D., Rahier, J. -F., Rutgeerts, P., Seibold, F., Stronati, L., Taylor, K. M., Torkvist, L., Ublick, K., Van Limbergen, J., Van Gossum, A., Vatn, M. H., Zhang, H., Zhang, W., Andrews, J. M., Bampton, P. A., Barclay, M., Florin, T. H., Gearry, R., Krishnaprasad, K., Lawrance, I. C., Mahy, G., Montgomery, G. W., Radford-Smith, G., Roberts, R. L., Simms, L. A., Hanigan, K., Croft, A., Amininijad, L., Cleynen, I., Dewit, O., Franchimont, D., Georges, M., Laukens, D., Theatre, E., Vermeire, S., Aumais, G., Baidoo, L., Barrie, A. M., Beck, K., Bernard, E. -J., Binion, D. G., Bitton, A., Brant, S. R., Cho, J. H., Cohen, A., Croitoru, K., Daly, M. J., Datta, L. W., Deslandres, C., Duerr, R. H., Dutridge, D., Ferguson, J., Fultz, J., Goyette, P., Greenberg, G. R., Haritunians, T., Jobin, G., Katz, S., Lahaie, R. G., Mcgovern, D. P., Nelson, L., Ng, S. M., Ning, K., Pare, P., Regueiro, M. D., Rioux, J. D., Ruggiero, E., Schumm, L. P., Schwartz, M., Scott, R., Sharma, Y., Silverberg, M. S., Spears, D., Steinhart, A. H., Stempak, J. M., Swoger, J. M., Tsagarelis, C., Zhang, C., Zhao, H., Aerts, J., Ahmad, T., Arbury, H., Attwood, A., Auton, A., Ball, S. G., Balmforth, A. J., Barnes, C., Barrett, J. C., Barroso, I., Barton, A., Bennett, A. J., Bhaskar, S., Blaszczyk, K., Bowes, J., Brand, O. J., Braund, P. S., Bredin, F., Breen, G., Brown, M. J., Bruce, I. N., Bull, J., Burren, O. S., Burton, J., Byrnes, J., Caesar, S., Cardin, N., Clee, C. M., Coffey, A. J., MC Connell, J., Conrad, D. F., Cooper, J. D., Dominiczak, A. F., Downes, K., Drummond, H. E., Dudakia, D., Dunham, A., Ebbs, B., Eccles, D., Edkins, S., Edwards, C., Elliot, A., Emery, P., Evans, D. M., Evans, G., Eyre, S., Farmer, A., Ferrier, I. N., Flynn, E., Forbes, A., Forty, L., Franklyn, J. A., Frayling, T. M., Freathy, R. M., Giannoulatou, E., Gibbs, P., Gilbert, P., Gordon-Smith, K., Gray, E., Green, E., Groves, C. J., Grozeva, D., Gwilliam, R., Hall, A., Hammond, N., Hardy, M., Harrison, P., Hassanali, N., Hebaishi, H., Hines, S., Hinks, A., Hitman, G. A., Hocking, L., Holmes, C., Howard, E., Howard, P., Howson, J. M. M., Hughes, D., Hunt, S., Isaacs, J. D., Jain, M., Jewell, D. P., Johnson, T., Jolley, J. D., Jones, I. R., Jones, L. A., Kirov, G., Langford, C. F., Lango-Allen, H., Lathrop, G. M., Lee, J., Lee, K. L., Lees, C., Lewis, K., Lindgren, C. M., Maisuria-Armer, M., Maller, J., Mansfield, J., Marchini, J. L., Martin, P., Massey, D. C., Mcardle, W. L., Mcguffin, P., Mclay, K. E., Mcvean, G., Mentzer, A., Mimmack, M. L., Morgan, A. E., Morris, A. P., Mowat, C., Munroe, P. B., Myers, S., Newman, W., Nimmo, E. R., O'Donovan, M. C., Onipinla, A., Ovington, N. R., Owen, M. J., Palin, K., Palotie, A., Parnell, K., Pearson, R., Pernet, D., Perry, J. R., Phillips, A., Plagnol, V., Prescott, N. J., Prokopenko, I., Quail, M. A., Rafelt, S., Rayner, N. W., Reid, D. M., Renwick, A., Ring, S. M., Robertson, N., Robson, S., Russell, E., Clair, D. S., Sambrook, J. G., Sanderson, J. D., Sawcer, S. J., Schuilenburg, H., Scott, C. E., Seal, S., Shaw-Hawkins, S., Shields, B. M., Simmonds, M. J., Smyth, D. J., Somaskantharajah, E., Spanova, K., Steer, S., Stephens, J., Stevens, H. E., Stirrups, K., Stone, M. A., Strachan, D. P., Su, Z., Symmons, D. P. M., Thompson, J. R., Thomson, W., Tobin, M. D., Travers, M. E., Turnbull, C., Vukcevic, D., Wain, L. V., Walker, M., Walker, N. M., Wallace, C., Warren-Perry, M., Watkins, N. A., Webster, J., Weedon, M. N., Wilson, A. G., Woodburn, M., Wordsworth, B. P., Yau, C., Young, A. H., Zeggini, E., Brown, M. A., Burton, P. R., Caulfield, M. J., Compston, A., Farrall, M., Gough, S. C. L., Hall, A. S., Hattersley, A. T., Hill, A. V. S., Mathew, C. G., Pembrey, M., Satsangi, J., Stratton, M. R., Worthington, J., Hurles, M. E., Duncanson, A., Ouwehand, W. H., Parkes, M., Rahman, N., Todd, J. A., Samani, N. J., Kwiatkowski, D. P., Mccarthy, M. I., Craddock, N., Deloukas, P., Donnelly, P., Blackwell, J. M., Bramon, E., Casas, J. P., Corvin, A., Jankowski, J., Markus, H. S., Palmer, C. N., Plomin, R., Rautanen, A., Trembath, R. C., Viswanathan, A. C., Wood, N. W., Spencer, C. C. A., Band, G., Bellenguez, C., Freeman, C., Hellenthal, G., Pirinen, M., Strange, A., Blackburn, H., Bumpstead, S. J., Dronov, S., Gillman, M., Jayakumar, A., Mccann, O. T., Liddle, J., Potter, S. C., Ravindrarajah, R., Ricketts, M., Waller, M., Weston, P., Widaa, S., Whittaker, P., Daly, Mark J. [0000-0002-0949-8752], Apollo - University of Cambridge Repository, Hugot, Jean-Pierre [0000-0002-8446-6056], UCL - SSS/IREC/GAEN - Pôle d'Hépato-gastro-entérologie, UCL - (MGD) Service de gastro-entérologie, Romagnoni, A, Jegou, S, VAN STEEN, Kristel, Wainrib, G, Hugot, JP, Peyrin-Biroulet, L, Chamaillard, M, Colombel, JF, Cottone, M, D'Amato, M, D'Inca, R, Halfvarson, J, Henderson, P, Karban, A, Kennedy, NA, Khan, MA, Lemann, M, Levine, A, Massey, D, Milla, M, Ng, SME, Oikonomou, I, Peeters, H, Proctor, DD, Rahier, JF, Rutgeerts, P, Seibold, F, Stronati, L, Taylor, KM, Torkvist, L, Ublick, K, Van Limbergen, J, Van Gossum, A, Vatn, MH, Zhang, H, Zhang, W, Andrews, JM, Bampton, PA, Barclay, M, Florin, TH, Gearry, R, Krishnaprasad, K, Lawrance, IC, Mahy, G, Montgomery, GW, Radford-Smith, G, Roberts, RL, Simms, LA, Hanigan, K, Croft, A, Amininijad, L, Cleynen, I, Dewit, O, Franchimont, D, Georges, M, Laukens, D, Theatre, E, Vermeire, S, Aumais, G, Baidoo, L, Barrie, AM, Beck, K, Bernard, EJ, Binion, DG, Bitton, A, Brant, SR, Cho, JH, Cohen, A, Croitoru, K, Daly, MJ, Datta, LW, Deslandres, C, Duerr, RH, Dutridge, D, Ferguson, J, Fultz, J, Goyette, P, Greenberg, GR, Haritunians, T, Jobin, G, Katz, S, Lahaie, RG, McGovern, DP, Nelson, L, Ng, SM, Ning, K, Pare, P, Regueiro, MD, Rioux, JD, Ruggiero, E, Schumm, LP, Schwartz, M, Scott, R, Sharma, Y, Silverberg, MS, Spears, D, Steinhart, AH, Stempak, JM, Swoger, JM, Tsagarelis, C, Zhang, C, Zhao, HY, AERTS, Jan, Ahmad, T, Arbury, H, Attwood, A, Auton, A, Ball, SG, Balmforth, AJ, Barnes, C, Barrett, JC, Barroso, I, Barton, A, Bennett, AJ, Bhaskar, S, Blaszczyk, K, Bowes, J, Brand, OJ, Braund, PS, Bredin, F, Breen, G, Brown, MJ, Bruce, IN, Bull, J, Burren, OS, Burton, J, Byrnes, J, Caesar, S, Cardin, N, Clee, CM, Coffey, AJ, Mc Connell, J, Conrad, DF, Cooper, JD, Dominiczak, AF, Downes, K, Drummond, HE, Dudakia, D, Dunham, A, Ebbs, B, Eccles, D, Edkins, S, Edwards, C, Elliot, A, Emery, P, Evans, DM, Evans, G, Eyre, S, Farmer, A, Ferrier, IN, Flynn, E, Forbes, A, Forty, L, Franklyn, JA, Frayling, TM, Freathy, RM, Giannoulatou, E, Gibbs, P, Gilbert, P, Gordon-Smith, K, Gray, E, Green, E, Groves, CJ, Grozeva, D, Gwilliam, R, Hall, A, Hammond, N, Hardy, M, Harrison, P, Hassanali, N, Hebaishi, H, Hines, S, Hinks, A, Hitman, GA, Hocking, L, Holmes, C, Howard, E, Howard, P, Howson, JMM, Hughes, D, Hunt, S, Isaacs, JD, Jain, M, Jewell, DP, Johnson, T, Jolley, JD, Jones, IR, Jones, LA, Kirov, G, Langford, CF, Lango-Allen, H, Lathrop, GM, Lee, J, Lee, KL, Lees, C, Lewis, K, Lindgren, CM, Maisuria-Armer, M, Maller, J, Mansfield, J, Marchini, JL, Martin, P, Massey, DCO, McArdle, WL, McGuffin, P, McLay, KE, McVean, G, Mentzer, A, Mimmack, ML, Morgan, AE, Morris, AP, Mowat, C, Munroe, PB, Myers, S, Newman, W, Nimmo, ER, O'Donovan, MC, Onipinla, A, Ovington, NR, Owen, MJ, Palin, K, Palotie, A, Parnell, K, Pearson, R, Pernet, D, Perry, JRB, Phillips, A, Plagnol, V, Prescott, NJ, Prokopenko, I, Quail, MA, Rafelt, S, Rayner, NW, Reid, DM, Renwick, A, Ring, SM, Robertson, N, Robson, S, Russell, E, St Clair, D, Sambrook, JG, Sanderson, JD, Sawcer, SJ, Schuilenburg, H, Scott, CE, Seal, S, Shaw-Hawkins, S, Shields, BM, Simmonds, MJ, Smyth, DJ, Somaskantharajah, E, Spanova, K, Steer, S, Stephens, J, Stevens, HE, Stirrups, K, Stone, MA, Strachan, DP, Su, Z, Symmons, DPM, Thompson, JR, Thomson, W, Tobin, MD, Travers, ME, Turnbull, C, Vukcevic, D, Wain, LV, Walker, M, Walker, NM, Wallace, C, Warren-Perry, M, Watkins, NA, Webster, J, Weedon, MN, Wilson, AG, Woodburn, M, Wordsworth, BP, Yau, C, Young, AH, Zeggini, E, Brown, MA, Burton, PR, Caulfield, MJ, Compston, A, Farrall, M, Gough, SCL, Hall, AS, Hattersley, AT, Hill, AVS, Mathew, CG, Pembrey, M, Satsangi, J, Stratton, MR, Worthington, J, Hurles, ME, Duncanson, A, Ouwehand, WH, Parkes, M, Rahman, N, Todd, JA, Samani, NJ, Kwiatkowski, DP, McCarthy, MI, Craddock, N, Deloukas, P, Donnelly, P, Blackwell, JM, Bramon, E, Casas, JP, Corvin, A, Jankowski, J, Markus, HS, Palmer, CNA, Plomin, R, Rautanen, A, Trembath, RC, Viswanathan, AC, Wood, NW, Spencer, CCA, Band, G, Bellenguez, C, Freeman, C, Hellenthal, G, Pirinen, M, Strange, A, Blackburn, H, Bumpstead, SJ, Dronov, S, Gillman, M, Jayakumar, A, McCann, OT, Liddle, J, Potter, SC, Ravindrarajah, R, Ricketts, M, Waller, M, Weston, P, Widaa, S, Whittaker, P, and Kwiatkowski, D
- Subjects
Male ,692/4020/1503/257/1402 ,Genotype ,Genotyping Techniques ,LOCI ,45/43 ,lcsh:Medicine ,Polymorphism, Single Nucleotide ,Crohn's disease, genetics, genome wide association ,Article ,Deep Learning ,Crohn Disease ,INDEL Mutation ,Genetics research ,Humans ,genetics ,Genetic Predisposition to Disease ,129 ,lcsh:Science ,Alleles ,Science & Technology ,genome wide association ,RISK PREDICTION ,45 ,Models, Genetic ,lcsh:R ,Decision Trees ,692/308/2056 ,ASSOCIATION ,Multidisciplinary Sciences ,Crohn's disease ,Logistic Models ,Nonlinear Dynamics ,ROC Curve ,Area Under Curve ,Science & Technology - Other Topics ,lcsh:Q ,Female ,Neural Networks, Computer ,INFLAMMATORY-BOWEL-DISEASE ,Genome-Wide Association Study - Abstract
Crohn Disease (CD) is a complex genetic disorder for which more than 140 genes have been identified using genome wide association studies (GWAS). However, the genetic architecture of the trait remains largely unknown. The recent development of machine learning (ML) approaches incited us to apply them to classify healthy and diseased people according to their genomic information. The Immunochip dataset containing 18,227 CD patients and 34,050 healthy controls enrolled and genotyped by the international Inflammatory Bowel Disease genetic consortium (IIBDGC) has been re-analyzed using a set of ML methods: penalized logistic regression (LR), gradient boosted trees (GBT) and artificial neural networks (NN). The main score used to compare the methods was the Area Under the ROC Curve (AUC) statistics. The impact of quality control (QC), imputing and coding methods on LR results showed that QC methods and imputation of missing genotypes may artificially increase the scores. At the opposite, neither the patient/control ratio nor marker preselection or coding strategies significantly affected the results. LR methods, including Lasso, Ridge and ElasticNet provided similar results with a maximum AUC of 0.80. GBT methods like XGBoost, LightGBM and CatBoost, together with dense NN with one or more hidden layers, provided similar AUC values, suggesting limited epistatic effects in the genetic architecture of the trait. ML methods detected near all the genetic variants previously identified by GWAS among the best predictors plus additional predictors with lower effects. The robustness and complementarity of the different methods are also studied. Compared to LR, non-linear models such as GBT or NN may provide robust complementary approaches to identify and classify genetic markers. Tis work was supported by Fondation pour la Recherche Médical (ref DEI20151234405) and Investissements d’Avenir programme ANR-11-IDEX-0005-02, Sorbonne Paris Cite, Laboratoire d’excellence INFLAMEX. Te authors thank the students that participated to the wisdom of the crowd exercise.
- Published
- 2019