Search

Your search keyword '"Knauer, Ricardo"' showing total 7 results
Start Over Author "Knauer, Ricardo"
7 results on '"Knauer, Ricardo"'

1. 'Oh LLM, I'm Asking Thee, Please Give Me a Decision Tree': Zero-Shot Decision Tree Induction and Embedding with Large Language Models

Author

Knauer, Ricardo, Koddenbrock, Mario, Wallsberger, Raphael, Brisson, Nicholas M., Duda, Georg N., Falla, Deborah, Evans, David W., and Rodner, Erik

Subjects
Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Machine Learning
Abstract

Large language models (LLMs) provide powerful means to leverage prior knowledge for predictive modeling when data is limited. In this work, we demonstrate how LLMs can use their compressed world knowledge to generate intrinsically interpretable machine learning models, i.e., decision trees, without any training data. We find that these zero-shot decision trees can surpass data-driven trees on some small-sized tabular datasets and that embeddings derived from these trees perform on par with data-driven tree-based embeddings on average. Our knowledge-driven decision tree induction and embedding approaches therefore serve as strong new baselines for data-driven machine learning methods in the low-data regime.

Published
2024

2. PMLBmini: A Tabular Classification Benchmark Suite for Data-Scarce Applications

Author

Knauer, Ricardo, Grimm, Marvin, and Rodner, Erik

Subjects
Computer Science - Machine Learning, Computer Science - Artificial Intelligence
Abstract

In practice, we are often faced with small-sized tabular data. However, current tabular benchmarks are not geared towards data-scarce applications, making it very difficult to derive meaningful conclusions from empirical comparisons. We introduce PMLBmini, a tabular benchmark suite of 44 binary classification datasets with sample sizes $\leq$ 500. We use our suite to thoroughly evaluate current automated machine learning (AutoML) frameworks, off-the-shelf tabular deep neural networks, as well as classical linear models in the low-data regime. Our analysis reveals that state-of-the-art AutoML and deep learning approaches often fail to appreciably outperform even a simple logistic regression baseline, but we also identify scenarios where AutoML and deep learning methods are indeed reasonable to apply. Our benchmark suite, available on https://github.com/RicardoKnauer/TabMini , allows researchers and practitioners to analyze their own methods and challenge their data efficiency., Comment: AutoML 2024 Workshop Track

Published
2024

3. Squeezing Lemons with Hammers: An Evaluation of AutoML and Tabular Deep Learning for Data-Scarce Classification Applications

Author

Knauer, Ricardo and Rodner, Erik

Subjects
Computer Science - Machine Learning, Computer Science - Artificial Intelligence
Abstract

Many industry verticals are confronted with small-sized tabular data. In this low-data regime, it is currently unclear whether the best performance can be expected from simple baselines, or more complex machine learning approaches that leverage meta-learning and ensembling. On 44 tabular classification datasets with sample sizes $\leq$ 500, we find that L2-regularized logistic regression performs similar to state-of-the-art automated machine learning (AutoML) frameworks (AutoPrognosis, AutoGluon) and off-the-shelf deep neural networks (TabPFN, HyperFast) on the majority of the benchmark datasets. We therefore recommend to consider logistic regression as the first choice for data-scarce applications with tabular data and provide practitioners with best practices for further method selection., Comment: ICLR 2024 Workshop on Practical ML for Low Resource Settings

Published
2024

4. Cost-Sensitive Best Subset Selection for Logistic Regression: A Mixed-Integer Conic Optimization Perspective

Author

Knauer, Ricardo and Rodner, Erik

Subjects
Computer Science - Artificial Intelligence, Computer Science - Machine Learning
Abstract

A key challenge in machine learning is to design interpretable models that can reduce their inputs to the best subset for making transparent predictions, especially in the clinical domain. In this work, we propose a certifiably optimal feature selection procedure for logistic regression from a mixed-integer conic optimization perspective that can take an auxiliary cost to obtain features into account. Based on an extensive review of the literature, we carefully create a synthetic dataset generator for clinical prognostic model research. This allows us to systematically evaluate different heuristic and optimal cardinality- and budget-constrained feature selection procedures. The analysis shows key limitations of the methods for the low-data regime and when confronted with label noise. Our paper not only provides empirical recommendations for suitable methods and dataset designs, but also paves the way for future research in the area of meta-learning., Comment: German Conference on Artificial Intelligence (K\"unstliche Intelligenz)

Published
2023
Full Text
View/download PDF

6. Deutsche Normungsroadmap Künstliche Intelligenz Ausgabe 2

Author

Adler, Rasmus, Alcala, Araceli, Anton, Marie, Armbruster, Tristan, Arntzen, Stefan, Aschenbrenner, Doris, Klaus-Dieter Axt, Baumgartner, Renate, Becker, Nikolas, Beiter, Rebecca, Bendig, Thomas, Benecke, Ralf, Benner, Philipp, Bernhardt, Bastian, Beyer, Paul, Bich, Karsten, Biehler, Jan, Bieringer, Lukas, Binder, Andreas, Birska, Sylwia, Blum, André, Böhm, John, Bohn, Jürgen, Bollgrün, Patrick, Börkircher, Mikko, Borowski, Kevin, Bracht, Oliver, Brand, Matthias, Buchsbaum, Katharina, Budde, Lena Marie, Bühler, Joachim, Bunte, Andreas, Burchardt, Aljoscha, Burton, Simon, Büttel, Tim, Coester, Ulla, Cremers, Armin B., Czarny, Damian A., Da Silva, Lucas, Dang, David, Däßler, Klaus, De Meer, Jan, Demel, Axel, Deussen, Peter, Dickhaut, Ernestine, Dittrich, Eckhard, Dittrich, Alexander, Khac, Lilian Do, Dotzauer, Felix, Drzyzga, Gilbert, Ebers, Martin, Elmas, Filiz, Elmer, Stefan, Esche, Marko, Fehlandt, Benjamin, Féret, Leander, Fetic, Lajla, Fliehe, Marc, Fligge-Niebling, Julia, Flögel, Werner, Frank, Matthias, Franken, Annika, Fränzle, Martin, Fraunholz, Christian, Frierson, Charlotte, Gauer, Florian, Gause, Clemens, Gautier, Antoine, Gebauer, Marc, Geiger, Bernd, Genovesi, Sergio, Gerst, Detlef, Geschwill, Simon, Gesmann-Nuissl, Dagmar, Glasmeier, Nora Helena, Glatzner, Ludwig, Gnaudschun, Jens, Goebel, Marius, Grau, Dominik, Gromov, Viacheslav, Großmann, Jürgen, Grotepass, Jürgen, Gruchmann, Yvonne, Günther, Norman, Haimerl, Martin, Hattenkofer, Christian, Hauer, Marc, Haufe, Stefan, Heider, Elias, Heiles, Jürgen, Heinemann, Tobias, Hein, Tabea, Heinemann, Claudia, Henseler, Christoph, Hildesheim, Wolfgang, Hilgert, Barbara, Höhndorf, Lukas, Holoyad, Taras, Hösl, Maximilian, Jaschke, Alexander, Jung, Barbara, Just, Vanessa, Kacyniak, Agnieszka, Kaiser, Thomas, Kärkkäinen, Leo, Kiefer, Jan, Kim, So-Jin, Kirsch, Roland, Nils-Olaf Klabunde, Kläs, Michael, Kleen, Philip, Kleinfeld, Anette, Klingel, Anita, Klippert, Jürgen, Kloiber, Julia, Knaak, Mirko, Knauer, David, Knauer, Ricardo, Knaut, Andrea, Knecht, Franz, Knicker, Mario, Knödler, Marco, Knopf, Harry, Köhler, Martin F., Kolf, Christian, Kolliarakis, Georgios, Koska, Christopher, Kosslers, Sebastian, Kossow, Roland, Kothe, Stefan, Kotte, Sebastian, Krafft, Tobias D., Kratzer, Klaus, Kraus, Tom, Krebsz, Markus, Kremer, Tim, Kriegsmann, Sebastian, Kröll, Mirco, Krüger, Antonio, Krüger, Katja, Brandao, Jacques Kruse, Kubes, Tanja, Kuch, Susanne, Kunkel, Stefan, Küttner, Benjamin, Lachenmaier, Jens F., Laible, Holger, Lakermann, Joel, Lang, Fredi, Latniak, Erich, Lederer, Elisa, Legat, Christoph, Lehmhaus, Lorenz, Mahei Manhai Li, Lipka, Michael, Loevenich, Daniel, Lorenz, Jeanette Miriam, Löwen, Ulrich, Ma, Jackie, Maack, Stefan, Mackert, Manuela, Mahr, Sabine, Margreiter, Maximilian, Markert, Karla, Maspfuhl, Oliver, Matthias, Isabel, Matzke, Gerd, Meeß, Henri, Merget, Iris, Meschede, Ralf, Meyer, Martin, Meyer, Olga, Meyne, Sascha, Mihatsch, Alexander, Mirnig, Alexander G., Mockenhaupt, Andreas, Möhlmann, Eike, Mörike, Michael, Müller, Andreas W., Müller, Christian, Nad, Tomislav, Nahler, Gert, Nawroth, Andreas, Neuhüttler, Jens, Neumann-Brosig, Matthias, Neveling, Marc, Nickel, Peter, Niehaus, Jürgen, Nienaber, Reimund, Nöbel, Johannes, Nowack, Antje, O'Sullivan, Shane, Obert, Otto, Ohliger, Ursula, Page, Rebecca, Papenbrock, Jochen, Pechmann, Ludwig, Peifer, Yannick, Pekerman, Robin H., Pentenrieder, Annelie, Peters, Christoph, Petsch, Fabian, Petschick, Katharina, Peylo, Christoph, Pflumm, Daniel, Philipp, Patrick, Pöhls, Heinrich C., Poignée, Frank, Poretschkin, Maximilian, Portier, Martin, Prager, Jens, Putzer, Henrik J., Rabe, Alexander, Rauh, Peter, Reese, Hendrik A., Rehm, Georg, Reinel, Claudia, Rennoch, Alex, Roleff, Klaus, Roscher, Karsten, Rosenthal, Michael, Rösler, Jan, Röttger, Nils, Runze, Gerhard, Ruskowski, Martin, Saerbeck, Martin, Sanner, Peter K., Sawilla, Ingo, Schacht, Mario, Schemel, Peter, Scheurenbrand, Kim Marvin, Schildt, Maximilian, Schirgi, David, Schleipen, Miriam, Schlesinger, Dirk, Schlicker, Nadine, Schmid, Thomas, Michael-Christian Schmidt, Schmidt, Thomas, Schmidt, Christoph, Schmidtke, Jörg, Schmiedchen, Frank, Schmitz, Thorsten, Schneider, Jonas, Schoepe, Detlef, Schröder, Wolfgang M., Schröter, Welf, Schlug, Stephan, Schüßler, Tim, Schütte, Jan Fiete, Schwendicke, Falk, Seeliger, Adrian, Seifert, Eberhard K., Seitz, Jan, Annegrit Seyerlein-Klug, Shahinfar, Fatemeh, Simbeck, Katharina, Skuin, Andreas, Sliwa, Ariana, Spallek, Reiner, Spangenberg, Felix, Sperl, Philip, Spitzer, Patrick, Spreiter, Lucas, Steimers, André, Steininger, Rosmarie, Steinke, Jannis, Stemmer, Mira, Stock, Patricia, Stoll, Julia, Strobel, Christina, Stuch, Oliver, Stürenburg, Johannes, Surdina, Alexandra, Ernö Szivek, Tagiew, Rustam, Ternes, Neal, Terstegen, Sebastian, Tettke, Martin, Traphöner, Ralph, Traschewski, Holk, Treier, Volker, Trippel, Thorsten, Unverricht, Kristina, Usländer, Thomas, Uslar, Mathias, Van Hasselt, Tobias, Veith, Eric MSP, Vijayagopal, Sharan, Vock, Silvia, Vollmer, Thomas, Von Geibler, Justus, Von Twickel, Arndt, Waechter, Sabine, Wagner, Kirsten, Wagner-Stürz, David, Wahl, Siegfried, Wahlster, Wolfgang, Walter, Robert, Waschulzik, Thomas, Waurick, Steffen, Wedel, Marco, Wegener, Dieter, Weicken, Eva, Wenzel, Felix, Westhoven, Martin, Wildpanner, Bernd, Winter, Dorothea, Winter, Johannes, Winter, Mario, Winterhalter, Christoph, Wirjadi, Oliver, Wohlrapp, Sebastian, Wolf, Susanna, Wrobel, Stefan, Wunderle, Alexander, Wutz, Michael, YiJunsong, Jason, Zaunseder, Sebastian, Zehlike, Meike, Zidowitz, Stephan, Ziegler, Wolfgang, Ziehn, Jens, Zillner, Sonja, and Zucker, Bettina

Published
2022
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results