Back to Search
Start Over
An alternative pruning based approach to unbiased recursive partitioning
- Source :
- Computational Statistics & Data Analysis. 106:90-102
- Publication Year :
- 2017
- Publisher :
- Elsevier BV, 2017.
-
Abstract
- Tree-based methods are a non-parametric modelling strategy that can be used in combination with generalized linear models or Cox proportional hazards models, mostly at an exploratory stage. Their popularity is mainly due to the simplicity of the technique along with the ease in which the resulting model can be interpreted. Variable selection bias from variables with many possible splits or missing values has been identified as one of the problems associated with tree-based methods. A number of unbiased recursive partitioning algorithms have been proposed that avoid this bias by using p -values in the splitting procedure of the algorithm. The final tree is obtained using direct stopping rules (pre-pruning strategy) or by growing a large tree first and pruning it afterwards (post-pruning). Some of the drawbacks of pre-pruned trees based on p -values in the presence of interaction effects and a large number of explanatory variables are discussed, and a simple alternative post-pruning solution is presented that allows the identification of such interactions. The proposed method includes a novel pruning algorithm that uses a false discovery rate (FDR) controlling procedure for the determination of splits corresponding to significant tests. The new approach is demonstrated with simulated and real-life examples.
- Subjects :
- Statistics and Probability
Generalized linear model
False discovery rate
Recursive partitioning
Feature selection
Machine learning
computer.software_genre
01 natural sciences
010104 statistics & probability
0504 sociology
Pruning (decision trees)
0101 mathematics
Mathematics
business.industry
Applied Mathematics
05 social sciences
050401 social sciences methods
Missing data
Computational Mathematics
Tree (data structure)
Computational Theory and Mathematics
Principal variation search
Artificial intelligence
business
Algorithm
computer
Subjects
Details
- ISSN :
- 01679473
- Volume :
- 106
- Database :
- OpenAIRE
- Journal :
- Computational Statistics & Data Analysis
- Accession number :
- edsair.doi...........71a40aa34522fd12bead3aed0079ebb4
- Full Text :
- https://doi.org/10.1016/j.csda.2016.08.011