Decision Tree Induction Systems: A Bayesian Analysis
Abstract
Decision tree induction systems are being used for knowledge acquisition in noisy domains. This paper develops a subjective Bayesian interpretation of the task tackled by these systems and the heuristic methods they use. It is argued that decision tree systems implicitly incorporate a prior belief that the simpler (in terms of decision tree complexity) of two hypotheses be preferred, all else being equal, and that they perform a greedy search of the space of decision rules to find one in which there is strong posterior belief. A number of improvements to these systems are then suggested.
- Publication:
-
arXiv e-prints
- Pub Date:
- March 2013
- DOI:
- 10.48550/arXiv.1304.2732
- arXiv:
- arXiv:1304.2732
- Bibcode:
- 2013arXiv1304.2732B
- Keywords:
-
- Computer Science - Artificial Intelligence
- E-Print:
- Appears in Proceedings of the Third Conference on Uncertainty in Artificial Intelligence (UAI1987)