Professional Documents
Culture Documents
INTRODUCTION
TO
MACHNE
LEARNNG
3RD EDTON
ETHEM ALPAYDIN
The MIT Press, 2014
alpaydin@boun.edu.tr
http://www.cmpe.boun.edu.tr/~ethem/i2ml3e
CHAPTER 9:
DECSON TREES
Tree Uses Nodes and Leaves
3
Divide and Conquer
4
Leaves
Classification: Class labels, or proportions
Regression: Numeric; r average, or local fit
K
I m pmi log 2 pmi
i 1
Best Split
6
Error at node m:
1 if x X m : x reaches node m
bm x
0 otherwise
t m t
t
1 b x r
2
Em t
t
gm
b x
t
r g m bm x t
Nm t m
After splitting:
1 if x X mj : x reaches node m and branch j
bmj x
0 otherwise
b x r t t
E 'm
1
j t
t
2
t
t mj
b x
r g mj bmj x gmj t
Nm t mj
Model Selection in Trees
9
Pruning Trees
10
11
Learning Rules
12