- which is faster
- which has better performance
ai-se / caret Goto Github PK
View Code? Open in Web Editor NEWcompare Caret with DE
caret's Introduction
caret's People
Contributors
Watchers
Forkers
zhongbinedencaret's Issues
while waiting for canada...
you could go back to the rig that you know (the one we used for the journal submission) to check if
- try your clustering idea
- clustering the training leads to different tunings for different clusterings
- if yes then cluster the test data (but only AFTER clustering and tuning training) then use tunings from the nearest training cluster to the test cluster
- see if that improves the baseline we reported in the journal paper
- compare de with grid search on your old rig
- for multiple tunings, using a coarse grained grid, then finer grain, then a finer grain
- and as things get finer, grid search gets slower
now you've got some results from (2) from somewhere else? but same or different to my suggestion above?
get caret going
new data split scheme
old one is
train : release 1
tune: release 2
test : release 3
new one is (for DE,GridSearch and Naive)
train+tune : release 1+2, and Cross-Evaluation with StratifiedKfold(make data distribution balance for both training and tuning data )
test: release 3
Try classifier and not regressor
change regressor to classifier and predict binary class label.
with limited evaluation, which is better DE or Caret?
get the rigs run
get two access measures going
- caret paper
- tim's
add AUC evaluation
f1_uniformly_pick
gogogoogogo f1
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.107
Grid_CART Running Time: 0.5204
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 21.1508
Grid_RF Running Time: 144.72
++++++++++++++++++++
DataSet: antV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 3 (-* -- | ), 0.00, 0.03, 0.03, 0.06, 0.09
2 , Naive_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Grid_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
3 , Grid_CART: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
3 , Tuned_CART: Y-Def , 34 , 6 ( --|-- *------ ), 0.21, 0.28, 0.34, 0.34, 0.46
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Tuned_RF: Y-Def , 7 , 2 (----- * | ), 0.02, 0.06, 0.07, 0.08, 0.08
1 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Tuned_CART: Y-Def , 18 , 1 ( --|------ *----- ), 0.11, 0.17, 0.18, 0.18, 0.22
2 , Grid_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 4 (---- * ----- | ), 0.00, 0.04, 0.05, 0.08, 0.13
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Grid_CART: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 19 , 5 ( ----|---- * ), 0.10, 0.18, 0.19, 0.23, 0.23
3 , Grid_RF: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 4 (-- * --- | ), 0.00, 0.03, 0.04, 0.07, 0.10
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_RF: Y-Def , 16 , 0 ( * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Grid_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Tuned_CART: Y-Def , 25 , 1 ( --|------- *---- ), 0.14, 0.24, 0.25, 0.25, 0.31
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 5 (---* --- | ), 0.00, 0.06, 0.06, 0.11, 0.17
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Grid_RF: Y-Def , 31 , 0 ( * ), 0.31, 0.31, 0.31, 0.31, 0.31
3 , Grid_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
3 , Tuned_CART: Y-Def , 48 , 6 ( | ---- *---- ), 0.34, 0.42, 0.48, 0.48, 0.59
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 54 , 3 ( ------- * ---|-- ), 0.47, 0.53, 0.54, 0.56, 0.61
2 , Grid_CART: Y-Def , 59 , 0 ( |* ), 0.59, 0.59, 0.59, 0.59, 0.59
3 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
3 , Tuned_RF: Y-Def , 68 , 2 ( | -- * ), 0.65, 0.67, 0.68, 0.69, 0.69
4 , Grid_RF: Y-Def , 71 , 0 ( | *), 0.71, 0.71, 0.71, 0.71, 0.71
In terms of 3 : the times of better tuners are{'Tuned_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1382
Grid_CART Running Time: 0.5378
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 22.4066
Grid_RF Running Time: 151.8174
++++++++++++++++++++
DataSet: antV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 15 , 0 (* | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Grid_CART: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
3 , Naive_CART: Y-Def , 28 , 0 ( |* ), 0.28, 0.28, 0.28, 0.28, 0.28
3 , Tuned_RF: Y-Def , 28 , 3 ( --- |* ), 0.23, 0.25, 0.28, 0.29, 0.29
4 , Tuned_CART: Y-Def , 38 , 0 ( |-------------*), 0.27, 0.38, 0.38, 0.38, 0.38
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
2 , Tuned_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Grid_CART: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
3 , Tuned_CART: Y-Def , 7 , 0 ( ---|-*----------- ), 0.06, 0.07, 0.07, 0.07, 0.10
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_CART: Y-Def , 63 , 0 ( *| ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 63 , 4 (---- *| ), 0.57, 0.59, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 63 , 0 ( *| ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Tuned_RF: Y-Def , 68 , 4 ( | -- * ), 0.64, 0.65, 0.68, 0.69, 0.69
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_CART: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Tuned_RF: Y-Def , 40 , 5 ( --| * ), 0.34, 0.36, 0.40, 0.41, 0.41
2 , Tuned_CART: Y-Def , 47 , 2 ( |----------- *), 0.37, 0.45, 0.47, 0.47, 0.47
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 26 , 0 (* | ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
2 , Grid_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
3 , Naive_CART: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
3 , Tuned_RF: Y-Def , 43 , 5 ( - | * ), 0.38, 0.39, 0.43, 0.44, 0.44
3 , Tuned_CART: Y-Def , 53 , 0 ( | ------------*), 0.42, 0.53, 0.53, 0.53, 0.53
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 64 , 0 ( * | ), 0.64, 0.64, 0.64, 0.64, 0.64
2 , Tuned_CART: Y-Def , 71 , 5 ( -- | *-- ), 0.66, 0.67, 0.71, 0.72, 0.73
2 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
3 , Tuned_RF: Y-Def , 77 , 1 ( | -- * ), 0.75, 0.76, 0.77, 0.77, 0.78
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1656
Grid_CART Running Time: 0.628
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 24.6358
Grid_RF Running Time: 157.8996
++++++++++++++++++++
DataSet: antV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 (* | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Naive_CART: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Tuned_RF: Y-Def , 48 , 4 ( -| * - ), 0.46, 0.47, 0.48, 0.51, 0.52
2 , Tuned_CART: Y-Def , 59 , 0 ( ------|-------------*), 0.41, 0.59, 0.59, 0.59, 0.59
2 , Grid_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Tuned_RF: Y-Def , 7 , 0 ( *--- | ), 0.07, 0.07, 0.07, 0.07, 0.08
3 , Tuned_CART: Y-Def , 11 , 0 ( ----|------* ), 0.08, 0.11, 0.11, 0.11, 0.11
3 , Grid_CART: Y-Def , 11 , 0 ( | * ), 0.11, 0.11, 0.11, 0.11, 0.11
3 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 60 , 0 ( -|--* ), 0.58, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Tuned_RF: Y-Def , 65 , 1 ( | -- * ), 0.63, 0.64, 0.65, 0.65, 0.65
3 , Grid_RF: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 43 , 0 (* | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Naive_CART: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Tuned_RF: Y-Def , 55 , 1 ( | --* ), 0.54, 0.55, 0.55, 0.57, 0.57
2 , Tuned_CART: Y-Def , 59 , 0 ( ------|-------------*), 0.48, 0.59, 0.59, 0.59, 0.59
2 , Grid_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 49 , 0 (* | ), 0.49, 0.49, 0.49, 0.49, 0.49
1 , Grid_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Naive_CART: Y-Def , 60 , 0 ( * ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Tuned_RF: Y-Def , 63 , 4 ( | - * ), 0.61, 0.62, 0.63, 0.66, 0.66
2 , Tuned_CART: Y-Def , 70 , 0 ( ----|-------------*), 0.57, 0.70, 0.70, 0.70, 0.70
2 , Grid_CART: Y-Def , 70 , 0 ( | *), 0.70, 0.70, 0.70, 0.70, 0.70
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 73 , 0 ( ----* | ), 0.71, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 73 , 0 ( * | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
2 , Tuned_RF: Y-Def , 82 , 1 ( | *), 0.81, 0.81, 0.82, 0.82, 0.82
2 , Grid_RF: Y-Def , 82 , 0 ( | *), 0.82, 0.82, 0.82, 0.82, 0.82
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 3, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.2654
Grid_CART Running Time: 0.673
Naive_RF Running Time: 0.0098
Tuned_RF Running Time: 29.2584
Grid_RF Running Time: 173.5984
++++++++++++++++++++
DataSet: camelV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 30 , 3 (-- *---- | ), 0.26, 0.28, 0.30, 0.31, 0.34
2 , Grid_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34
3 , Grid_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
4 , Tuned_CART: Y-Def , 44 , 1 ( | --- *--- ), 0.41, 0.43, 0.44, 0.44, 0.47
4 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
4 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 1 (- * | ), 0.05, 0.06, 0.07, 0.07, 0.08
1 , Grid_RF: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Grid_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Tuned_CART: Y-Def , 19 , 1 ( | --- *-- ), 0.16, 0.18, 0.19, 0.19, 0.21
2 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_CART: Y-Def , 30 , 5 (- * --- | ), 0.28, 0.29, 0.30, 0.33, 0.35
1 , Grid_CART: Y-Def , 30 , 0 ( * | ), 0.30, 0.30, 0.30, 0.30, 0.30
2 , Naive_RF: Y-Def , 40 , 0 ( * ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_RF: Y-Def , 45 , 2 ( | *------ ), 0.44, 0.44, 0.45, 0.46, 0.51
3 , Grid_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Tuned_CART: Y-Def , 36 , 5 ( * | ), 0.34, 0.34, 0.36, 0.39, 0.39
1 , Tuned_RF: Y-Def , 36 , 1 ( *------ | ), 0.35, 0.35, 0.36, 0.36, 0.38
2 , Grid_RF: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 45 , 4 (--- * ----- | ), 0.41, 0.43, 0.45, 0.47, 0.50
1 , Grid_RF: Y-Def , 50 , 0 ( *| ), 0.50, 0.50, 0.50, 0.50, 0.50
2 , Grid_CART: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
3 , Tuned_CART: Y-Def , 56 , 2 ( | -- * --- ), 0.54, 0.55, 0.56, 0.58, 0.60
3 , Naive_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
3 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 62 , 0 (* | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Tuned_CART: Y-Def , 62 , 1 (* ---- | ), 0.62, 0.62, 0.62, 0.63, 0.65
2 , Grid_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
3 , Tuned_RF: Y-Def , 73 , 0 ( | --* ), 0.72, 0.73, 0.73, 0.73, 0.73
4 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
4 , Grid_RF: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.0036
Tuned_CART Running Time: 0.303
Grid_CART Running Time: 0.8018
Naive_RF Running Time: 0.011
Tuned_RF Running Time: 42.2556
Grid_RF Running Time: 196.8082
++++++++++++++++++++
DataSet: camelV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 25 , 0 (-*--- | ), 0.24, 0.25, 0.25, 0.25, 0.27
1 , Grid_RF: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Naive_RF: Y-Def , 27 , 0 ( * | ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Grid_CART: Y-Def , 31 , 0 ( * | ), 0.31, 0.31, 0.31, 0.31, 0.31
2 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Tuned_CART: Y-Def , 38 , 1 ( ----------|----------* - ), 0.27, 0.38, 0.38, 0.39, 0.40
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 0 (*- | ), 0.06, 0.06, 0.06, 0.06, 0.07
1 , Grid_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 12 , 0 ( *| ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Grid_CART: Y-Def , 12 , 0 ( *| ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Tuned_CART: Y-Def , 16 , 3 ( ------|--- * -- ), 0.10, 0.14, 0.16, 0.17, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 35 , 3 (-* ---- | ), 0.34, 0.35, 0.35, 0.38, 0.40
1 , Grid_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Naive_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
2 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
3 , Naive_RF: Y-Def , 43 , 0 ( |* ), 0.43, 0.43, 0.43, 0.43, 0.43
3 , Tuned_RF: Y-Def , 48 , 2 ( | ---- * - ), 0.45, 0.47, 0.48, 0.49, 0.50
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 31 , 0 (* | ), 0.31, 0.31, 0.31, 0.31, 0.31
2 , Tuned_RF: Y-Def , 33 , 1 ( *------ | ), 0.32, 0.32, 0.33, 0.33, 0.35
2 , Naive_RF: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Grid_CART: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34
3 , Tuned_CART: Y-Def , 37 , 1 ( ------------| *--------- ), 0.32, 0.36, 0.37, 0.37, 0.40
3 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 39 , 0 ( * | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Tuned_RF: Y-Def , 40 , 1 (- *--- | ), 0.38, 0.39, 0.40, 0.40, 0.42
1 , Naive_RF: Y-Def , 42 , 0 ( * | ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Grid_CART: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
2 , Tuned_CART: Y-Def , 52 , 1 ( --------|----------* - ), 0.42, 0.52, 0.52, 0.53, 0.54
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 64 , 0 ( * | ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Tuned_CART: Y-Def , 65 , 1 (---------- *-| ), 0.60, 0.64, 0.65, 0.65, 0.66
1 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 70 , 1 ( | *- ), 0.69, 0.69, 0.70, 0.70, 0.71
3 , Grid_RF: Y-Def , 71 , 0 ( | *), 0.71, 0.71, 0.71, 0.71, 0.71
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1244
Grid_CART Running Time: 0.5684
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 20.9872
Grid_RF Running Time: 147.2596
++++++++++++++++++++
DataSet: ivyV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 12 , 0 (* | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Tuned_RF: Y-Def , 20 , 3 ( -- *- | ), 0.15, 0.17, 0.20, 0.20, 0.22
2 , Grid_RF: Y-Def , 30 , 0 ( * ), 0.30, 0.30, 0.30, 0.30, 0.30
2 , Grid_CART: Y-Def , 30 , 0 ( * ), 0.30, 0.30, 0.30, 0.30, 0.30
3 , Naive_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Tuned_CART: Y-Def , 42 , 8 ( | ---- * - ), 0.32, 0.37, 0.42, 0.45, 0.47
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 1 ( * | ), 0.03, 0.03, 0.04, 0.04, 0.04
2 , Grid_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
3 , Tuned_CART: Y-Def , 13 , 1 ( ----*-|------------- ), 0.10, 0.13, 0.13, 0.14, 0.25
3 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
3 , Naive_CART: Y-Def , 19 , 0 ( | * ), 0.19, 0.19, 0.19, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_CART: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_CART: Y-Def , 30 , 6 (------------ | *---- ), 0.14, 0.25, 0.30, 0.31, 0.34
2 , Grid_RF: Y-Def , 32 , 0 ( | * ), 0.32, 0.32, 0.32, 0.32, 0.32
3 , Tuned_RF: Y-Def , 35 , 4 ( | -* - ), 0.34, 0.35, 0.35, 0.39, 0.40
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 14 , 0 (* | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Tuned_RF: Y-Def , 25 , 3 ( --- *-|- ), 0.21, 0.23, 0.25, 0.26, 0.28
1 , Grid_CART: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Grid_RF: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
2 , Tuned_CART: Y-Def , 36 , 7 ( ---------|--- *- ), 0.19, 0.30, 0.36, 0.37, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 22 , 0 (* | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_RF: Y-Def , 33 , 5 ( --- *- | ), 0.25, 0.29, 0.33, 0.33, 0.36
2 , Grid_CART: Y-Def , 44 , 0 ( |* ), 0.44, 0.44, 0.44, 0.44, 0.44
3 , Grid_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
4 , Naive_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
4 , Tuned_CART: Y-Def , 56 , 7 ( | ------ * - ), 0.45, 0.52, 0.57, 0.59, 0.61
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Grid_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Tuned_CART: Y-Def , 64 , 12 (----- * | --- ), 0.58, 0.62, 0.64, 0.74, 0.76
2 , Naive_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
2 , Grid_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
2 , Tuned_RF: Y-Def , 78 , 4 ( | - *), 0.73, 0.74, 0.78, 0.78, 0.78
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.156
Grid_CART Running Time: 0.6314
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 23.6772
Grid_RF Running Time: 156.5892
++++++++++++++++++++
DataSet: jeditV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 3 (- * --------|------------- ), 0.40, 0.41, 0.43, 0.44, 0.56
1 , Tuned_RF: Y-Def , 46 , 2 ( * -| ), 0.46, 0.46, 0.46, 0.48, 0.49
1 , Naive_RF: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Grid_CART: Y-Def , 49 , 0 ( |* ), 0.49, 0.49, 0.49, 0.49, 0.49
3 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Grid_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Tuned_RF: Y-Def , 8 , 1 (--- *-- | ), 0.06, 0.07, 0.08, 0.08, 0.09
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Tuned_CART: Y-Def , 11 , 6 ( --- |* --- ), 0.07, 0.08, 0.11, 0.14, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 56 , 8 (--------- * | --- ), 0.46, 0.55, 0.57, 0.63, 0.66
2 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_RF: Y-Def , 67 , 1 ( | ---- *-- ), 0.62, 0.66, 0.67, 0.67, 0.70
3 , Grid_CART: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
4 , Grid_RF: Y-Def , 74 , 0 ( | *), 0.74, 0.74, 0.74, 0.74, 0.74
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 52 , 5 (------- *-------- ), 0.43, 0.47, 0.52, 0.52, 0.57
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 55 , 2 ( | -- *-- ), 0.53, 0.54, 0.55, 0.56, 0.57
3 , Grid_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
4 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
4 , Grid_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 57 , 3 (---- * -----|------------- ), 0.54, 0.56, 0.58, 0.59, 0.68
1 , Tuned_RF: Y-Def , 62 , 1 ( -|-* -- ), 0.61, 0.62, 0.62, 0.63, 0.64
1 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Grid_RF: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_CART: Y-Def , 75 , 2 ( ----- * | ), 0.72, 0.74, 0.75, 0.76, 0.76
2 , Grid_CART: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78
3 , Tuned_RF: Y-Def , 82 , 1 ( | * ), 0.82, 0.82, 0.82, 0.83, 0.83
3 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
4 , Grid_RF: Y-Def , 83 , 0 ( | *), 0.83, 0.83, 0.83, 0.83, 0.83
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1596
Grid_CART Running Time: 0.6144
Naive_RF Running Time: 0.0078
Tuned_RF Running Time: 24.1634
Grid_RF Running Time: 156.724
++++++++++++++++++++
DataSet: jeditV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 54 , 0 (* | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
2 , Tuned_CART: Y-Def , 57 , 10 (-- * | ------------ ), 0.54, 0.56, 0.58, 0.66, 0.75
2 , Grid_RF: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58
2 , Tuned_RF: Y-Def , 62 , 2 ( --- * | ), 0.58, 0.60, 0.62, 0.62, 0.62
2 , Naive_CART: Y-Def , 64 , 0 ( *| ), 0.64, 0.64, 0.64, 0.64, 0.64
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 11 , 0 (* | ), 0.11, 0.11, 0.11, 0.11, 0.11
1 , Tuned_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Grid_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
3 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Tuned_CART: Y-Def , 17 , 2 ( | * --------- ), 0.16, 0.16, 0.17, 0.18, 0.21
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 34 , 1 (---- *---- | ), 0.31, 0.33, 0.34, 0.34, 0.36
1 , Naive_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Grid_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_RF: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_RF: Y-Def , 42 , 1 ( | ---* ), 0.41, 0.42, 0.42, 0.43, 0.43
2 , Grid_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 6 (-- * | ), 0.40, 0.41, 0.43, 0.47, 0.47
1 , Grid_CART: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Naive_RF: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Grid_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
2 , Tuned_RF: Y-Def , 50 , 2 ( | --- * ), 0.48, 0.49, 0.50, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_CART: Y-Def , 67 , 0 ( * | ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_CART: Y-Def , 68 , 7 (-- * | -------- ), 0.65, 0.66, 0.68, 0.73, 0.76
2 , Grid_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
2 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
2 , Tuned_RF: Y-Def , 72 , 2 ( -----| * ), 0.69, 0.71, 0.72, 0.73, 0.73
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
2 , Tuned_CART: Y-Def , 75 , 3 ( --* ----|------- ), 0.74, 0.75, 0.75, 0.78, 0.83
3 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
3 , Tuned_RF: Y-Def , 85 , 0 ( | * ), 0.85, 0.85, 0.85, 0.85, 0.85
4 , Grid_RF: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1726
Grid_CART Running Time: 0.601
Naive_RF Running Time: 0.009
Tuned_RF Running Time: 24.4766
Grid_RF Running Time: 159.1112
++++++++++++++++++++
DataSet: jeditV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 45 , 18 (---------* | ), 0.36, 0.45, 0.45, 0.63, 0.63
1 , Tuned_RF: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Grid_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Tuned_CART: Y-Def , 13 , 3 (------------* | --- ), 0.08, 0.13, 0.13, 0.16, 0.17
3 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Grid_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Tuned_CART: Y-Def , 7 , 0 ( *---- | ), 0.07, 0.07, 0.07, 0.07, 0.08
3 , Grid_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
4 , Naive_RF: Y-Def , 10 , 0 ( | * ), 0.10, 0.10, 0.10, 0.10, 0.10
4 , Tuned_RF: Y-Def , 11 , 1 ( | *), 0.10, 0.10, 0.11, 0.11, 0.11
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Tuned_CART: Y-Def , 13 , 1 ( *-| ), 0.12, 0.12, 0.13, 0.13, 0.14
3 , Grid_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
4 , Naive_RF: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
4 , Tuned_RF: Y-Def , 18 , 1 ( | *), 0.17, 0.17, 0.18, 0.18, 0.18
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 59 , 13 (-----------* | ), 0.51, 0.59, 0.59, 0.72, 0.72
1 , Tuned_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Grid_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 63 , 0 ( -*--- | ), 0.62, 0.63, 0.63, 0.63, 0.66
2 , Grid_RF: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
3 , Grid_CART: Y-Def , 67 , 0 ( *| ), 0.67, 0.67, 0.67, 0.67, 0.67
3 , Tuned_CART: Y-Def , 69 , 2 (-------------- | * ), 0.57, 0.67, 0.69, 0.69, 0.70
3 , Naive_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.0954
Grid_CART Running Time: 0.5576
Naive_RF Running Time: 0.0064
Tuned_RF Running Time: 22.6926
Grid_RF Running Time: 141.7976
++++++++++++++++++++
DataSet: log4jV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Grid_CART: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
2 , Grid_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
3 , Tuned_RF: Y-Def , 27 , 1 ( *- | ), 0.26, 0.26, 0.27, 0.27, 0.28
4 , Tuned_CART: Y-Def , 30 , 4 ( ----- *| ---------- ), 0.26, 0.28, 0.30, 0.32, 0.36
4 , Naive_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 12 , 6 ( *----- | ), 0.06, 0.06, 0.12, 0.12, 0.18
1 , Grid_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Tuned_CART: Y-Def , 18 , 19 (----- * | ----- ), 0.06, 0.12, 0.18, 0.31, 0.37
2 , Naive_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
2 , Grid_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 92 , 0 (* | ), 0.92, 0.92, 0.92, 0.92, 0.92
1 , Naive_RF: Y-Def , 93 , 0 ( * | ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_CART: Y-Def , 95 , 4 ( *| ---------- ), 0.92, 0.92, 0.95, 0.96, 0.98
2 , Tuned_RF: Y-Def , 96 , 2 ( ------|---* ), 0.94, 0.96, 0.96, 0.98, 0.98
2 , Grid_RF: Y-Def , 96 , 0 ( | * ), 0.96, 0.96, 0.96, 0.96, 0.96
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 38 , 0 (* | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Grid_CART: Y-Def , 39 , 0 ( * | ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
3 , Tuned_RF: Y-Def , 42 , 0 ( --*- | ), 0.41, 0.42, 0.42, 0.42, 0.43
4 , Tuned_CART: Y-Def , 45 , 5 ( ---- *| -------- ), 0.41, 0.43, 0.45, 0.48, 0.52
4 , Naive_CART: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 37 , 0 (* | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Naive_RF: Y-Def , 37 , 0 (* | ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_RF: Y-Def , 41 , 1 ( ----* |--- ), 0.40, 0.41, 0.41, 0.42, 0.43
3 , Tuned_CART: Y-Def , 43 , 1 ( ------|---* ------ ), 0.40, 0.43, 0.43, 0.44, 0.46
3 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_CART: Y-Def , 53 , 1 (---- *------- | ), 0.49, 0.52, 0.53, 0.53, 0.58
1 , Grid_CART: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 59 , 6 ( -- |* --- ), 0.56, 0.57, 0.59, 0.62, 0.64
2 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Grid_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1334
Grid_CART Running Time: 0.5656
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 23.959
Grid_RF Running Time: 150.5298
++++++++++++++++++++
DataSet: luceneV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 56 , 0 (* | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Tuned_CART: Y-Def , 67 , 23 ( --- * | ), 0.63, 0.66, 0.67, 0.89, 0.89
2 , Grid_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
2 , Tuned_RF: Y-Def , 76 , 1 ( | * ), 0.75, 0.75, 0.76, 0.76, 0.76
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 32 , 0 (* | ), 0.32, 0.32, 0.32, 0.32, 0.32
2 , Grid_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Naive_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
3 , Tuned_RF: Y-Def , 46 , 1 ( *| ), 0.46, 0.46, 0.46, 0.47, 0.48
3 , Tuned_CART: Y-Def , 49 , 21 ( | * ), 0.40, 0.40, 0.49, 0.61, 0.61
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 68 , 2 (---------* |--- ), 0.65, 0.68, 0.68, 0.70, 0.71
1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_RF: Y-Def , 70 , 0 ( --|* ), 0.69, 0.70, 0.70, 0.70, 0.70
2 , Naive_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
2 , Grid_CART: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
3 , Grid_RF: Y-Def , 74 , 0 ( | *), 0.74, 0.74, 0.74, 0.74, 0.74
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 62 , 0 (* | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_CART: Y-Def , 67 , 0 ( * | ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_CART: Y-Def , 69 , 9 ( -------- * | ), 0.64, 0.68, 0.69, 0.77, 0.77
2 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
2 , Tuned_RF: Y-Def , 73 , 0 ( | --* ), 0.72, 0.73, 0.73, 0.73, 0.73
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 55 , 8 ( * | -- ), 0.54, 0.54, 0.55, 0.62, 0.63
1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_RF: Y-Def , 62 , 0 ( |--* ), 0.61, 0.62, 0.62, 0.62, 0.62
1 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Grid_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 66 , 5 (---------------|---- * ), 0.50, 0.65, 0.66, 0.70, 0.70
1 , Grid_CART: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Grid_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
3 , Tuned_RF: Y-Def , 72 , 1 ( | *), 0.71, 0.71, 0.72, 0.72, 0.72
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1282
Grid_CART Running Time: 0.5966
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 25.0464
Grid_RF Running Time: 151.891
++++++++++++++++++++
DataSet: poiV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 6 (* -|-------- ), 0.00, 0.00, 0.00, 0.06, 0.10
1 , Tuned_RF: Y-Def , 0 , 0 (*------------- | ), 0.00, 0.00, 0.00, 0.00, 0.06
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 4 (* -----|----------- ), 0.00, 0.00, 0.00, 0.04, 0.10
1 , Tuned_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.02
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Naive_RF: Y-Def , 6 , 0 ( |* ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Naive_CART: Y-Def , 11 , 0 ( | *), 0.11, 0.11, 0.11, 0.11, 0.11
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Naive_RF: Y-Def , 71 , 0 ( * | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Grid_RF: Y-Def , 87 , 0 ( | * ), 0.87, 0.87, 0.87, 0.87, 0.87
1 , Tuned_CART: Y-Def , 100 , 29 ( ----- | *), 0.63, 0.71, 1.00, 1.00, 1.00
1 , Tuned_RF: Y-Def , 100 , 17 (---------------|--- *), 0.50, 0.83, 1.00, 1.00, 1.00
1 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*--------------| ), 0.00, 0.00, 0.00, 0.00, 0.11
1 , Tuned_CART: Y-Def , 1 , 10 ( * |--------- ), 0.01, 0.01, 0.01, 0.11, 0.17
1 , Grid_CART: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
2 , Grid_RF: Y-Def , 10 , 0 ( *| ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*--------------| ), 0.00, 0.00, 0.00, 0.00, 0.11
1 , Tuned_CART: Y-Def , 1 , 10 ( * |--------- ), 0.01, 0.01, 0.01, 0.11, 0.18
1 , Grid_CART: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
2 , Grid_RF: Y-Def , 10 , 0 ( *| ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 21 , 0 ( | *), 0.21, 0.21, 0.21, 0.21, 0.21
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 3 ( *--------- | ), 0.24, 0.24, 0.27, 0.27, 0.36
2 , Grid_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
3 , Tuned_CART: Y-Def , 48 , 6 ( ---------|------- * ), 0.30, 0.44, 0.48, 0.50, 0.50
3 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
3 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Grid_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 11, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.002
Tuned_CART Running Time: 0.1432
Grid_CART Running Time: 0.6282
Naive_RF Running Time: 0.0084
Tuned_RF Running Time: 22.6276
Grid_RF Running Time: 160.9594
++++++++++++++++++++
DataSet: poiV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Tuned_CART: Y-Def , 26 , 0 ( ----|-----------*- ), 0.11, 0.26, 0.26, 0.26, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
2 , Tuned_CART: Y-Def , 7 , 0 ( ------* | ), 0.04, 0.07, 0.07, 0.07, 0.07
2 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Tuned_CART: Y-Def , 86 , 0 ( | ---* ), 0.79, 0.86, 0.86, 0.86, 0.86
1 , Naive_RF: Y-Def , 92 , 0 ( | *), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Tuned_CART: Y-Def , 40 , 0 ( --|------------* ), 0.19, 0.40, 0.40, 0.40, 0.42
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Naive_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_CART: Y-Def , 41 , 0 ( --|------------* ), 0.19, 0.41, 0.41, 0.41, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 (-------*---- | ), 0.52, 0.59, 0.59, 0.59, 0.64
2 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Grid_CART: Y-Def , 66 , 0 ( *| ), 0.66, 0.66, 0.66, 0.66, 0.66
3 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
3 , Grid_RF: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
3 , Tuned_RF: Y-Def , 80 , 3 ( | *), 0.77, 0.77, 0.80, 0.80, 0.80
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 12, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1126
Grid_CART Running Time: 0.5554
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 18.8766
Grid_RF Running Time: 146.7236
++++++++++++++++++++
DataSet: synapseV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 24 , 2 (-- *- | ), 0.20, 0.22, 0.24, 0.24, 0.25
2 , Grid_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Naive_RF: Y-Def , 27 , 0 ( * | ), 0.27, 0.27, 0.27, 0.27, 0.27
3 , Naive_CART: Y-Def , 31 , 0 ( |* ), 0.31, 0.31, 0.31, 0.31, 0.31
3 , Grid_CART: Y-Def , 32 , 0 ( | * ), 0.32, 0.32, 0.32, 0.32, 0.32
3 , Tuned_CART: Y-Def , 34 , 7 ( -|- * - ), 0.30, 0.32, 0.34, 0.39, 0.40
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 0 (*- | ), 0.04, 0.04, 0.04, 0.04, 0.05
1 , Grid_RF: Y-Def , 4 , 0 (* | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Grid_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_CART: Y-Def , 15 , 11 ( | * ), 0.07, 0.07, 0.15, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 53 , 16 (-- * | - ), 0.50, 0.52, 0.53, 0.68, 0.69
1 , Grid_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
2 , Naive_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
2 , Tuned_RF: Y-Def , 72 , 3 ( | -- * ), 0.67, 0.69, 0.72, 0.72, 0.73
3 , Grid_RF: Y-Def , 74 , 0 ( | *), 0.74, 0.74, 0.74, 0.74, 0.74
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 36 , 3 (-- *- | ), 0.32, 0.33, 0.36, 0.36, 0.37
2 , Naive_CART: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Grid_RF: Y-Def , 39 , 0 ( *| ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Naive_RF: Y-Def , 39 , 0 ( *| ), 0.39, 0.39, 0.39, 0.39, 0.39
3 , Grid_CART: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
3 , Tuned_CART: Y-Def , 45 , 2 ( -----|--------- * ), 0.37, 0.44, 0.45, 0.46, 0.46
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 38 , 3 (- *-- | ), 0.34, 0.35, 0.38, 0.38, 0.40
2 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
2 , Naive_RF: Y-Def , 42 , 0 ( * | ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Naive_CART: Y-Def , 45 , 0 ( |* ), 0.45, 0.45, 0.45, 0.45, 0.45
3 , Grid_CART: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
3 , Tuned_CART: Y-Def , 50 , 5 ( -|---- * - ), 0.44, 0.48, 0.50, 0.53, 0.54
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 64 , 0 ( -------*----|----- ), 0.60, 0.64, 0.64, 0.64, 0.70
1 , Grid_CART: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Tuned_RF: Y-Def , 71 , 1 ( | -* ), 0.70, 0.71, 0.71, 0.72, 0.72
3 , Grid_RF: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 13, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.115
Grid_CART Running Time: 0.5476
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 22.7164
Grid_RF Running Time: 148.0484
++++++++++++++++++++
DataSet: velocityV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Naive_CART: Y-Def , 98 , 0 ( | * ), 0.98, 0.98, 0.98, 0.98, 0.98
1 , Tuned_CART: Y-Def , 100 , 0 (---------------|-------------*), 0.43, 1.00, 1.00, 1.00, 1.00
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
1 , Tuned_CART: Y-Def , 100 , 0 (---------------|-------------*), 0.41, 1.00, 1.00, 1.00, 1.00
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 (* | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_CART: Y-Def , 34 , 0 ( *|------------- ), 0.34, 0.34, 0.34, 0.34, 0.35
1 , Tuned_RF: Y-Def , 34 , 0 ( *| ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Grid_RF: Y-Def , 34 , 0 ( *| ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Grid_CART: Y-Def , 34 , 0 ( *| ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Naive_CART: Y-Def , 35 , 0 ( | *), 0.35, 0.35, 0.35, 0.35, 0.35
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Tuned_CART: Y-Def , 50 , 0 (---------------|-----------* ), 0.38, 0.50, 0.50, 0.50, 0.50
1 , Tuned_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_CART: Y-Def , 51 , 0 ( | *), 0.51, 0.51, 0.51, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|------------- ), 0.00, 0.00, 0.00, 0.00, 0.49
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 46 , 0 (* | ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Tuned_CART: Y-Def , 49 , 1 ( -* ---- | ), 0.48, 0.49, 0.49, 0.50, 0.53
2 , Naive_CART: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
2 , Naive_RF: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
3 , Tuned_RF: Y-Def , 67 , 1 ( | * ), 0.67, 0.67, 0.67, 0.68, 0.68
4 , Grid_RF: Y-Def , 69 , 0 ( | *), 0.69, 0.69, 0.69, 0.69, 0.69
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 14, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1426
Grid_CART Running Time: 0.5648
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 22.9084
Grid_RF Running Time: 154.4694
++++++++++++++++++++
DataSet: xercesV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 13 , 0 (* | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Naive_CART: Y-Def , 23 , 0 ( *| ), 0.23, 0.23, 0.23, 0.23, 0.23
3 , Tuned_CART: Y-Def , 26 , 5 ( | * ---- ), 0.26, 0.26, 0.26, 0.31, 0.34
3 , Tuned_RF: Y-Def , 27 , 1 ( -|-- *- ), 0.23, 0.26, 0.27, 0.27, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 12 , 0 (* | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Grid_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_RF: Y-Def , 16 , 1 ( -------- | * ), 0.13, 0.15, 0.16, 0.16, 0.16
3 , Tuned_CART: Y-Def , 18 , 2 ( | * ), 0.17, 0.17, 0.18, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 15 , 0 (* | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Naive_CART: Y-Def , 21 , 0 ( *| ), 0.21, 0.21, 0.21, 0.21, 0.21
3 , Tuned_CART: Y-Def , 21 , 1 ( --*| ----- ), 0.20, 0.21, 0.21, 0.22, 0.24
3 , Tuned_RF: Y-Def , 22 , 2 ( -- | * ---------- ), 0.20, 0.21, 0.22, 0.23, 0.27
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 14 , 0 (* | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Naive_CART: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22
3 , Tuned_CART: Y-Def , 23 , 3 ( | --* ---- ), 0.22, 0.23, 0.23, 0.26, 0.28
3 , Tuned_RF: Y-Def , 24 , 2 ( -|--- * ------ ), 0.21, 0.23, 0.24, 0.25, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 22 , 0 (* | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Grid_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
3 , Naive_CART: Y-Def , 36 , 0 ( |* ), 0.36, 0.36, 0.36, 0.36, 0.36
3 , Tuned_CART: Y-Def , 39 , 6 ( | * --- ), 0.39, 0.39, 0.39, 0.45, 0.48
3 , Tuned_RF: Y-Def , 41 , 2 ( |--- *-- ), 0.36, 0.39, 0.41, 0.41, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 56 , 3 ( --* | ), 0.55, 0.56, 0.56, 0.59, 0.59
1 , Grid_CART: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Grid_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Tuned_RF: Y-Def , 63 , 0 ( | ----*- ), 0.61, 0.63, 0.63, 0.63, 0.64
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 10, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 15, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1898
Grid_CART Running Time: 0.603
Naive_RF Running Time: 0.0084
Tuned_RF Running Time: 20.7108
Grid_RF Running Time: 163.9304
++++++++++++++++++++
DataSet: xercesV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_RF: Y-Def , 11 , 1 ( ----- *-- | ), 0.07, 0.10, 0.11, 0.11, 0.13
2 , Grid_CART: Y-Def , 11 , 0 ( * | ), 0.11, 0.11, 0.11, 0.11, 0.11
2 , Naive_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
3 , Tuned_CART: Y-Def , 19 , 0 ( |----*-------- ), 0.16, 0.19, 0.19, 0.19, 0.25
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Grid_CART: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Tuned_CART: Y-Def , 2 , 0 ( ----*------|------------- ), 0.01, 0.02, 0.02, 0.02, 0.07
1 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_CART: Y-Def , 5 , 0 ( | * ), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_RF: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
2 , Grid_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_CART: Y-Def , 95 , 0 ( ----|---* ), 0.91, 0.95, 0.95, 0.95, 0.95
3 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 20 , 1 ( ----- *-- | ), 0.14, 0.19, 0.20, 0.20, 0.23
2 , Grid_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
2 , Naive_CART: Y-Def , 24 , 0 ( * | ), 0.24, 0.24, 0.24, 0.24, 0.24
3 , Tuned_CART: Y-Def , 31 , 1 ( |----*-------- ), 0.27, 0.31, 0.31, 0.32, 0.40
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 20 , 1 ( ----- *-- | ), 0.14, 0.19, 0.20, 0.20, 0.23
2 , Grid_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
2 , Naive_CART: Y-Def , 24 , 0 ( * | ), 0.24, 0.24, 0.24, 0.24, 0.24
3 , Tuned_CART: Y-Def , 32 , 0 ( |-----*------- ), 0.27, 0.32, 0.32, 0.32, 0.40
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Grid_RF: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Grid_CART: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
2 , Tuned_CART: Y-Def , 59 , 0 ( |-*----- ), 0.57, 0.59, 0.59, 0.59, 0.64
3 , Tuned_RF: Y-Def , 68 , 2 ( | - * ), 0.66, 0.67, 0.68, 0.69, 0.69
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 11, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 16, 'Grid_RF: Y-Def': 6}
------------------------------------------------------------
Sender: LSF System <lsfadmin@n2d2-2>
Subject: Job 192184: </share3/wfu/miniconda/bin/python2.7 run.py run f1 false> Done
Job </share3/wfu/miniconda/bin/python2.7 run.py run f1 false> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>.
Job was executed on host(s) <n2d2-2>, in queue <serial>, as user <wfu> in cluster <henry2>.
</home/wfu> was used as the home directory.
</home/wfu/Github/Caret> was used as the working directory.
Started at Sun Feb 21 12:29:24 2016
Results reported at Sun Feb 21 16:47:02 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
/share3/wfu/miniconda/bin/python2.7 run.py run f1 false
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 15450.83 sec.
Max Memory : 71 MB
Max Swap : 856 MB
Max Processes : 3
Max Threads : 4
The output (if any) is above this job summary.
PS:
Read file <./err/f1_false.err.192184> for stderr output of this job.
what we concern about Caret?
Speed
evaluation is not available to compare..
High performance
can't compare learners from R and python.
results of 0209 tuning goal is PRECISION
Tuning objective: prec
Begin time: 2016-02-10 04:04:44
Dataset: antV0
------------------------------
The.cart.max_features: 0.84
The.cart.max_depth: 22
The.cart.min_samples_split: 9
The.cart.min_samples_leaf: 1
The.option.threshold: 0.58
evaluation: 60
Tuned_CART Running Time: 3.546
------------------------------
Grid_CART Running Time: 1.081
------------------------------
Naive_CART Running Time: 0.099
------------------------------
The.rf.min_samples_split: 15
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 19
The.rf.n_estimators: 104
The.rf.max_features: 0.16
The.option.threshold: 0.71
evaluation: 70
Tuned_RF Running Time: 20.236
------------------------------
Grid_RF Running Time: 84.373
------------------------------
Naive_RF Running Time: 0.421
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 72 , 0 (* | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Naive_RF: Y-Def , 77 , 0 ( * | ), 0.77, 0.77, 0.77, 0.77, 0.77
1 , Grid_CART: Y-Def , 83 , 0 ( * ), 0.83, 0.83, 0.83, 0.83, 0.83
1 , Tuned_CART: Y-Def , 86 , 0 ( | * ), 0.86, 0.86, 0.86, 0.86, 0.86
1 , Tuned_RF: Y-Def , 91 , 0 ( | * ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Grid_RF: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 43 , 0 (* | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_CART: Y-Def , 59 , 0 ( *| ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_CART: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_RF: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Grid_CART: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Tuned_CART: Y-Def , 91 , 0 ( * | ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Grid_RF: Y-Def , 91 , 0 ( * | ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Naive_RF: Y-Def , 92 , 0 ( *| ), 0.92, 0.92, 0.92, 0.92, 0.92
1 , Tuned_RF: Y-Def , 94 , 0 ( | *), 0.94, 0.94, 0.94, 0.94, 0.94
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 80 , 0 (* | ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Naive_RF: Y-Def , 84 , 0 ( * | ), 0.84, 0.84, 0.84, 0.84, 0.84
1 , Grid_CART: Y-Def , 86 , 0 ( * | ), 0.86, 0.86, 0.86, 0.86, 0.86
1 , Tuned_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_RF: Y-Def , 92 , 0 ( | * ), 0.92, 0.92, 0.92, 0.92, 0.92
1 , Tuned_RF: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 39 , 0 (* | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_CART: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_RF: Y-Def , 69 , 0 ( | *), 0.69, 0.69, 0.69, 0.69, 0.69
End time :2016-02-10 04:06:34
Tuning objective: prec
Begin time: 2016-02-10 04:06:34
Dataset: antV1
------------------------------
The.cart.max_features: 0.01
The.cart.max_depth: 32
The.cart.min_samples_split: 16
The.cart.min_samples_leaf: 12
The.option.threshold: 0.04
evaluation: 60
Tuned_CART Running Time: 5.216
------------------------------
Grid_CART Running Time: 1.269
------------------------------
Naive_CART Running Time: 0.135
------------------------------
The.rf.min_samples_split: 5
The.rf.min_samples_leaf : 6
The.rf.max_leaf_nodes: 18
The.rf.n_estimators: 95
The.rf.max_features: 0.3
The.option.threshold: 0.03
evaluation: 50
Tuned_RF Running Time: 17.401
------------------------------
Grid_RF Running Time: 88.753
------------------------------
Naive_RF Running Time: 0.504
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Naive_RF: Y-Def , 27 , 0 ( * | ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_CART: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Tuned_CART: Y-Def , 95 , 0 ( | * ), 0.95, 0.95, 0.95, 0.95, 0.95
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Grid_CART: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Naive_CART: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Tuned_CART: Y-Def , 91 , 0 ( | * ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Tuned_RF: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 26 , 0 (* | ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Tuned_CART: Y-Def , 27 , 0 (* | ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_CART: Y-Def , 55 , 0 ( * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Grid_CART: Y-Def , 55 , 0 ( * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Grid_RF: Y-Def , 83 , 0 ( | *), 0.83, 0.83, 0.83, 0.83, 0.83
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_CART: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Naive_CART: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Naive_RF: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_CART: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Tuned_RF: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_CART: Y-Def , 28 , 0 ( | * ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_RF: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_CART: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
End time :2016-02-10 04:08:28
Tuning objective: prec
Begin time: 2016-02-10 04:08:28
Dataset: antV2
------------------------------
The.cart.max_features: 0.71
The.cart.max_depth: 46
The.cart.min_samples_split: 9
The.cart.min_samples_leaf: 13
The.option.threshold: 0.67
evaluation: 60
Tuned_CART Running Time: 7.771
------------------------------
Grid_CART Running Time: 1.6
------------------------------
Naive_CART Running Time: 0.219
------------------------------
The.rf.min_samples_split: 15
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 20
The.rf.n_estimators: 122
The.rf.max_features: 0.85
The.option.threshold: 0.95
evaluation: 60
Tuned_RF Running Time: 25.1
------------------------------
Grid_RF Running Time: 95.016
------------------------------
Naive_RF Running Time: 0.76
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Tuned_CART: Y-Def , 11 , 0 ( * | ), 0.11, 0.11, 0.11, 0.11, 0.11
1 , Grid_CART: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Grid_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Naive_RF: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Naive_RF: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_CART: Y-Def , 18 , 0 ( | *), 0.18, 0.18, 0.18, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 42 , 0 (* | ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_RF: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_CART: Y-Def , 68 , 0 ( * | ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_RF: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_CART: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Tuned_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 57 , 0 ( | *), 0.58, 0.58, 0.58, 0.58, 0.58
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Tuned_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Grid_CART: Y-Def , 53 , 0 ( | * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_RF: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 70 , 0 ( | *), 0.70, 0.70, 0.70, 0.70, 0.70
End time :2016-02-10 04:10:38
Tuning objective: prec
Begin time: 2016-02-10 04:10:38
Dataset: camelV0
------------------------------
The.cart.max_features: 0.99
The.cart.max_depth: 43
The.cart.min_samples_split: 20
The.cart.min_samples_leaf: 1
The.option.threshold: 0.72
evaluation: 70
Tuned_CART Running Time: 12.045
------------------------------
Grid_CART Running Time: 2.01
------------------------------
Naive_CART Running Time: 0.277
------------------------------
The.rf.min_samples_split: 6
The.rf.min_samples_leaf : 3
The.rf.max_leaf_nodes: 11
The.rf.n_estimators: 72
The.rf.max_features: 0.44
The.option.threshold: 0.5
evaluation: 70
Tuned_RF Running Time: 31.287
------------------------------
Grid_RF Running Time: 106.362
------------------------------
Naive_RF Running Time: 1.036
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 62 , 0 (* | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 73 , 0 ( * | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 89 , 0 ( | * ), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Grid_RF: Y-Def , 96 , 0 ( | * ), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Tuned_CART: Y-Def , 99 , 0 ( | *), 0.99, 0.99, 0.99, 0.99, 0.99
1 , Tuned_RF: Y-Def , 99 , 0 ( | *), 0.99, 0.99, 0.99, 0.99, 0.99
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 28 , 0 (* | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Grid_CART: Y-Def , 63 , 0 ( *| ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Tuned_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
1 , Tuned_RF: Y-Def , 99 , 0 ( | *), 0.99, 0.99, 0.99, 0.99, 0.99
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 83 , 0 (* | ), 0.83, 0.83, 0.83, 0.83, 0.83
1 , Tuned_RF: Y-Def , 83 , 0 (* | ), 0.83, 0.83, 0.83, 0.83, 0.83
1 , Grid_RF: Y-Def , 86 , 0 ( * | ), 0.86, 0.86, 0.86, 0.86, 0.86
1 , Grid_CART: Y-Def , 87 , 0 ( *| ), 0.87, 0.87, 0.87, 0.87, 0.87
1 , Naive_CART: Y-Def , 89 , 0 ( | * ), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Naive_RF: Y-Def , 91 , 0 ( | *), 0.91, 0.91, 0.91, 0.91, 0.91
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 74 , 0 (* | ), 0.74, 0.74, 0.74, 0.74, 0.74
1 , Naive_CART: Y-Def , 80 , 0 ( * | ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Grid_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Tuned_CART: Y-Def , 90 , 0 ( | * ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Tuned_RF: Y-Def , 90 , 0 ( | * ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Grid_RF: Y-Def , 91 , 0 ( | *), 0.91, 0.91, 0.91, 0.91, 0.91
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Tuned_CART: Y-Def , 2 , 0 (* | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Grid_RF: Y-Def , 37 , 0 ( |* ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Grid_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Naive_RF: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
End time :2016-02-10 04:13:11
Tuning objective: prec
Begin time: 2016-02-10 04:13:11
Dataset: camelV1
------------------------------
The.cart.max_features: 0.13
The.cart.max_depth: 43
The.cart.min_samples_split: 2
The.cart.min_samples_leaf: 7
The.option.threshold: 0.01
evaluation: 60
Tuned_CART Running Time: 15.593
------------------------------
Grid_CART Running Time: 2.66
------------------------------
Naive_CART Running Time: 0.421
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 7
The.rf.max_leaf_nodes: 28
The.rf.n_estimators: 67
The.rf.max_features: 0.38
The.option.threshold: 0.18
evaluation: 60
Tuned_RF Running Time: 37.948
------------------------------
Grid_RF Running Time: 117.867
------------------------------
Naive_RF Running Time: 1.454
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 17 , 0 (* | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Grid_CART: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Naive_CART: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Naive_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Tuned_CART: Y-Def , 93 , 0 ( | * ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Naive_CART: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Grid_CART: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_RF: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Tuned_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Tuned_RF: Y-Def , 94 , 0 ( | *), 0.94, 0.94, 0.94, 0.94, 0.94
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 20 , 0 (* | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Tuned_RF: Y-Def , 20 , 0 (* | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Grid_CART: Y-Def , 31 , 0 ( * | ), 0.31, 0.31, 0.31, 0.31, 0.31
1 , Naive_RF: Y-Def , 33 , 0 ( |* ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Grid_RF: Y-Def , 44 , 0 ( | *), 0.44, 0.44, 0.44, 0.44, 0.44
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Grid_CART: Y-Def , 32 , 0 ( *| ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Tuned_CART: Y-Def , 33 , 0 ( * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_RF: Y-Def , 33 , 0 ( * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_RF: Y-Def , 41 , 0 ( | *), 0.41, 0.41, 0.41, 0.41, 0.41
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Grid_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Grid_CART: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_CART: Y-Def , 53 , 0 ( | * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Naive_RF: Y-Def , 62 , 0 ( | *), 0.62, 0.62, 0.62, 0.62, 0.62
End time :2016-02-10 04:16:07
Tuning objective: prec
Begin time: 2016-02-10 04:16:07
Dataset: ivyV0
------------------------------
The.cart.max_features: 0.99
The.cart.max_depth: 43
The.cart.min_samples_split: 4
The.cart.min_samples_leaf: 7
The.option.threshold: 0.72
evaluation: 50
Tuned_CART Running Time: 3.222
------------------------------
Grid_CART Running Time: 1.11
------------------------------
Naive_CART Running Time: 0.121
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 8
The.rf.max_leaf_nodes: 30
The.rf.n_estimators: 76
The.rf.max_features: 0.5
The.option.threshold: 1
evaluation: 60
Tuned_RF Running Time: 17.241
------------------------------
Grid_RF Running Time: 79.831
------------------------------
Naive_RF Running Time: 0.473
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_RF: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Naive_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Naive_CART: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Grid_CART: Y-Def , 96 , 0 ( | *), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Grid_RF: Y-Def , 97 , 0 ( | *), 0.97, 0.97, 0.97, 0.97, 0.97
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 7 , 0 (* | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Tuned_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 85 , 0 ( | * ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Grid_CART: Y-Def , 90 , 0 ( | *), 0.90, 0.90, 0.90, 0.90, 0.90
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 89 , 0 (* | ), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Grid_CART: Y-Def , 89 , 0 (* | ), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Naive_CART: Y-Def , 91 , 0 ( * | ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Naive_RF: Y-Def , 96 , 0 ( | * ), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Tuned_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97
1 , Tuned_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 67 , 0 (* | ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Tuned_RF: Y-Def , 71 , 0 ( * | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Naive_RF: Y-Def , 81 , 0 ( |* ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Naive_CART: Y-Def , 84 , 0 ( | * ), 0.84, 0.84, 0.84, 0.84, 0.84
1 , Grid_CART: Y-Def , 92 , 0 ( | * ), 0.92, 0.92, 0.92, 0.92, 0.92
1 , Grid_RF: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 18 , 0 (* | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Grid_RF: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Naive_CART: Y-Def , 53 , 0 ( | * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Naive_RF: Y-Def , 73 , 0 ( | *), 0.73, 0.73, 0.73, 0.73, 0.73
End time :2016-02-10 04:17:49
Tuning objective: prec
Begin time: 2016-02-10 04:17:49
Dataset: jeditV0
------------------------------
The.cart.max_features: 0.42
The.cart.max_depth: 22
The.cart.min_samples_split: 13
The.cart.min_samples_leaf: 1
The.option.threshold: 1
evaluation: 80
Tuned_CART Running Time: 7.62
------------------------------
Grid_CART Running Time: 1.327
------------------------------
Naive_CART Running Time: 0.148
------------------------------
The.rf.min_samples_split: 14
The.rf.min_samples_leaf : 7
The.rf.max_leaf_nodes: 35
The.rf.n_estimators: 68
The.rf.max_features: 0.93
The.option.threshold: 0.86
evaluation: 60
Tuned_RF Running Time: 22.732
------------------------------
Grid_RF Running Time: 87.265
------------------------------
Naive_RF Running Time: 0.651
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 48 , 0 (* | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Tuned_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78
1 , Naive_RF: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 7 , 0 (* | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Naive_CART: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Tuned_CART: Y-Def , 17 , 0 ( *| ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Naive_RF: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Tuned_RF: Y-Def , 27 , 0 ( | *), 0.27, 0.27, 0.27, 0.27, 0.27
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 49 , 0 (* | ), 0.49, 0.49, 0.49, 0.49, 0.49
1 , Naive_RF: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Tuned_CART: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_CART: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Grid_RF: Y-Def , 70 , 0 ( | *), 0.70, 0.70, 0.70, 0.70, 0.70
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Tuned_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Grid_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_CART: Y-Def , 67 , 0 ( * | ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Tuned_CART: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
End time :2016-02-10 04:19:49
Tuning objective: prec
Begin time: 2016-02-10 04:19:49
Dataset: jeditV1
------------------------------
The.cart.max_features: 0.71
The.cart.max_depth: 46
The.cart.min_samples_split: 9
The.cart.min_samples_leaf: 16
The.option.threshold: 0.67
evaluation: 50
Tuned_CART Running Time: 5.54
------------------------------
Grid_CART Running Time: 1.421
------------------------------
Naive_CART Running Time: 0.173
------------------------------
The.rf.min_samples_split: 13
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 13
The.rf.n_estimators: 81
The.rf.max_features: 0.98
The.option.threshold: 1
evaluation: 100
Tuned_RF Running Time: 33.838
------------------------------
Grid_RF Running Time: 88.565
------------------------------
Naive_RF Running Time: 0.689
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_RF: Y-Def , 64 , 0 ( * | ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Naive_CART: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_RF: Y-Def , 79 , 0 ( | *), 0.79, 0.79, 0.79, 0.79, 0.79
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Tuned_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_CART: Y-Def , 17 , 0 ( *| ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 24 , 0 ( | *), 0.24, 0.24, 0.24, 0.24, 0.24
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 32 , 0 (* | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Grid_CART: Y-Def , 32 , 0 (* | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Naive_RF: Y-Def , 32 , 0 (* | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Tuned_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Grid_RF: Y-Def , 45 , 0 ( | *), 0.45, 0.45, 0.45, 0.45, 0.45
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 42 , 0 (* | ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_CART: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Naive_RF: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Tuned_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Tuned_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_RF: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 68 , 0 (* | ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Tuned_CART: Y-Def , 71 , 0 ( * | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Naive_CART: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_RF: Y-Def , 73 , 0 ( |* ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Naive_RF: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
End time :2016-02-10 04:21:59
Tuning objective: prec
Begin time: 2016-02-10 04:21:59
Dataset: jeditV2
------------------------------
The.cart.max_features: 0.13
The.cart.max_depth: 1
The.cart.min_samples_split: 6
The.cart.min_samples_leaf: 10
The.option.threshold: 1
evaluation: 60
Tuned_CART Running Time: 7.283
------------------------------
Grid_CART Running Time: 1.478
------------------------------
Naive_CART Running Time: 0.202
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 7
The.rf.max_leaf_nodes: 10
The.rf.n_estimators: 121
The.rf.max_features: 0.94
The.option.threshold: 1
evaluation: 70
Tuned_RF Running Time: 26.99
------------------------------
Grid_RF Running Time: 90.743
------------------------------
Naive_RF Running Time: 0.751
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 27 , 0 (* | ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Tuned_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Grid_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_CART: Y-Def , 15 , 0 ( * ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Tuned_RF: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_RF: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 4 , 0 (* | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Tuned_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_RF: Y-Def , 10 , 0 ( |* ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Tuned_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Naive_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Grid_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Tuned_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 42 , 0 (* | ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Tuned_RF: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_CART: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
End time :2016-02-10 04:24:07
Tuning objective: prec
Begin time: 2016-02-10 04:24:07
Dataset: log4jV0
------------------------------
The.cart.max_features: 0.01
The.cart.max_depth: 24
The.cart.min_samples_split: 2
The.cart.min_samples_leaf: 9
The.option.threshold: 0.01
evaluation: 70
Tuned_CART Running Time: 3.069
------------------------------
Grid_CART Running Time: 0.967
------------------------------
Naive_CART Running Time: 0.071
------------------------------
The.rf.min_samples_split: 13
The.rf.min_samples_leaf : 20
The.rf.max_leaf_nodes: 24
The.rf.n_estimators: 104
The.rf.max_features: 0.01
The.option.threshold: 0.41
evaluation: 90
Tuned_RF Running Time: 24.379
------------------------------
Grid_RF Running Time: 76.028
------------------------------
Naive_RF Running Time: 0.339
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 31 , 0 (* | ), 0.31, 0.31, 0.31, 0.31, 0.31
1 , Tuned_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Naive_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_CART: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_RF: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_CART: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Tuned_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Tuned_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_CART: Y-Def , 22 , 0 ( | *), 0.22, 0.22, 0.22, 0.22, 0.22
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 15 , 0 (* | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_CART: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Tuned_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Tuned_CART: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 36 , 0 (* | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Grid_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Tuned_CART: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_RF: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Tuned_RF: Y-Def , 56 , 0 ( | *), 0.57, 0.57, 0.57, 0.57, 0.57
End time :2016-02-10 04:25:51
Tuning objective: prec
Begin time: 2016-02-10 04:25:51
Dataset: luceneV0
------------------------------
The.cart.max_features: 0.96
The.cart.max_depth: 12
The.cart.min_samples_split: 20
The.cart.min_samples_leaf: 4
The.option.threshold: 0.01
evaluation: 60
Tuned_CART Running Time: 4.647
------------------------------
Grid_CART Running Time: 1.282
------------------------------
Naive_CART Running Time: 0.125
------------------------------
The.rf.min_samples_split: 5
The.rf.min_samples_leaf : 6
The.rf.max_leaf_nodes: 18
The.rf.n_estimators: 95
The.rf.max_features: 0.3
The.option.threshold: 0.03
evaluation: 50
Tuned_RF Running Time: 17.579
------------------------------
Grid_RF Running Time: 86.021
------------------------------
Naive_RF Running Time: 0.761
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_RF: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Grid_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_RF: Y-Def , 69 , 0 ( | *), 0.69, 0.69, 0.69, 0.69, 0.69
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Naive_RF: Y-Def , 21 , 0 ( *| ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_CART: Y-Def , 44 , 0 ( | *), 0.44, 0.44, 0.44, 0.44, 0.44
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 56 , 0 ( | *), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_RF: Y-Def , 57 , 0 ( | *), 0.58, 0.58, 0.58, 0.58, 0.58
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_CART: Y-Def , 52 , 0 ( | * ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Grid_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_RF: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
End time :2016-02-10 04:27:42
Tuning objective: prec
Begin time: 2016-02-10 04:27:42
Dataset: poiV0
------------------------------
The.cart.max_features: 0.45
The.cart.max_depth: 32
The.cart.min_samples_split: 2
The.cart.min_samples_leaf: 7
The.option.threshold: 1
evaluation: 90
Tuned_CART Running Time: 9.376
------------------------------
Grid_CART Running Time: 1.486
------------------------------
Naive_CART Running Time: 0.177
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 7
The.rf.max_leaf_nodes: 40
The.rf.n_estimators: 105
The.rf.max_features: 0.84
The.option.threshold: 1
evaluation: 60
Tuned_RF Running Time: 22.598
------------------------------
Grid_RF Running Time: 90.245
------------------------------
Naive_RF Running Time: 0.639
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_CART: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Naive_CART: Y-Def , 78 , 0 ( *| ), 0.78, 0.78, 0.78, 0.78, 0.78
1 , Grid_CART: Y-Def , 91 , 0 ( | * ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Grid_RF: Y-Def , 96 , 0 ( | *), 0.96, 0.96, 0.96, 0.96, 0.96
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 28 , 0 (* | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_CART: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Grid_CART: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_RF: Y-Def , 91 , 0 ( | *), 0.91, 0.91, 0.91, 0.91, 0.91
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Naive_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Grid_CART: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_CART: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Tuned_RF: Y-Def , 53 , 0 ( | *), 0.53, 0.53, 0.53, 0.53, 0.53
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 47 , 0 (* | ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_CART: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 53 , 0 ( | * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_CART: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Tuned_CART: Y-Def , 56 , 0 ( | *), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Tuned_RF: Y-Def , 56 , 0 ( | *), 0.57, 0.57, 0.57, 0.57, 0.57
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 16 , 0 (* | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Grid_CART: Y-Def , 30 , 0 ( * | ), 0.30, 0.30, 0.30, 0.30, 0.30
1 , Naive_CART: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Naive_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Tuned_RF: Y-Def , 65 , 0 ( | *), 0.65, 0.65, 0.65, 0.65, 0.65
End time :2016-02-10 04:29:46
Tuning objective: prec
Begin time: 2016-02-10 04:29:46
Dataset: poiV1
------------------------------
The.cart.max_features: 0.24
The.cart.max_depth: 12
The.cart.min_samples_split: 5
The.cart.min_samples_leaf: 9
The.option.threshold: 0.3
evaluation: 50
Tuned_CART Running Time: 6.766
------------------------------
Grid_CART Running Time: 1.646
------------------------------
Naive_CART Running Time: 0.194
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 12
The.rf.max_leaf_nodes: 25
The.rf.n_estimators: 74
The.rf.max_features: 0.8
The.option.threshold: 0.13
evaluation: 60
Tuned_RF Running Time: 23.713
------------------------------
Grid_RF Running Time: 95.31
------------------------------
Naive_RF Running Time: 0.791
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 56 , 0 (* | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 75 , 0 ( *| ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Grid_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_RF: Y-Def , 91 , 0 ( | * ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Tuned_CART: Y-Def , 94 , 0 ( | *), 0.94, 0.94, 0.94, 0.94, 0.94
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Naive_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Tuned_RF: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Tuned_CART: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 40 , 0 (* | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Tuned_RF: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Tuned_CART: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 47 , 0 ( * | ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_RF: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_RF: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Grid_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Grid_RF: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Tuned_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 61 , 0 ( | *), 0.61, 0.61, 0.61, 0.61, 0.61
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 38 , 0 (* | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Tuned_CART: Y-Def , 47 , 0 ( * | ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Tuned_RF: Y-Def , 55 , 0 ( |* ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
End time :2016-02-10 04:31:55
Tuning objective: prec
Begin time: 2016-02-10 04:31:55
Dataset: synapseV0
------------------------------
The.cart.max_features: 1
The.cart.max_depth: 32
The.cart.min_samples_split: 16
The.cart.min_samples_leaf: 2
The.option.threshold: 0.95
evaluation: 60
Tuned_CART Running Time: 4.191
------------------------------
Grid_CART Running Time: 1.143
------------------------------
Naive_CART Running Time: 0.095
------------------------------
The.rf.min_samples_split: 10
The.rf.min_samples_leaf : 12
The.rf.max_leaf_nodes: 50
The.rf.n_estimators: 50
The.rf.max_features: 0.56
The.option.threshold: 0.54
evaluation: 80
Tuned_RF Running Time: 23.785
------------------------------
Grid_RF Running Time: 83.672
------------------------------
Naive_RF Running Time: 0.517
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 81 , 0 (* | ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Naive_RF: Y-Def , 85 , 0 ( * | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Grid_CART: Y-Def , 95 , 0 ( | * ), 0.95, 0.95, 0.95, 0.95, 0.95
1 , Grid_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97
1 , Tuned_RF: Y-Def , 98 , 0 ( | * ), 0.98, 0.98, 0.98, 0.98, 0.98
1 , Tuned_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 53 , 0 (* | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Naive_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Grid_CART: Y-Def , 76 , 0 ( |* ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Grid_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Tuned_CART: Y-Def , 96 , 0 ( | *), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Tuned_RF: Y-Def , 96 , 0 ( | *), 0.96, 0.96, 0.96, 0.96, 0.96
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 67 , 0 ( * | ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Grid_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Grid_CART: Y-Def , 71 , 0 ( |* ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Naive_RF: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 76 , 0 (* | ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Tuned_RF: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Tuned_CART: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Naive_RF: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Grid_RF: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_CART: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Tuned_RF: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Grid_RF: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Grid_CART: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Naive_CART: Y-Def , 52 , 0 ( | * ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
End time :2016-02-10 04:33:48
Tuning objective: prec
Begin time: 2016-02-10 04:33:48
Dataset: velocityV0
------------------------------
The.cart.max_features: 0.04
The.cart.max_depth: 27
The.cart.min_samples_split: 18
The.cart.min_samples_leaf: 8
The.option.threshold: 0.22
evaluation: 50
Tuned_CART Running Time: 3.731
------------------------------
Grid_CART Running Time: 1.254
------------------------------
Naive_CART Running Time: 0.117
------------------------------
The.rf.min_samples_split: 15
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 27
The.rf.n_estimators: 122
The.rf.max_features: 0.24
The.option.threshold: 0.95
evaluation: 50
Tuned_RF Running Time: 17.678
------------------------------
Grid_RF Running Time: 85.534
------------------------------
Naive_RF Running Time: 0.542
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Grid_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Tuned_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Grid_CART: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Tuned_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Grid_CART: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 75 , 0 (* | ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_CART: Y-Def , 79 , 0 ( * | ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Tuned_RF: Y-Def , 84 , 0 ( * | ), 0.84, 0.84, 0.84, 0.84, 0.84
1 , Naive_RF: Y-Def , 89 , 0 ( |* ), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Grid_RF: Y-Def , 95 , 0 ( | * ), 0.95, 0.95, 0.95, 0.95, 0.95
1 , Tuned_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Grid_RF: Y-Def , 23 , 0 ( * | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Tuned_RF: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Grid_RF: Y-Def , 23 , 0 ( * | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Tuned_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_RF: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_CART: Y-Def , 53 , 0 ( | *), 0.53, 0.53, 0.53, 0.53, 0.53
End time :2016-02-10 04:35:37
Tuning objective: prec
Begin time: 2016-02-10 04:35:37
Dataset: xercesV0
------------------------------
The.cart.max_features: 0.27
The.cart.max_depth: 4
The.cart.min_samples_split: 11
The.cart.min_samples_leaf: 2
The.option.threshold: 0.83
evaluation: 60
Tuned_CART Running Time: 6.673
------------------------------
Grid_CART Running Time: 1.4
------------------------------
Naive_CART Running Time: 0.199
------------------------------
The.rf.min_samples_split: 18
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 11
The.rf.n_estimators: 117
The.rf.max_features: 0.94
The.option.threshold: 1
evaluation: 80
Tuned_RF Running Time: 28.242
------------------------------
Grid_RF Running Time: 90.077
------------------------------
Naive_RF Running Time: 0.606
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 14 , 0 (* | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Grid_CART: Y-Def , 23 , 0 ( * | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Naive_CART: Y-Def , 24 , 0 ( * | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Tuned_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Tuned_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 7 , 0 (* | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_CART: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 19 , 0 ( * | ), 0.19, 0.19, 0.19, 0.19, 0.19
1 , Naive_RF: Y-Def , 19 , 0 ( * | ), 0.19, 0.19, 0.19, 0.19, 0.19
1 , Tuned_CART: Y-Def , 39 , 0 ( | *), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Tuned_RF: Y-Def , 40 , 0 ( | *), 0.40, 0.40, 0.40, 0.40, 0.40
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 14 , 0 (* | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Tuned_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Naive_CART: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Grid_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Grid_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_RF: Y-Def , 28 , 0 ( | *), 0.29, 0.29, 0.29, 0.29, 0.29
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 18 , 0 (* | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Tuned_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Tuned_RF: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 34 , 0 ( | *), 0.34, 0.34, 0.34, 0.34, 0.34
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 25 , 0 (* | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Grid_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Tuned_CART: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Tuned_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_RF: Y-Def , 56 , 0 ( | *), 0.56, 0.56, 0.56, 0.56, 0.56
End time :2016-02-10 04:37:44
Tuning objective: prec
Begin time: 2016-02-10 04:37:44
Dataset: xercesV1
------------------------------
The.cart.max_features: 0.84
The.cart.max_depth: 1
The.cart.min_samples_split: 15
The.cart.min_samples_leaf: 1
The.option.threshold: 0.45
evaluation: 60
Tuned_CART Running Time: 9.719
------------------------------
Grid_CART Running Time: 1.7
------------------------------
Naive_CART Running Time: 0.252
------------------------------
The.rf.min_samples_split: 20
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 33
The.rf.n_estimators: 122
The.rf.max_features: 0.24
The.option.threshold: 0.95
evaluation: 60
Tuned_RF Running Time: 27.392
------------------------------
Grid_RF Running Time: 97.857
------------------------------
Naive_RF Running Time: 0.854
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 75 , 0 (* | ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 77 , 0 ( * | ), 0.77, 0.77, 0.77, 0.77, 0.77
1 , Tuned_RF: Y-Def , 96 , 0 ( | * ), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Grid_CART: Y-Def , 99 , 0 ( | * ), 0.99, 0.99, 0.99, 0.99, 0.99
1 , Tuned_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Naive_CART: Y-Def , 76 , 0 ( * | ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Grid_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Tuned_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97
1 , Grid_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97
1 , Tuned_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 25 , 0 (* | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Tuned_RF: Y-Def , 25 , 0 (* | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Tuned_CART: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_RF: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_CART: Y-Def , 27 , 0 ( | *), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_RF: Y-Def , 27 , 0 ( | *), 0.27, 0.27, 0.27, 0.27, 0.27
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 38 , 0 (* | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Naive_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Tuned_CART: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Grid_RF: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Grid_CART: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Tuned_RF: Y-Def , 4 , 0 (* | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_RF: Y-Def , 41 , 0 ( | *), 0.41, 0.41, 0.41, 0.41, 0.41
End time :2016-02-10 04:40:02
Compare DE with actual Caret with their data
R learner + their data
DE vs GridSearch
Settings
Training data should be the same for both techniques, since GridSearch using cross evaluaiton with strafitied sampling, then we need to modify our DE traning data sets as well.
- GridSearch:
- Training data: release1+release2(2-fold CrossEvaluation with stratified sampling to split data.)
- Testing data: release3
- generate grid policy: (eg: number_estimators: [50~150])
- randomly pick 3 values for each parameter within given range(e.g:number_estimators:[68,90,133])
- uniformly pick 3 values for each parameter within given range(e.g: nubmer_estimators:[50,100,150])
- DE:
- Training data: release1+release2(stratified sampling the data into new_train and new_tuning)
- Testing data: release3
Results
Scores
Totally we have 17 experiments, the red numbers show the total number of highest scores occured between DE and GridSearch.
Running time:
Generally, DE is much faster than GridSearch, 5 times faster given current grid selection policy
DE usually run 60~100 evaluations, but GridSearch runs 2x3^4=162 evaluations for CART, 2x3^5 = 488 for RF(2 is because of 2-fold cross evaluation).
More details
Tuning goal: auc, GridSearch: randomly pick
Tuning goal: auc, GridSearch: uniformly pick
Tuning goal: precision, GridSearch: randomly pick
Tuning goal: precision, GridSearch: uniformly pick
Tuning goal: f1, GridSearch: randomly pick
Tuning goal: f1, GridSearch: uniformly pick
Conclusion
- DE is better in terms of scores
- DE is faster in terms of running time, and also evaluation numbers.
- But sometimes Tuning is not better than default parameters.
auc_uniformly_pick
gogogoogogo auc
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1152
Grid_CART Running Time: 0.6336
Naive_RF Running Time: 0.0088
Tuned_RF Running Time: 26.192
Grid_RF Running Time: 176.1336
++++++++++++++++++++
DataSet: antV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 21 (* | ---- ), 0.00, 0.00, 0.00, 0.21, 0.25
1 , Tuned_RF: Y-Def , 0 , 6 (* ------- | ), 0.00, 0.00, 0.00, 0.06, 0.12
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 12 , 0 ( *| ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 9 (* -|------- ), 0.00, 0.00, 0.00, 0.09, 0.14
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 5 , 10 ( * |-- ), 0.00, 0.00, 0.05, 0.10, 0.11
1 , Naive_RF: Y-Def , 9 , 0 ( *| ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Naive_CART: Y-Def , 18 , 0 ( | *), 0.18, 0.18, 0.18, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 17 (* | ------ ), 0.00, 0.00, 0.00, 0.17, 0.22
1 , Tuned_RF: Y-Def , 0 , 6 (* -------| ), 0.00, 0.00, 0.00, 0.06, 0.12
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 20 (* | -- ), 0.00, 0.00, 0.00, 0.20, 0.22
1 , Tuned_RF: Y-Def , 0 , 6 (* -------| ), 0.00, 0.00, 0.00, 0.06, 0.12
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 35 (* | -- ), 0.00, 0.00, 0.00, 0.35, 0.38
1 , Tuned_RF: Y-Def , 0 , 11 (* -------| ), 0.00, 0.00, 0.00, 0.11, 0.21
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 21 , 0 ( |* ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 62 , 0 ( *| ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Tuned_RF: Y-Def , 67 , 10 ( |- * --- ), 0.64, 0.65, 0.67, 0.75, 0.79
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_CART: Y-Def , 74 , 4 ( | - *-- ), 0.69, 0.71, 0.74, 0.75, 0.77
3 , Grid_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 5 : the times of better tuners are{'Tuned_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1466
Grid_CART Running Time: 0.6328
Naive_RF Running Time: 0.0088
Tuned_RF Running Time: 27.594
Grid_RF Running Time: 181.245
++++++++++++++++++++
DataSet: antV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 10 (* --------|---- ), 0.00, 0.00, 0.00, 0.10, 0.26
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Tuned_CART: Y-Def , 18 , 20 ( *|------------- ), 0.00, 0.00, 0.18, 0.20, 0.38
1 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 1 (* -------- | ), 0.00, 0.00, 0.00, 0.01, 0.03
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_CART: Y-Def , 4 , 5 ( | * -------- ), 0.00, 0.00, 0.04, 0.05, 0.07
2 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( | * ), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 66 (* | - ), 0.00, 0.00, 0.00, 0.66, 0.70
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 56 , 57 ( | *- ), 0.00, 0.00, 0.57, 0.58, 0.63
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 18 (* ----|-------- ), 0.00, 0.00, 0.00, 0.18, 0.38
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 26 , 0 ( |* ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Tuned_CART: Y-Def , 28 , 30 ( | * ---------- ), 0.00, 0.00, 0.28, 0.30, 0.47
1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 19 (* -----|------- ), 0.00, 0.00, 0.00, 0.19, 0.41
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.29, 0.29, 0.29, 0.29, 0.29
2 , Tuned_CART: Y-Def , 30 , 33 ( |* ----------- ), 0.00, 0.00, 0.30, 0.33, 0.53
2 , Naive_CART: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Tuned_CART: Y-Def , 67 , 5 ( * --| ), 0.65, 0.65, 0.67, 0.70, 0.72
1 , Naive_RF: Y-Def , 71 , 0 ( *| ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Grid_RF: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
2 , Tuned_RF: Y-Def , 82 , 1 ( | - *), 0.80, 0.81, 0.82, 0.82, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0018
Tuned_CART Running Time: 0.1632
Grid_CART Running Time: 0.6758
Naive_RF Running Time: 0.0098
Tuned_RF Running Time: 24.7478
Grid_RF Running Time: 189.2922
++++++++++++++++++++
DataSet: antV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 19 , 9 ( *--------|-------- ), 0.11, 0.11, 0.19, 0.20, 0.40
1 , Grid_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Tuned_RF: Y-Def , 34 , 12 ( -------|-- * ), 0.21, 0.33, 0.34, 0.45, 0.45
2 , Grid_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 1 , 3 (* --------|----------- ), 0.01, 0.01, 0.01, 0.04, 0.12
1 , Grid_RF: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Tuned_RF: Y-Def , 3 , 4 ( * | ), 0.02, 0.02, 0.03, 0.06, 0.06
2 , Grid_CART: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_CART: Y-Def , 63 , 6 (--------- *|------------- ), 0.48, 0.58, 0.63, 0.63, 0.78
1 , Grid_CART: Y-Def , 65 , 0 ( |* ), 0.65, 0.65, 0.65, 0.65, 0.65
2 , Tuned_RF: Y-Def , 72 , 8 ( | * --- ), 0.66, 0.66, 0.72, 0.74, 0.77
3 , Grid_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 30 , 11 ( *-----|----- ), 0.19, 0.19, 0.30, 0.30, 0.44
1 , Grid_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34
2 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
2 , Tuned_RF: Y-Def , 46 , 8 ( ----|-------* ), 0.32, 0.46, 0.46, 0.54, 0.54
2 , Naive_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Grid_CART: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 32 , 13 ( *------|--------- ), 0.20, 0.20, 0.32, 0.33, 0.55
1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Naive_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
2 , Tuned_RF: Y-Def , 50 , 12 ( -----|-----* ), 0.34, 0.49, 0.50, 0.61, 0.61
2 , Grid_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
2 , Naive_CART: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Tuned_CART: Y-Def , 77 , 2 ( | --* -- ), 0.76, 0.77, 0.77, 0.79, 0.80
2 , Grid_CART: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
3 , Tuned_RF: Y-Def , 82 , 0 ( | *), 0.82, 0.82, 0.82, 0.82, 0.82
3 , Grid_RF: Y-Def , 82 , 0 ( | *), 0.82, 0.82, 0.82, 0.82, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0028
Tuned_CART Running Time: 0.2608
Grid_CART Running Time: 0.7648
Naive_RF Running Time: 0.0116
Tuned_RF Running Time: 28.6218
Grid_RF Running Time: 205.6206
++++++++++++++++++++
DataSet: camelV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 4 ( *-- | ), 0.00, 0.00, 0.03, 0.04, 0.08
2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Grid_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
4 , Tuned_CART: Y-Def , 41 , 5 ( | * ), 0.41, 0.41, 0.41, 0.46, 0.46
4 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
4 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
3 , Naive_RF: Y-Def , 13 , 0 ( |* ), 0.13, 0.13, 0.13, 0.13, 0.13
3 , Grid_CART: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14
4 , Tuned_CART: Y-Def , 19 , 0 ( | -* ), 0.18, 0.19, 0.19, 0.19, 0.19
4 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_CART: Y-Def , 30 , 1 ( * | ), 0.29, 0.30, 0.30, 0.31, 0.32
1 , Grid_CART: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Naive_RF: Y-Def , 40 , 0 ( *| ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Grid_RF: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Tuned_RF: Y-Def , 70 , 72 ( | *--- ), 0.00, 0.00, 0.70, 0.72, 0.83
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 9 ( * ---- | ), 0.00, 0.00, 0.06, 0.09, 0.15
2 , Grid_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
3 , Grid_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
4 , Tuned_CART: Y-Def , 35 , 3 ( | *- ), 0.34, 0.34, 0.35, 0.37, 0.38
4 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
4 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 9 ( * --- | ), 0.00, 0.00, 0.06, 0.09, 0.16
2 , Grid_RF: Y-Def , 30 , 0 ( *| ), 0.30, 0.30, 0.30, 0.30, 0.30
3 , Grid_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
4 , Tuned_CART: Y-Def , 54 , 3 ( | * ), 0.54, 0.54, 0.54, 0.58, 0.58
4 , Naive_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
4 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Tuned_CART: Y-Def , 66 , 2 ( ---- * | ), 0.63, 0.65, 0.66, 0.67, 0.67
3 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
3 , Tuned_RF: Y-Def , 75 , 1 ( | --* ), 0.74, 0.75, 0.75, 0.76, 0.76
4 , Grid_RF: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 3, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.0038
Tuned_CART Running Time: 0.305
Grid_CART Running Time: 0.9108
Naive_RF Running Time: 0.0136
Tuned_RF Running Time: 34.436
Grid_RF Running Time: 232.5146
++++++++++++++++++++
DataSet: camelV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 18 , 0 (* | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Tuned_RF: Y-Def , 22 , 1 ( -- * | ), 0.20, 0.21, 0.22, 0.22, 0.23
1 , Grid_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Naive_RF: Y-Def , 27 , 0 ( * ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Tuned_CART: Y-Def , 32 , 9 ( --- | *--- ), 0.21, 0.23, 0.32, 0.32, 0.34
2 , Naive_CART: Y-Def , 35 , 0 ( | *), 0.35, 0.35, 0.35, 0.35, 0.35
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 1 (* | ), 0.05, 0.05, 0.05, 0.06, 0.06
1 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Grid_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
3 , Tuned_CART: Y-Def , 11 , 3 ( ------| * --- ), 0.08, 0.10, 0.11, 0.13, 0.14
3 , Naive_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 37 , 2 (- *---------| ), 0.34, 0.35, 0.37, 0.37, 0.42
1 , Grid_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Naive_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
2 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
2 , Grid_RF: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44
3 , Tuned_RF: Y-Def , 47 , 1 ( | --------* -- ), 0.43, 0.47, 0.47, 0.48, 0.49
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Tuned_RF: Y-Def , 30 , 3 ( -- * | ), 0.28, 0.29, 0.30, 0.31, 0.31
2 , Grid_RF: Y-Def , 30 , 0 ( * | ), 0.30, 0.30, 0.30, 0.30, 0.30
2 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Tuned_CART: Y-Def , 34 , 7 ( -- | * ---- ), 0.27, 0.28, 0.34, 0.35, 0.37
2 , Naive_CART: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 30 , 0 (* | ), 0.30, 0.30, 0.30, 0.30, 0.30
1 , Tuned_RF: Y-Def , 36 , 2 ( - *- | ), 0.33, 0.34, 0.36, 0.36, 0.37
1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Tuned_CART: Y-Def , 47 , 11 ( --- | * ), 0.35, 0.37, 0.47, 0.48, 0.48
2 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Tuned_CART: Y-Def , 67 , 1 ( *|------ ), 0.66, 0.66, 0.67, 0.67, 0.69
2 , Naive_RF: Y-Def , 67 , 0 ( *| ), 0.67, 0.67, 0.67, 0.67, 0.67
3 , Tuned_RF: Y-Def , 69 , 0 ( | *--- ), 0.69, 0.69, 0.69, 0.69, 0.70
4 , Grid_RF: Y-Def , 71 , 0 ( | *), 0.71, 0.71, 0.71, 0.71, 0.71
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1204
Grid_CART Running Time: 0.6322
Naive_RF Running Time: 0.009
Tuned_RF Running Time: 25.6758
Grid_RF Running Time: 176.6064
++++++++++++++++++++
DataSet: ivyV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Tuned_CART: Y-Def , 20 , 30 ( *| - ), 0.00, 0.00, 0.20, 0.30, 0.32
2 , Grid_CART: Y-Def , 22 , 0 ( * ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Naive_CART: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 5 , 7 ( * | ), 0.00, 0.00, 0.05, 0.07, 0.07
2 , Grid_CART: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 19 , 0 ( | *), 0.19, 0.19, 0.19, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Grid_CART: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 32 , 35 ( | * - ), 0.00, 0.00, 0.32, 0.35, 0.37
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Tuned_CART: Y-Def , 24 , 32 ( | * - ), 0.00, 0.00, 0.24, 0.32, 0.34
2 , Grid_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Tuned_CART: Y-Def , 33 , 45 ( | * -- ), 0.00, 0.00, 0.33, 0.45, 0.48
2 , Grid_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Naive_CART: Y-Def , 55 , 0 ( | *), 0.55, 0.55, 0.55, 0.55, 0.55
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Tuned_CART: Y-Def , 74 , 2 ( | *--- ), 0.73, 0.73, 0.74, 0.75, 0.77
1 , Grid_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
2 , Grid_RF: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
2 , Tuned_RF: Y-Def , 82 , 1 ( | *), 0.81, 0.81, 0.82, 0.82, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.152
Grid_CART Running Time: 0.6606
Naive_RF Running Time: 0.0094
Tuned_RF Running Time: 26.439
Grid_RF Running Time: 187.8622
++++++++++++++++++++
DataSet: jeditV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_CART: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Naive_RF: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Tuned_CART: Y-Def , 48 , 6 (------- *-|------------- ), 0.36, 0.43, 0.48, 0.49, 0.63
2 , Tuned_RF: Y-Def , 50 , 1 ( - * ), 0.48, 0.49, 0.50, 0.50, 0.51
2 , Naive_CART: Y-Def , 51 , 0 ( |* ), 0.51, 0.51, 0.51, 0.51, 0.51
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
2 , Tuned_RF: Y-Def , 7 , 1 ( --* ---- | ), 0.06, 0.07, 0.07, 0.08, 0.10
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
3 , Tuned_CART: Y-Def , 12 , 1 ( ------|* ----------- ), 0.08, 0.12, 0.12, 0.13, 0.19
3 , Grid_CART: Y-Def , 12 , 0 ( |* ), 0.12, 0.12, 0.12, 0.12, 0.12
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Tuned_CART: Y-Def , 56 , 5 (---- * -----| ), 0.47, 0.52, 0.56, 0.58, 0.64
2 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_RF: Y-Def , 69 , 3 ( -|-- *---- ), 0.62, 0.66, 0.69, 0.69, 0.74
3 , Grid_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 50 , 0 ( *| ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_RF: Y-Def , 51 , 0 ( * ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 52 , 2 (---------------| *------- ), 0.41, 0.51, 0.52, 0.53, 0.57
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 56 , 4 ( | * - ), 0.55, 0.55, 0.57, 0.59, 0.60
2 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Grid_CART: Y-Def , 60 , 0 ( *| ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Tuned_CART: Y-Def , 62 , 6 (----------- | *----------- ), 0.51, 0.58, 0.62, 0.63, 0.70
2 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
3 , Tuned_RF: Y-Def , 64 , 1 ( | --* - ), 0.63, 0.64, 0.64, 0.65, 0.66
3 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_CART: Y-Def , 76 , 3 ( --- * | ), 0.74, 0.75, 0.76, 0.78, 0.78
1 , Grid_CART: Y-Def , 76 , 0 ( * | ), 0.76, 0.76, 0.76, 0.76, 0.76
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 83 , 1 ( | * ), 0.83, 0.83, 0.83, 0.84, 0.84
2 , Grid_RF: Y-Def , 83 , 0 ( | * ), 0.83, 0.83, 0.83, 0.83, 0.83
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0018
Tuned_CART Running Time: 0.177
Grid_CART Running Time: 0.6688
Naive_RF Running Time: 0.0094
Tuned_RF Running Time: 26.1002
Grid_RF Running Time: 189.299
++++++++++++++++++++
DataSet: jeditV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_RF: Y-Def , 57 , 0 ( * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 57 , 0 ( * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_RF: Y-Def , 62 , 2 ( |-- * ), 0.58, 0.60, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Tuned_CART: Y-Def , 64 , 2 (---------------|----- *---- ), 0.47, 0.62, 0.64, 0.64, 0.68
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_RF: Y-Def , 11 , 0 (------*-- | ), 0.09, 0.11, 0.11, 0.11, 0.12
2 , Naive_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Tuned_CART: Y-Def , 15 , 3 (--------- | *--------- ), 0.09, 0.12, 0.15, 0.15, 0.18
2 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Tuned_CART: Y-Def , 38 , 4 ( -----* | ----- ), 0.36, 0.38, 0.38, 0.42, 0.44
1 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_RF: Y-Def , 44 , 1 ( | -----* ----- ), 0.42, 0.44, 0.44, 0.45, 0.47
2 , Grid_RF: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44
2 , Grid_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 48 , 1 ( ---- *|------ ), 0.46, 0.47, 0.48, 0.48, 0.50
2 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Grid_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
3 , Tuned_RF: Y-Def , 52 , 1 ( | -------- *), 0.49, 0.51, 0.52, 0.52, 0.52
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Grid_CART: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_CART: Y-Def , 73 , 1 (---------------|-------- *- ), 0.62, 0.72, 0.73, 0.73, 0.74
1 , Tuned_RF: Y-Def , 73 , 2 ( | --- * ), 0.70, 0.71, 0.73, 0.73, 0.73
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 77 , 0 ( * | ), 0.77, 0.77, 0.77, 0.77, 0.77
1 , Tuned_CART: Y-Def , 78 , 5 ( * | ), 0.77, 0.77, 0.78, 0.82, 0.82
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 85 , 1 ( | * ), 0.85, 0.85, 0.85, 0.86, 0.86
2 , Grid_RF: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0018
Tuned_CART Running Time: 0.1638
Grid_CART Running Time: 0.6976
Naive_RF Running Time: 0.0096
Tuned_RF Running Time: 24.586
Grid_RF Running Time: 191.8906
++++++++++++++++++++
DataSet: jeditV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_RF: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Grid_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 1 ( ----* | ), 0.05, 0.07, 0.07, 0.08, 0.08
1 , Grid_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Tuned_CART: Y-Def , 9 , 2 (------ * | ), 0.04, 0.07, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Tuned_CART: Y-Def , 10 , 2 ( * | ------------ ), 0.10, 0.10, 0.10, 0.12, 0.17
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_RF: Y-Def , 11 , 0 ( *| ), 0.11, 0.11, 0.11, 0.11, 0.11
1 , Grid_CART: Y-Def , 11 , 0 ( *| ), 0.11, 0.11, 0.11, 0.11, 0.11
1 , Tuned_RF: Y-Def , 12 , 2 ( | *--------- ), 0.10, 0.10, 0.12, 0.12, 0.16
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Tuned_CART: Y-Def , 16 , 3 ( * | ----------- ), 0.16, 0.16, 0.16, 0.19, 0.25
1 , Grid_RF: Y-Def , 17 , 0 ( *| ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Naive_RF: Y-Def , 17 , 0 ( *| ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Tuned_RF: Y-Def , 19 , 2 ( | *------- ), 0.17, 0.17, 0.19, 0.19, 0.23
1 , Grid_CART: Y-Def , 19 , 0 ( | * ), 0.19, 0.19, 0.19, 0.19, 0.19
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 60 , 1 ( * | ), 0.60, 0.60, 0.60, 0.61, 0.61
1 , Tuned_RF: Y-Def , 60 , 1 ( * | ), 0.60, 0.60, 0.60, 0.61, 0.61
1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Grid_CART: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 64 , 1 ( *--- | ), 0.63, 0.63, 0.64, 0.64, 0.66
1 , Tuned_CART: Y-Def , 65 , 0 (---*- | ), 0.63, 0.65, 0.65, 0.65, 0.66
1 , Grid_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
2 , Grid_RF: Y-Def , 71 , 0 ( * ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Naive_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.0956
Grid_CART Running Time: 0.5948
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 27.0348
Grid_RF Running Time: 171.8958
++++++++++++++++++++
DataSet: log4jV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 15 , 0 (---------*-----|-- ), 0.07, 0.15, 0.15, 0.15, 0.23
2 , Tuned_CART: Y-Def , 23 , 0 ( --|--*---------- ), 0.19, 0.23, 0.23, 0.23, 0.33
2 , Grid_RF: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Naive_RF: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Grid_CART: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Naive_CART: Y-Def , 33 , 0 ( | *), 0.33, 0.33, 0.33, 0.33, 0.33
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.06
1 , Tuned_CART: Y-Def , 6 , 0 (-----*---------|------------- ), 0.00, 0.06, 0.06, 0.06, 0.31
1 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Naive_RF: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 93 , 0 ( * | ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94
1 , Grid_CART: Y-Def , 96 , 0 ( *| ), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Tuned_CART: Y-Def , 97 , 0 (---------------|--*---------- ), 0.92, 0.97, 0.97, 0.97, 1.00
1 , Grid_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97
2 , Tuned_RF: Y-Def , 100 , 0 ( | -----------*), 0.97, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 1 (---------- *---|---- ), 0.13, 0.26, 0.27, 0.27, 0.38
2 , Tuned_CART: Y-Def , 38 , 0 ( |----*-------- ), 0.32, 0.38, 0.38, 0.38, 0.49
2 , Naive_RF: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Grid_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Grid_CART: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
2 , Naive_CART: Y-Def , 49 , 0 ( | *), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 1 (----------- *--|----- ), 0.13, 0.26, 0.27, 0.27, 0.37
2 , Tuned_CART: Y-Def , 37 , 0 ( | ----*------- ), 0.32, 0.37, 0.37, 0.37, 0.45
2 , Naive_RF: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Grid_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 51 , 10 (- * | --- ), 0.48, 0.49, 0.51, 0.59, 0.61
1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_CART: Y-Def , 56 , 0 ( *| ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Tuned_RF: Y-Def , 57 , 0 ( |-*- ), 0.57, 0.58, 0.58, 0.58, 0.59
1 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Grid_RF: Y-Def , 65 , 0 ( | *), 0.65, 0.65, 0.65, 0.65, 0.65
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1362
Grid_CART Running Time: 0.6442
Naive_RF Running Time: 0.009
Tuned_RF Running Time: 26.173
Grid_RF Running Time: 181.4096
++++++++++++++++++++
DataSet: luceneV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Naive_RF: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Tuned_CART: Y-Def , 67 , 3 (---------------| * --- ), 0.53, 0.66, 0.67, 0.69, 0.71
2 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
3 , Tuned_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.76
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Naive_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Grid_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
3 , Tuned_RF: Y-Def , 43 , 2 ( | *- ), 0.42, 0.42, 0.43, 0.44, 0.45
3 , Tuned_CART: Y-Def , 48 , 13 (-------------- | * - ), 0.26, 0.40, 0.48, 0.53, 0.54
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 67 , 4 (-- * -|------------- ), 0.65, 0.66, 0.67, 0.70, 0.75
1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Grid_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Tuned_RF: Y-Def , 72 , 1 ( | * ), 0.71, 0.71, 0.72, 0.72, 0.72
2 , Naive_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
3 , Grid_RF: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_CART: Y-Def , 67 , 1 ( -----------* | ), 0.62, 0.67, 0.67, 0.68, 0.68
3 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
4 , Tuned_RF: Y-Def , 73 , 1 ( | * ), 0.73, 0.73, 0.73, 0.74, 0.74
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 57 , 5 (-- * -|- ), 0.55, 0.56, 0.58, 0.61, 0.62
1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Tuned_RF: Y-Def , 64 , 1 ( | ---* ), 0.63, 0.64, 0.64, 0.65, 0.65
3 , Grid_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 64 , 1 ( -----* --|-- ), 0.62, 0.64, 0.64, 0.65, 0.67
2 , Grid_CART: Y-Def , 66 , 0 ( |* ), 0.66, 0.66, 0.66, 0.66, 0.66
3 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
4 , Tuned_RF: Y-Def , 72 , 0 ( | *), 0.72, 0.72, 0.72, 0.72, 0.72
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 4, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1384
Grid_CART Running Time: 0.6522
Naive_RF Running Time: 0.0092
Tuned_RF Running Time: 26.4286
Grid_RF Running Time: 184.5288
++++++++++++++++++++
DataSet: poiV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_RF: Y-Def , 2 , 1 ( --* -- | ), 0.01, 0.02, 0.02, 0.03, 0.04
2 , Grid_RF: Y-Def , 3 , 0 ( * | ), 0.03, 0.03, 0.03, 0.03, 0.03
3 , Tuned_CART: Y-Def , 7 , 2 ( ---------- | * --- ), 0.02, 0.06, 0.07, 0.08, 0.09
3 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
3 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 2 (* | ), 0.00, 0.00, 0.00, 0.02, 0.02
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
2 , Tuned_CART: Y-Def , 6 , 4 ( ----- *| ---------- ), 0.02, 0.04, 0.06, 0.08, 0.12
2 , Naive_RF: Y-Def , 6 , 0 ( *| ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 11 , 0 ( | * ), 0.11, 0.11, 0.11, 0.11, 0.11
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_CART: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.65
2 , Tuned_CART: Y-Def , 66 , 20 ( -------|- * ), 0.29, 0.58, 0.66, 0.77, 0.78
2 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
3 , Tuned_RF: Y-Def , 85 , 24 ( | * ), 0.75, 0.76, 0.85, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_RF: Y-Def , 4 , 2 ( -* -- | ), 0.03, 0.04, 0.04, 0.06, 0.07
2 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
3 , Tuned_CART: Y-Def , 13 , 4 ( -----------| * - ), 0.03, 0.11, 0.13, 0.15, 0.16
3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Naive_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_RF: Y-Def , 4 , 2 ( -* - | ), 0.03, 0.04, 0.04, 0.06, 0.07
2 , Grid_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
3 , Tuned_CART: Y-Def , 13 , 4 ( -----------| * --- ), 0.03, 0.11, 0.13, 0.15, 0.17
3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Naive_CART: Y-Def , 21 , 0 ( | *), 0.21, 0.21, 0.21, 0.21, 0.21
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Tuned_CART: Y-Def , 37 , 1 (- *-----------| ), 0.35, 0.36, 0.37, 0.37, 0.43
2 , Tuned_RF: Y-Def , 37 , 1 ( --* ---- | ), 0.36, 0.37, 0.37, 0.38, 0.40
3 , Grid_CART: Y-Def , 42 , 0 ( * | ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
3 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0026
Tuned_CART Running Time: 0.155
Grid_CART Running Time: 0.7054
Naive_RF Running Time: 0.0104
Tuned_RF Running Time: 24.1832
Grid_RF Running Time: 193.1604
++++++++++++++++++++
DataSet: poiV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_CART: Y-Def , 16 , 26 ( | * ), 0.00, 0.00, 0.16, 0.26, 0.26
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Tuned_CART: Y-Def , 3 , 7 ( * | ), 0.00, 0.00, 0.03, 0.07, 0.07
1 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Tuned_CART: Y-Def , 86 , 86 ( | * ), 0.00, 0.00, 0.86, 0.86, 0.90
1 , Naive_RF: Y-Def , 92 , 0 ( | *), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 28 , 40 ( | * ), 0.00, 0.00, 0.28, 0.40, 0.40
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 39 , 0 ( | *), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 28 , 41 ( | * ), 0.00, 0.00, 0.28, 0.41, 0.41
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 40 , 0 ( | *), 0.40, 0.40, 0.40, 0.40, 0.40
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 59 , 0 (---* | ), 0.56, 0.59, 0.59, 0.59, 0.59
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
2 , Grid_RF: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78
3 , Tuned_RF: Y-Def , 80 , 1 ( | --*- ), 0.78, 0.80, 0.80, 0.81, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1398
Grid_CART Running Time: 0.6402
Naive_RF Running Time: 0.0088
Tuned_RF Running Time: 24.3292
Grid_RF Running Time: 177.67
++++++++++++++++++++
DataSet: synapseV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Tuned_RF: Y-Def , 17 , 14 (------ * | ), 0.00, 0.09, 0.17, 0.23, 0.23
2 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Naive_CART: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
2 , Tuned_CART: Y-Def , 38 , 7 (---------------|------- *- ), 0.00, 0.32, 0.38, 0.39, 0.41
2 , Grid_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Tuned_RF: Y-Def , 3 , 3 (- * | ), 0.00, 0.01, 0.03, 0.04, 0.04
2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Tuned_CART: Y-Def , 7 , 5 (-----------* | ---------- ), 0.00, 0.07, 0.07, 0.12, 0.18
2 , Grid_CART: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 62 , 16 (---------------|--- * - ), 0.00, 0.52, 0.62, 0.68, 0.71
1 , Naive_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_CART: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Tuned_RF: Y-Def , 71 , 3 (---------------|----------*-- ), 0.00, 0.71, 0.71, 0.74, 0.80
1 , Grid_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 26 , 0 ( * ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Tuned_RF: Y-Def , 28 , 19 (--------- |* ), 0.00, 0.16, 0.28, 0.35, 0.35
2 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Naive_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Tuned_CART: Y-Def , 45 , 6 (---------------|----------* ), 0.00, 0.44, 0.45, 0.50, 0.50
2 , Grid_CART: Y-Def , 49 , 0 ( | *), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 27 , 0 ( *| ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Tuned_RF: Y-Def , 28 , 20 (--------- * ), 0.00, 0.17, 0.29, 0.37, 0.37
2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Tuned_CART: Y-Def , 53 , 6 (---------------|--------- * ), 0.00, 0.48, 0.53, 0.54, 0.56
2 , Grid_CART: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Tuned_CART: Y-Def , 69 , 6 ( -- | * -- ), 0.63, 0.64, 0.69, 0.70, 0.71
1 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Tuned_RF: Y-Def , 72 , 1 ( | * - ), 0.72, 0.72, 0.72, 0.73, 0.74
2 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 7}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1226
Grid_CART Running Time: 0.628
Naive_RF Running Time: 0.0086
Tuned_RF Running Time: 26.8088
Grid_RF Running Time: 179.0512
++++++++++++++++++++
DataSet: velocityV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 46 , 0 (----------*----|------------- ), 0.17, 0.46, 0.46, 0.46, 0.98
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 97 , 6 ( | ----- * ), 0.78, 0.92, 0.97, 0.98, 1.00
2 , Naive_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
2 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
2 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 41 , 3 (---*-----------|------------ ), 0.33, 0.40, 0.41, 0.43, 0.97
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_RF: Y-Def , 94 , 16 ( | --- * ), 0.74, 0.82, 0.94, 0.98, 0.99
3 , Grid_RF: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
4 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_RF: Y-Def , 34 , 1 ( | * -- ), 0.34, 0.34, 0.34, 0.35, 0.36
1 , Grid_RF: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Grid_CART: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Tuned_CART: Y-Def , 35 , 2 (---------------|-------- * - ), 0.21, 0.34, 0.35, 0.36, 0.37
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 1 (---------------|---*-------- ), 0.19, 0.40, 0.40, 0.41, 0.50
2 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
2 , Tuned_RF: Y-Def , 50 , 1 ( | --* ), 0.48, 0.50, 0.50, 0.51, 0.52
2 , Grid_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Naive_CART: Y-Def , 51 , 0 ( | *), 0.51, 0.51, 0.51, 0.51, 0.51
3 , Grid_RF: Y-Def , 51 , 0 ( | *), 0.51, 0.51, 0.51, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_RF: Y-Def , 10 , 25 (- * |----- ), 0.01, 0.03, 0.10, 0.29, 0.38
1 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Tuned_CART: Y-Def , 50 , 23 ( -------------| * ), 0.05, 0.28, 0.50, 0.51, 0.52
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Tuned_CART: Y-Def , 50 , 9 (------ * | -- ), 0.41, 0.46, 0.50, 0.55, 0.57
2 , Naive_CART: Y-Def , 52 , 0 ( *| ), 0.52, 0.52, 0.52, 0.52, 0.52
2 , Tuned_RF: Y-Def , 53 , 7 ( --- |* ------ ), 0.48, 0.50, 0.53, 0.58, 0.63
2 , Naive_RF: Y-Def , 53 , 0 ( |* ), 0.53, 0.53, 0.53, 0.53, 0.53
2 , Grid_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 8}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.146
Grid_CART Running Time: 0.6552
Naive_RF Running Time: 0.0094
Tuned_RF Running Time: 25.6514
Grid_RF Running Time: 185.877
++++++++++++++++++++
DataSet: xercesV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Grid_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
3 , Naive_CART: Y-Def , 23 , 0 ( * ), 0.23, 0.23, 0.23, 0.23, 0.23
3 , Tuned_CART: Y-Def , 26 , 15 (---------------| * ), 0.05, 0.24, 0.26, 0.39, 0.39
3 , Tuned_RF: Y-Def , 26 , 2 ( -| * ), 0.21, 0.24, 0.26, 0.26, 0.27
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Tuned_RF: Y-Def , 11 , 1 ( ---* | ), 0.10, 0.11, 0.11, 0.12, 0.12
1 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Naive_RF: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_CART: Y-Def , 15 , 4 ( ----------|- * ), 0.10, 0.14, 0.15, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Grid_RF: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Tuned_CART: Y-Def , 23 , 4 (---------------|------* ), 0.09, 0.23, 0.23, 0.27, 0.27
3 , Tuned_RF: Y-Def , 27 , 2 ( | * ), 0.26, 0.26, 0.27, 0.28, 0.28
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Naive_CART: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22
3 , Tuned_CART: Y-Def , 24 , 8 (---------------|----* ), 0.07, 0.24, 0.24, 0.32, 0.32
3 , Tuned_RF: Y-Def , 26 , 2 ( | - *-- ), 0.24, 0.25, 0.26, 0.27, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Grid_RF: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
2 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
3 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
3 , Tuned_CART: Y-Def , 39 , 14 (---------------|--- * ), 0.10, 0.38, 0.39, 0.52, 0.52
3 , Tuned_RF: Y-Def , 40 , 2 ( | -- * ), 0.34, 0.38, 0.40, 0.40, 0.41
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Grid_CART: Y-Def , 56 , 0 ( *| ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Tuned_CART: Y-Def , 57 , 4 ( ---|-* ), 0.56, 0.58, 0.58, 0.61, 0.61
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Grid_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Tuned_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 11, 'Grid_RF: Y-Def': 8}
Naive_CART Running Time: 0.002
Tuned_CART Running Time: 0.1908
Grid_CART Running Time: 0.7034
Naive_RF Running Time: 0.01
Tuned_RF Running Time: 26.5334
Grid_RF Running Time: 196.3468
++++++++++++++++++++
DataSet: xercesV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_RF: Y-Def , 10 , 1 ( * | ), 0.10, 0.10, 0.10, 0.11, 0.11
2 , Grid_CART: Y-Def , 11 , 0 ( |* ), 0.11, 0.11, 0.11, 0.11, 0.11
3 , Naive_CART: Y-Def , 13 , 0 ( | * ), 0.13, 0.13, 0.13, 0.13, 0.13
3 , Tuned_CART: Y-Def , 16 , 0 ( | --------*), 0.13, 0.16, 0.16, 0.16, 0.16
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_CART: Y-Def , 5 , 0 ( | *), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_RF: Y-Def , 92 , 0 ( * | ), 0.92, 0.92, 0.92, 0.92, 0.92
2 , Tuned_RF: Y-Def , 98 , 1 ( | *--- ), 0.97, 0.97, 0.98, 0.98, 1.00
2 , Grid_CART: Y-Def , 98 , 0 ( | * ), 0.98, 0.98, 0.98, 0.98, 0.98
2 , Tuned_CART: Y-Def , 100 , 0 ( | ----*), 0.98, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 19 , 2 ( *|-- ), 0.18, 0.18, 0.19, 0.20, 0.21
2 , Grid_CART: Y-Def , 20 , 0 ( |* ), 0.20, 0.20, 0.20, 0.20, 0.20
3 , Naive_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
3 , Tuned_CART: Y-Def , 28 , 1 ( | ----- *), 0.24, 0.27, 0.28, 0.28, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 19 , 2 ( *|-- ), 0.18, 0.18, 0.19, 0.20, 0.21
2 , Grid_CART: Y-Def , 20 , 0 ( |* ), 0.20, 0.20, 0.20, 0.20, 0.20
3 , Naive_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
3 , Tuned_CART: Y-Def , 28 , 1 ( | ----- *), 0.24, 0.27, 0.28, 0.28, 0.28
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Grid_RF: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44
2 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Tuned_CART: Y-Def , 56 , 4 ( ----* | ----- ), 0.52, 0.56, 0.56, 0.60, 0.64
4 , Tuned_RF: Y-Def , 66 , 3 ( | * - ), 0.66, 0.66, 0.66, 0.69, 0.70
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 12, 'Grid_RF: Y-Def': 8}
------------------------------------------------------------
Sender: LSF System <lsfadmin@n2i1-5>
Subject: Job 192186: </share3/wfu/miniconda/bin/python2.7 run.py run auc false> Done
Job </share3/wfu/miniconda/bin/python2.7 run.py run auc false> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>.
Job was executed on host(s) <n2i1-5>, in queue <serial>, as user <wfu> in cluster <henry2>.
</home/wfu> was used as the home directory.
</home/wfu/Github/Caret> was used as the working directory.
Started at Sun Feb 21 12:29:24 2016
Results reported at Sun Feb 21 17:35:14 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
/share3/wfu/miniconda/bin/python2.7 run.py run auc false
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 18355.87 sec.
Max Memory : 71 MB
Max Swap : 719 MB
Max Processes : 3
Max Threads : 4
The output (if any) is above this job summary.
PS:
Read file <./err/auc_false.err.192186> for stderr output of this job.
f1_randomly_pick
gogogoogogo f1
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1144
Grid_CART Running Time: 0.5534
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 21.373
Grid_RF Running Time: 154.5066
++++++++++++++++++++
DataSet: antV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 3 (-* -- | ), 0.00, 0.03, 0.03, 0.06, 0.09
1 , Naive_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Grid_RF: Y-Def , 21 , 7 ( -- * |-- ), 0.15, 0.18, 0.21, 0.25, 0.28
2 , Tuned_CART: Y-Def , 34 , 6 ( --|-- *------ ), 0.21, 0.28, 0.34, 0.34, 0.46
2 , Grid_CART: Y-Def , 34 , 19 ( ---- | * -- ), 0.12, 0.18, 0.34, 0.37, 0.40
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 2 (----- * | ), 0.02, 0.06, 0.07, 0.08, 0.08
1 , Grid_RF: Y-Def , 8 , 2 ( -- * | ), 0.06, 0.07, 0.08, 0.09, 0.09
1 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Grid_CART: Y-Def , 13 , 11 ( --- |* ), 0.07, 0.09, 0.13, 0.20, 0.20
2 , Naive_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Tuned_CART: Y-Def , 18 , 1 ( --|------ *----- ), 0.11, 0.17, 0.18, 0.18, 0.22
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 4 (---- * ----- | ), 0.00, 0.04, 0.05, 0.08, 0.13
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_CART: Y-Def , 18 , 3 ( | *------ ), 0.16, 0.16, 0.18, 0.19, 0.25
2 , Tuned_CART: Y-Def , 19 , 5 ( -----|--- * ), 0.10, 0.18, 0.19, 0.23, 0.23
3 , Grid_RF: Y-Def , 24 , 4 ( | - *--- ), 0.20, 0.21, 0.24, 0.25, 0.28
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 4 (-- * --- | ), 0.00, 0.03, 0.04, 0.07, 0.10
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_RF: Y-Def , 16 , 0 ( * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 22 , 7 ( | - * ), 0.18, 0.19, 0.22, 0.26, 0.26
2 , Grid_CART: Y-Def , 22 , 8 ( --|- * ---- ), 0.14, 0.18, 0.22, 0.26, 0.30
2 , Tuned_CART: Y-Def , 25 , 1 ( --|------- *---- ), 0.14, 0.24, 0.25, 0.25, 0.31
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 5 (---* --- | ), 0.00, 0.06, 0.06, 0.11, 0.17
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Grid_RF: Y-Def , 35 , 8 ( --| * -- ), 0.26, 0.31, 0.35, 0.39, 0.42
2 , Grid_CART: Y-Def , 47 , 21 ( ----| * ), 0.22, 0.31, 0.47, 0.52, 0.53
2 , Tuned_CART: Y-Def , 48 , 6 ( | ---- *---- ), 0.34, 0.42, 0.48, 0.48, 0.59
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 54 , 3 ( ------- * --|--- ), 0.47, 0.53, 0.54, 0.56, 0.61
1 , Grid_CART: Y-Def , 59 , 7 ( ------|* ---- ), 0.53, 0.58, 0.59, 0.64, 0.67
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 68 , 2 ( | --- * ), 0.65, 0.67, 0.68, 0.69, 0.69
2 , Grid_RF: Y-Def , 68 , 1 ( | -*- ), 0.67, 0.68, 0.68, 0.69, 0.70
In terms of 3 : the times of better tuners are{'Tuned_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1094
Grid_CART Running Time: 0.5776
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 22.4362
Grid_RF Running Time: 160.596
++++++++++++++++++++
DataSet: antV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 11 , 3 (---* --- | ), 0.07, 0.11, 0.11, 0.14, 0.17
1 , Grid_CART: Y-Def , 16 , 2 (--------* -----|- ), 0.07, 0.16, 0.16, 0.18, 0.25
1 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Tuned_RF: Y-Def , 28 , 3 ( |- * ), 0.23, 0.25, 0.28, 0.29, 0.29
3 , Tuned_CART: Y-Def , 38 , 0 ( | ----------*), 0.27, 0.38, 0.38, 0.38, 0.38
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 1 , 0 (*----- | ), 0.01, 0.01, 0.01, 0.01, 0.03
2 , Tuned_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Grid_CART: Y-Def , 4 , 1 ( --- *-----| ), 0.02, 0.03, 0.04, 0.04, 0.06
2 , Naive_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
3 , Tuned_CART: Y-Def , 7 , 0 ( |---*--------- ), 0.06, 0.07, 0.07, 0.07, 0.10
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 55 , 2 (-----* ------|- ), 0.50, 0.55, 0.55, 0.58, 0.65
1 , Naive_RF: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_CART: Y-Def , 63 , 0 ( *| ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 63 , 4 ( -- *| ), 0.57, 0.59, 0.63, 0.63, 0.63
2 , Tuned_RF: Y-Def , 68 , 4 ( |- * ), 0.64, 0.65, 0.68, 0.69, 0.69
2 , Grid_RF: Y-Def , 68 , 10 ( -- | * --- ), 0.61, 0.63, 0.68, 0.73, 0.76
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 20 , 3 (------* ----- | ), 0.13, 0.20, 0.20, 0.23, 0.28
1 , Grid_CART: Y-Def , 25 , 3 (----------* --|--- ), 0.13, 0.25, 0.25, 0.28, 0.35
1 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Tuned_RF: Y-Def , 40 , 5 ( | -- * ), 0.34, 0.36, 0.40, 0.41, 0.41
2 , Tuned_CART: Y-Def , 47 , 2 ( | ------- *), 0.37, 0.45, 0.47, 0.47, 0.47
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 21 , 3 (-----* ---- | ), 0.14, 0.21, 0.21, 0.24, 0.29
1 , Grid_CART: Y-Def , 27 , 4 (---------* --|--- ), 0.14, 0.27, 0.27, 0.31, 0.39
1 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
2 , Naive_CART: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
2 , Tuned_RF: Y-Def , 43 , 5 ( | - * ), 0.38, 0.39, 0.43, 0.44, 0.44
3 , Tuned_CART: Y-Def , 53 , 0 ( | --------*), 0.42, 0.53, 0.53, 0.53, 0.53
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 70 , 4 ( --- |* ), 0.65, 0.67, 0.70, 0.71, 0.71
1 , Tuned_CART: Y-Def , 71 , 5 ( -- | *-- ), 0.66, 0.67, 0.71, 0.72, 0.73
1 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Grid_RF: Y-Def , 76 , 2 ( | - * - ), 0.74, 0.75, 0.76, 0.77, 0.78
2 , Tuned_RF: Y-Def , 77 , 1 ( | -- * ), 0.75, 0.76, 0.77, 0.77, 0.78
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.168
Grid_CART Running Time: 0.624
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 24.6156
Grid_RF Running Time: 168.8896
++++++++++++++++++++
DataSet: antV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 (* | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_CART: Y-Def , 36 , 3 ( * | ), 0.33, 0.33, 0.36, 0.36, 0.36
2 , Grid_RF: Y-Def , 39 , 0 ( --* | ), 0.37, 0.39, 0.39, 0.39, 0.39
3 , Naive_CART: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
3 , Tuned_RF: Y-Def , 48 , 4 ( -| * - ), 0.46, 0.47, 0.48, 0.51, 0.52
3 , Tuned_CART: Y-Def , 59 , 0 ( ------|-------------*), 0.41, 0.59, 0.59, 0.59, 0.59
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 4 , 1 (--* ------ | ), 0.03, 0.04, 0.04, 0.05, 0.07
1 , Grid_RF: Y-Def , 5 , 0 ( ---* | ), 0.04, 0.05, 0.05, 0.05, 0.05
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Tuned_RF: Y-Def , 7 , 0 ( *-- | ), 0.07, 0.07, 0.07, 0.07, 0.08
3 , Tuned_CART: Y-Def , 11 , 0 ( -|-------* ), 0.08, 0.11, 0.11, 0.11, 0.11
3 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 60 , 0 ( ---*| ), 0.58, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 60 , 0 ( *| ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Tuned_RF: Y-Def , 65 , 1 ( | - * ), 0.63, 0.64, 0.65, 0.65, 0.65
2 , Grid_RF: Y-Def , 67 , 2 ( | * ), 0.67, 0.67, 0.67, 0.69, 0.69
2 , Grid_CART: Y-Def , 68 , 6 ( -----|- *-- ), 0.57, 0.62, 0.68, 0.68, 0.70
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 43 , 0 (* | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Grid_CART: Y-Def , 45 , 3 (- * | ), 0.43, 0.44, 0.45, 0.47, 0.47
2 , Naive_CART: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Grid_RF: Y-Def , 49 , 1 ( --* | ), 0.48, 0.49, 0.49, 0.50, 0.50
3 , Tuned_RF: Y-Def , 55 , 1 ( | --* ), 0.54, 0.55, 0.55, 0.57, 0.57
3 , Tuned_CART: Y-Def , 59 , 0 ( ------|-------------*), 0.48, 0.59, 0.59, 0.59, 0.59
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 49 , 0 (* | ), 0.49, 0.49, 0.49, 0.49, 0.49
1 , Grid_CART: Y-Def , 51 , 3 ( * | ), 0.49, 0.49, 0.51, 0.52, 0.52
2 , Grid_RF: Y-Def , 55 , 0 ( -* | ), 0.54, 0.55, 0.55, 0.55, 0.56
3 , Naive_CART: Y-Def , 60 , 0 ( * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Tuned_RF: Y-Def , 63 , 4 ( | - * ), 0.61, 0.62, 0.63, 0.66, 0.66
3 , Tuned_CART: Y-Def , 70 , 0 ( ----|-------------*), 0.57, 0.70, 0.70, 0.70, 0.70
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 73 , 0 ( ----* | ), 0.71, 0.73, 0.73, 0.73, 0.73
2 , Grid_CART: Y-Def , 75 , 3 ( * - ), 0.75, 0.75, 0.75, 0.78, 0.79
2 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
3 , Tuned_RF: Y-Def , 82 , 1 ( | * ), 0.81, 0.81, 0.82, 0.82, 0.82
3 , Grid_RF: Y-Def , 82 , 1 ( | * ), 0.82, 0.82, 0.82, 0.83, 0.83
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 3, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.26
Grid_CART Running Time: 0.7526
Naive_RF Running Time: 0.0108
Tuned_RF Running Time: 29.2938
Grid_RF Running Time: 187.432
++++++++++++++++++++
DataSet: camelV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 30 , 3 (-- *---- | ), 0.26, 0.28, 0.30, 0.31, 0.34
1 , Grid_RF: Y-Def , 31 , 1 (----- *------- | ), 0.26, 0.30, 0.31, 0.31, 0.37
2 , Grid_CART: Y-Def , 38 , 3 ( ----- |* --------- ), 0.33, 0.37, 0.38, 0.40, 0.47
2 , Tuned_CART: Y-Def , 44 , 1 ( | --- *--- ), 0.41, 0.43, 0.44, 0.44, 0.47
2 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (-*-- | ), 0.04, 0.05, 0.05, 0.05, 0.07
1 , Tuned_RF: Y-Def , 7 , 1 ( -- *- | ), 0.05, 0.06, 0.07, 0.07, 0.08
2 , Naive_RF: Y-Def , 13 , 0 ( *| ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Grid_CART: Y-Def , 15 , 3 ( ----| * --- ), 0.11, 0.14, 0.15, 0.17, 0.19
3 , Tuned_CART: Y-Def , 19 , 1 ( | ---- *-- ), 0.16, 0.18, 0.19, 0.19, 0.21
3 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_CART: Y-Def , 30 , 5 (- * --- | ), 0.28, 0.29, 0.30, 0.33, 0.35
1 , Grid_CART: Y-Def , 32 , 3 ( --* - | ), 0.30, 0.32, 0.32, 0.35, 0.36
1 , Naive_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_RF: Y-Def , 45 , 2 ( | *------ ), 0.44, 0.44, 0.45, 0.46, 0.51
3 , Grid_RF: Y-Def , 52 , 2 ( | - *- ), 0.50, 0.51, 0.52, 0.53, 0.54
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 35 , 2 (-----* --- | ), 0.33, 0.35, 0.35, 0.37, 0.38
1 , Naive_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Tuned_CART: Y-Def , 36 , 5 ( * | ), 0.34, 0.34, 0.36, 0.39, 0.39
1 , Tuned_RF: Y-Def , 36 , 1 ( *----- | ), 0.35, 0.35, 0.36, 0.36, 0.38
1 , Grid_RF: Y-Def , 38 , 1 ( ---------*| ------------ ), 0.35, 0.38, 0.38, 0.39, 0.43
1 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 45 , 4 (--- * ----- | ), 0.41, 0.43, 0.45, 0.47, 0.50
1 , Grid_RF: Y-Def , 46 , 1 (------ *-------|-- ), 0.41, 0.45, 0.46, 0.46, 0.53
2 , Grid_CART: Y-Def , 52 , 2 ( ----|-* -------- ), 0.48, 0.52, 0.52, 0.54, 0.59
2 , Tuned_CART: Y-Def , 56 , 2 ( | -- * --- ), 0.54, 0.55, 0.56, 0.58, 0.60
2 , Naive_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 62 , 0 (* | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Tuned_CART: Y-Def , 62 , 1 (* ---- | ), 0.62, 0.62, 0.62, 0.63, 0.65
2 , Grid_CART: Y-Def , 66 , 1 ( -- *--- | ), 0.64, 0.65, 0.66, 0.66, 0.68
3 , Tuned_RF: Y-Def , 73 , 0 ( | --* ), 0.72, 0.73, 0.73, 0.73, 0.73
3 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
4 , Grid_RF: Y-Def , 75 , 1 ( | * ), 0.75, 0.75, 0.75, 0.76, 0.76
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.0034
Tuned_CART Running Time: 0.298
Grid_CART Running Time: 0.9206
Naive_RF Running Time: 0.0112
Tuned_RF Running Time: 42.0284
Grid_RF Running Time: 213.3512
++++++++++++++++++++
DataSet: camelV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 21 , 1 ( *----- | ), 0.20, 0.20, 0.21, 0.21, 0.25
2 , Tuned_RF: Y-Def , 25 , 0 ( --*-- | ), 0.24, 0.25, 0.25, 0.25, 0.27
2 , Naive_RF: Y-Def , 27 , 0 ( * | ), 0.27, 0.27, 0.27, 0.27, 0.27
3 , Grid_CART: Y-Def , 32 , 4 ( - | *---- ), 0.27, 0.28, 0.32, 0.32, 0.35
3 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
3 , Tuned_CART: Y-Def , 38 , 1 ( -----|----------* - ), 0.27, 0.38, 0.38, 0.39, 0.40
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 0 (*- | ), 0.06, 0.06, 0.06, 0.06, 0.07
1 , Grid_RF: Y-Def , 7 , 0 (--*- | ), 0.06, 0.07, 0.07, 0.07, 0.08
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 12 , 0 ( *| ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Grid_CART: Y-Def , 13 , 0 ( ---|-*------ ), 0.11, 0.13, 0.13, 0.13, 0.16
2 , Tuned_CART: Y-Def , 16 , 3 ( ------|--- * -- ), 0.10, 0.14, 0.16, 0.17, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 35 , 3 (-* ---- | ), 0.34, 0.35, 0.35, 0.38, 0.40
1 , Grid_CART: Y-Def , 36 , 2 ( * | ), 0.34, 0.34, 0.36, 0.36, 0.36
2 , Naive_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
2 , Grid_RF: Y-Def , 41 , 3 ( -- * | ), 0.38, 0.39, 0.41, 0.42, 0.42
3 , Naive_RF: Y-Def , 43 , 0 ( |* ), 0.43, 0.43, 0.43, 0.43, 0.43
3 , Tuned_RF: Y-Def , 48 , 2 ( | ---- * - ), 0.45, 0.47, 0.48, 0.49, 0.50
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 28 , 1 (-- *----- | ), 0.26, 0.27, 0.28, 0.28, 0.31
2 , Tuned_RF: Y-Def , 33 , 1 ( *|--- ), 0.32, 0.32, 0.33, 0.33, 0.35
2 , Naive_RF: Y-Def , 33 , 0 ( *| ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Grid_CART: Y-Def , 34 , 3 ( | *- ), 0.31, 0.31, 0.34, 0.34, 0.35
3 , Tuned_CART: Y-Def , 37 , 1 ( ---|----- *----- ), 0.32, 0.36, 0.37, 0.37, 0.40
3 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 34 , 2 ( *------ | ), 0.33, 0.33, 0.34, 0.35, 0.39
2 , Tuned_RF: Y-Def , 40 , 1 ( - *-- | ), 0.38, 0.39, 0.40, 0.40, 0.42
2 , Naive_RF: Y-Def , 42 , 0 ( * | ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Grid_CART: Y-Def , 47 , 4 ( -- | *-- ), 0.42, 0.43, 0.47, 0.47, 0.49
3 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Tuned_CART: Y-Def , 52 , 1 ( ---|-----------*- ), 0.42, 0.52, 0.52, 0.53, 0.54
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 64 , 1 ( ------ *----| ), 0.61, 0.63, 0.64, 0.64, 0.66
1 , Tuned_CART: Y-Def , 65 , 1 (---------- *-| ), 0.60, 0.64, 0.65, 0.65, 0.66
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 70 , 1 ( | *- ), 0.69, 0.69, 0.70, 0.70, 0.71
2 , Grid_RF: Y-Def , 70 , 1 ( | * ), 0.70, 0.70, 0.70, 0.71, 0.71
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.142
Grid_CART Running Time: 0.5558
Naive_RF Running Time: 0.0084
Tuned_RF Running Time: 21.284
Grid_RF Running Time: 156.0288
++++++++++++++++++++
DataSet: ivyV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 12 , 0 (* | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Tuned_RF: Y-Def , 20 , 3 ( -- *- | ), 0.15, 0.17, 0.20, 0.20, 0.22
2 , Grid_RF: Y-Def , 32 , 3 ( |-* ), 0.30, 0.32, 0.32, 0.35, 0.35
2 , Grid_CART: Y-Def , 32 , 10 ( --------- | * -- ), 0.15, 0.25, 0.32, 0.35, 0.37
3 , Naive_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Tuned_CART: Y-Def , 42 , 8 ( | ---- * - ), 0.32, 0.37, 0.42, 0.45, 0.47
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 1 ( * | ), 0.03, 0.03, 0.04, 0.04, 0.04
2 , Grid_RF: Y-Def , 6 , 1 ( - * | ), 0.04, 0.05, 0.06, 0.06, 0.06
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
3 , Tuned_CART: Y-Def , 13 , 1 ( ----*-|------------- ), 0.10, 0.13, 0.13, 0.14, 0.25
3 , Grid_CART: Y-Def , 13 , 6 ( -- *-| ), 0.06, 0.08, 0.13, 0.14, 0.15
3 , Naive_CART: Y-Def , 19 , 0 ( | * ), 0.19, 0.19, 0.19, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_CART: Y-Def , 23 , 4 ( ------ * ----|--- ), 0.16, 0.22, 0.23, 0.26, 0.35
1 , Tuned_CART: Y-Def , 30 , 6 (---------- *|-- ), 0.14, 0.25, 0.30, 0.31, 0.34
2 , Tuned_RF: Y-Def , 35 , 4 ( | -* - ), 0.34, 0.35, 0.35, 0.39, 0.40
3 , Grid_RF: Y-Def , 41 , 1 ( | - *--- ), 0.39, 0.40, 0.41, 0.41, 0.46
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 14 , 0 (* | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Tuned_RF: Y-Def , 25 , 3 ( --- *-|- ), 0.21, 0.23, 0.25, 0.26, 0.28
1 , Grid_CART: Y-Def , 26 , 11 ( --- *| ----- ), 0.18, 0.20, 0.26, 0.31, 0.35
1 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Tuned_CART: Y-Def , 36 , 7 ( ---------|--- *- ), 0.19, 0.30, 0.36, 0.37, 0.38
2 , Grid_RF: Y-Def , 36 , 1 ( | -* ), 0.35, 0.36, 0.36, 0.37, 0.37
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 22 , 0 (* | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_RF: Y-Def , 33 , 5 ( --- *- | ), 0.25, 0.29, 0.33, 0.33, 0.36
2 , Grid_CART: Y-Def , 47 , 12 ( ---------- | * -- ), 0.25, 0.38, 0.47, 0.50, 0.52
2 , Grid_RF: Y-Def , 48 , 2 ( | --* ), 0.45, 0.48, 0.48, 0.50, 0.50
3 , Naive_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
3 , Tuned_CART: Y-Def , 56 , 7 ( | ------ * - ), 0.45, 0.52, 0.57, 0.59, 0.61
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Tuned_CART: Y-Def , 64 , 12 (----- * | --- ), 0.58, 0.62, 0.64, 0.74, 0.76
1 , Grid_CART: Y-Def , 69 , 9 ( |*-------- ), 0.61, 0.61, 0.69, 0.70, 0.75
1 , Naive_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
2 , Grid_RF: Y-Def , 77 , 1 ( | - * ), 0.75, 0.76, 0.77, 0.77, 0.78
2 , Tuned_RF: Y-Def , 78 , 4 ( | - *), 0.73, 0.74, 0.78, 0.78, 0.78
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1564
Grid_CART Running Time: 0.6044
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 23.6394
Grid_RF Running Time: 165.9152
++++++++++++++++++++
DataSet: jeditV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 39 , 10 (----* | --- ), 0.36, 0.39, 0.39, 0.49, 0.51
1 , Tuned_CART: Y-Def , 43 , 3 ( -- *----|------------- ), 0.40, 0.41, 0.43, 0.44, 0.56
1 , Tuned_RF: Y-Def , 46 , 2 ( *| -- ), 0.46, 0.46, 0.46, 0.48, 0.49
1 , Naive_RF: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Grid_RF: Y-Def , 48 , 3 ( | * - ), 0.46, 0.46, 0.48, 0.49, 0.50
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 6 , 1 (---- *---- | ), 0.03, 0.05, 0.06, 0.06, 0.08
1 , Tuned_RF: Y-Def , 8 , 1 ( -- *- | ), 0.06, 0.07, 0.08, 0.08, 0.09
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Naive_CART: Y-Def , 9 , 0 ( *| ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 9 , 1 ( --- *|--- ), 0.07, 0.08, 0.09, 0.09, 0.11
1 , Tuned_CART: Y-Def , 11 , 6 ( --- | * -- ), 0.07, 0.08, 0.11, 0.14, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 56 , 8 (------- * -| ), 0.46, 0.55, 0.57, 0.63, 0.66
1 , Grid_CART: Y-Def , 60 , 7 ( * -|- ), 0.57, 0.57, 0.60, 0.63, 0.67
2 , Naive_CART: Y-Def , 66 , 0 ( |* ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Naive_RF: Y-Def , 66 , 0 ( |* ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_RF: Y-Def , 67 , 1 ( --| *- ), 0.62, 0.66, 0.67, 0.67, 0.70
2 , Grid_RF: Y-Def , 70 , 6 ( | --* ----- ), 0.67, 0.69, 0.70, 0.75, 0.82
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 46 , 8 ( * | ------- ), 0.46, 0.46, 0.46, 0.54, 0.58
1 , Tuned_CART: Y-Def , 52 , 5 (------- *-------- ), 0.43, 0.47, 0.52, 0.52, 0.57
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 55 , 2 ( | -- *-- ), 0.53, 0.54, 0.55, 0.56, 0.57
3 , Grid_RF: Y-Def , 56 , 3 ( | * - ), 0.56, 0.56, 0.57, 0.59, 0.60
3 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 54 , 9 (---* | ------ ), 0.52, 0.54, 0.54, 0.63, 0.66
1 , Tuned_CART: Y-Def , 57 , 3 ( ---- * --|------------- ), 0.54, 0.56, 0.58, 0.59, 0.68
2 , Tuned_RF: Y-Def , 62 , 1 ( |--* -- ), 0.61, 0.62, 0.62, 0.63, 0.64
2 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Grid_RF: Y-Def , 63 , 1 ( | --* -- ), 0.62, 0.63, 0.63, 0.64, 0.65
2 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_CART: Y-Def , 75 , 2 ( ---- * | ), 0.72, 0.74, 0.75, 0.76, 0.76
1 , Grid_CART: Y-Def , 75 , 1 ( * ----|---- ), 0.75, 0.75, 0.75, 0.76, 0.80
2 , Tuned_RF: Y-Def , 82 , 1 ( | * ), 0.82, 0.82, 0.82, 0.83, 0.83
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Grid_RF: Y-Def , 84 , 0 ( | --*), 0.83, 0.84, 0.84, 0.84, 0.84
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1552
Grid_CART Running Time: 0.6204
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 24.2276
Grid_RF Running Time: 166.8744
++++++++++++++++++++
DataSet: jeditV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_CART: Y-Def , 56 , 13 (- * | ), 0.45, 0.47, 0.56, 0.60, 0.60
1 , Tuned_CART: Y-Def , 57 , 10 ( -- * | --------- ), 0.54, 0.56, 0.58, 0.66, 0.75
1 , Grid_RF: Y-Def , 57 , 1 ( ---- * | ), 0.52, 0.56, 0.58, 0.58, 0.58
1 , Tuned_RF: Y-Def , 62 , 2 ( -- |* ), 0.58, 0.60, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 ( *- | ), 0.10, 0.10, 0.10, 0.10, 0.11
1 , Tuned_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Grid_CART: Y-Def , 13 , 4 (-- *---|---- ), 0.08, 0.09, 0.13, 0.13, 0.17
1 , Naive_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 17 , 2 ( | * ------ ), 0.16, 0.16, 0.17, 0.18, 0.21
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 34 , 1 (--- *--- | ), 0.31, 0.33, 0.34, 0.34, 0.36
1 , Naive_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Grid_CART: Y-Def , 40 , 1 ( --------------|-* ---------- ), 0.32, 0.40, 0.40, 0.41, 0.46
2 , Tuned_RF: Y-Def , 42 , 1 ( | --* ), 0.41, 0.42, 0.42, 0.43, 0.43
2 , Grid_RF: Y-Def , 44 , 2 ( | *- ), 0.42, 0.42, 0.44, 0.44, 0.45
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 6 (-- * | ), 0.40, 0.41, 0.43, 0.47, 0.47
1 , Naive_RF: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 46 , 5 ( ------ |* ), 0.41, 0.43, 0.46, 0.48, 0.48
2 , Grid_RF: Y-Def , 49 , 1 ( |--------* ), 0.46, 0.49, 0.49, 0.50, 0.50
2 , Tuned_RF: Y-Def , 50 , 2 ( | --- * ), 0.48, 0.49, 0.50, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 66 , 9 (--- * | ), 0.60, 0.62, 0.66, 0.71, 0.71
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 68 , 7 ( -- *| ----- ), 0.65, 0.66, 0.68, 0.73, 0.76
1 , Grid_RF: Y-Def , 70 , 1 ( ------| * ), 0.65, 0.69, 0.70, 0.70, 0.70
1 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_RF: Y-Def , 72 , 2 ( |---- * ), 0.69, 0.71, 0.72, 0.73, 0.73
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Tuned_CART: Y-Def , 75 , 3 ( --* -----|----- ), 0.74, 0.75, 0.75, 0.78, 0.83
1 , Grid_CART: Y-Def , 78 , 4 ( ----* | ), 0.76, 0.78, 0.78, 0.82, 0.82
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 85 , 0 ( | * ), 0.85, 0.85, 0.85, 0.85, 0.85
3 , Grid_RF: Y-Def , 86 , 1 ( | *- ), 0.85, 0.85, 0.86, 0.86, 0.87
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1586
Grid_CART Running Time: 0.6586
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 24.703
Grid_RF Running Time: 169.4776
++++++++++++++++++++
DataSet: jeditV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 45 , 18 (---------* | ), 0.36, 0.45, 0.45, 0.63, 0.63
1 , Tuned_RF: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Grid_RF: Y-Def , 9 , 1 ( * | ), 0.09, 0.09, 0.09, 0.10, 0.10
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Grid_CART: Y-Def , 12 , 1 ( ----------* |--- ), 0.09, 0.12, 0.12, 0.13, 0.14
2 , Tuned_CART: Y-Def , 13 , 3 (---------------|* --- ), 0.08, 0.13, 0.13, 0.16, 0.17
2 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Tuned_CART: Y-Def , 7 , 0 ( *---- | ), 0.07, 0.07, 0.07, 0.07, 0.08
1 , Grid_CART: Y-Def , 7 , 0 ( -----*-----|--- ), 0.06, 0.07, 0.07, 0.07, 0.09
2 , Grid_RF: Y-Def , 9 , 0 ( | *---- ), 0.09, 0.09, 0.09, 0.09, 0.10
3 , Naive_RF: Y-Def , 10 , 0 ( | * ), 0.10, 0.10, 0.10, 0.10, 0.10
3 , Tuned_RF: Y-Def , 11 , 1 ( | *), 0.10, 0.10, 0.11, 0.11, 0.11
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 12 , 1 ( ---* --|--- ), 0.11, 0.12, 0.12, 0.13, 0.15
1 , Tuned_CART: Y-Def , 13 , 1 ( *-| ), 0.12, 0.12, 0.13, 0.13, 0.14
2 , Grid_RF: Y-Def , 15 , 0 ( | *--- ), 0.15, 0.15, 0.15, 0.15, 0.16
3 , Naive_RF: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
3 , Tuned_RF: Y-Def , 18 , 1 ( | *), 0.17, 0.17, 0.18, 0.18, 0.18
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 59 , 13 (-----------* | ), 0.51, 0.59, 0.59, 0.72, 0.72
1 , Grid_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.60
1 , Tuned_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 63 , 0 ( --*--- | ), 0.62, 0.63, 0.63, 0.63, 0.66
1 , Grid_CART: Y-Def , 65 , 8 ( -- * | --------- ), 0.62, 0.63, 0.65, 0.71, 0.78
1 , Tuned_CART: Y-Def , 69 , 2 (------------- |* ), 0.57, 0.67, 0.69, 0.69, 0.70
2 , Grid_RF: Y-Def , 74 , 5 ( -----|- *----- ), 0.65, 0.70, 0.74, 0.75, 0.79
2 , Naive_RF: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.0984
Grid_CART Running Time: 0.5218
Naive_RF Running Time: 0.0066
Tuned_RF Running Time: 22.669
Grid_RF Running Time: 148.5404
++++++++++++++++++++
DataSet: log4jV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Tuned_RF: Y-Def , 27 , 1 ( *- | ), 0.26, 0.26, 0.27, 0.27, 0.28
1 , Grid_RF: Y-Def , 28 , 1 ( *- | ), 0.27, 0.27, 0.28, 0.28, 0.29
2 , Tuned_CART: Y-Def , 30 , 4 ( ---- * |------- ), 0.26, 0.28, 0.30, 0.32, 0.36
2 , Grid_CART: Y-Def , 32 , 2 ( ---- * ------------ ), 0.29, 0.31, 0.32, 0.33, 0.39
2 , Naive_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 12 , 6 ( *----- | ), 0.06, 0.06, 0.12, 0.12, 0.18
1 , Grid_RF: Y-Def , 12 , 6 (-----* | ), 0.06, 0.12, 0.12, 0.18, 0.18
1 , Tuned_CART: Y-Def , 18 , 19 (----- * | ----- ), 0.06, 0.12, 0.18, 0.31, 0.37
1 , Grid_CART: Y-Def , 18 , 6 (----- *---|-- ), 0.06, 0.12, 0.18, 0.18, 0.25
1 , Naive_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 93 , 0 ( * | ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94
1 , Tuned_CART: Y-Def , 95 , 4 ( *| ---------- ), 0.92, 0.92, 0.95, 0.96, 0.98
1 , Grid_CART: Y-Def , 95 , 2 ( ----------*| ----- ), 0.93, 0.95, 0.95, 0.97, 0.98
1 , Tuned_RF: Y-Def , 96 , 2 ( ------|---* ), 0.94, 0.96, 0.96, 0.98, 0.98
1 , Grid_RF: Y-Def , 96 , 2 ( | *--------- ), 0.94, 0.94, 0.96, 0.96, 0.98
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 38 , 0 (* | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_RF: Y-Def , 42 , 0 ( --* | ), 0.41, 0.42, 0.42, 0.42, 0.43
1 , Grid_RF: Y-Def , 43 , 1 ( *- | ), 0.42, 0.42, 0.43, 0.43, 0.44
2 , Tuned_CART: Y-Def , 45 , 5 ( --- * | ------- ), 0.41, 0.43, 0.45, 0.48, 0.52
2 , Grid_CART: Y-Def , 48 , 2 ( ---| * ---------- ), 0.45, 0.47, 0.48, 0.49, 0.55
2 , Naive_CART: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 37 , 0 (* | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Tuned_RF: Y-Def , 41 , 1 ( --*-- | ), 0.40, 0.41, 0.41, 0.42, 0.43
1 , Grid_RF: Y-Def , 42 , 1 ( * | ), 0.41, 0.41, 0.42, 0.42, 0.42
1 , Tuned_CART: Y-Def , 43 , 1 ( -----* ---| ), 0.40, 0.43, 0.43, 0.44, 0.46
2 , Naive_CART: Y-Def , 46 , 0 ( * ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Grid_CART: Y-Def , 46 , 2 ( -- * ------------ ), 0.44, 0.45, 0.46, 0.47, 0.54
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_CART: Y-Def , 53 , 1 (---- *------- | ), 0.49, 0.52, 0.53, 0.53, 0.58
2 , Tuned_RF: Y-Def , 59 , 6 ( -- |* --- ), 0.56, 0.57, 0.59, 0.62, 0.64
2 , Grid_CART: Y-Def , 59 , 1 ( ----|* -------- ), 0.56, 0.59, 0.59, 0.60, 0.65
2 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Grid_RF: Y-Def , 64 , 1 ( | -- *---- ), 0.62, 0.63, 0.64, 0.64, 0.67
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1184
Grid_CART Running Time: 0.5926
Naive_RF Running Time: 0.009
Tuned_RF Running Time: 23.9112
Grid_RF Running Time: 159.2018
++++++++++++++++++++
DataSet: luceneV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Naive_RF: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 63 , 3 (---- *------ | ), 0.55, 0.60, 0.63, 0.63, 0.72
2 , Tuned_CART: Y-Def , 67 , 23 ( -- * | ), 0.63, 0.66, 0.67, 0.89, 0.89
2 , Grid_RF: Y-Def , 67 , 2 ( - *- | ), 0.65, 0.66, 0.67, 0.68, 0.69
2 , Tuned_RF: Y-Def , 76 , 1 ( | * ), 0.75, 0.75, 0.76, 0.76, 0.76
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 35 , 2 ( -* | ), 0.34, 0.35, 0.35, 0.37, 0.37
1 , Naive_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Grid_CART: Y-Def , 43 , 5 (------ *---|------ ), 0.32, 0.38, 0.43, 0.43, 0.54
2 , Tuned_RF: Y-Def , 46 , 1 ( *| ), 0.46, 0.46, 0.46, 0.47, 0.48
2 , Tuned_CART: Y-Def , 49 , 21 ( | * ), 0.40, 0.40, 0.49, 0.61, 0.61
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 68 , 2 (--------* -|- ), 0.65, 0.68, 0.68, 0.70, 0.71
1 , Grid_CART: Y-Def , 68 , 1 ( --- *------|------- ), 0.66, 0.67, 0.68, 0.68, 0.73
1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_RF: Y-Def , 70 , 0 ( ---*| ), 0.69, 0.70, 0.70, 0.70, 0.70
2 , Grid_RF: Y-Def , 72 , 2 ( | * --- ), 0.72, 0.72, 0.72, 0.74, 0.75
2 , Naive_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 65 , 1 (--------* -----| ), 0.60, 0.65, 0.65, 0.66, 0.69
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_CART: Y-Def , 69 , 9 ( ------- * ), 0.64, 0.68, 0.69, 0.77, 0.77
2 , Grid_RF: Y-Def , 70 , 1 ( -| *--- ), 0.68, 0.69, 0.70, 0.70, 0.72
2 , Tuned_RF: Y-Def , 73 , 0 ( | -* ), 0.72, 0.73, 0.73, 0.73, 0.73
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 55 , 8 ( * | -- ), 0.54, 0.54, 0.55, 0.62, 0.63
1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 59 , 2 ( ----- *---|---- ), 0.56, 0.58, 0.59, 0.59, 0.63
2 , Tuned_RF: Y-Def , 62 , 0 ( |--* ), 0.61, 0.62, 0.62, 0.62, 0.62
2 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
3 , Grid_RF: Y-Def , 65 , 2 ( | * -- ), 0.64, 0.64, 0.65, 0.66, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 63 , 3 ( -|-* ), 0.61, 0.63, 0.63, 0.66, 0.66
1 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 66 , 5 (---------------|---- * ), 0.50, 0.65, 0.66, 0.70, 0.70
2 , Grid_RF: Y-Def , 69 , 1 ( | -* - ), 0.68, 0.69, 0.69, 0.70, 0.71
3 , Tuned_RF: Y-Def , 72 , 1 ( | *), 0.71, 0.71, 0.72, 0.72, 0.72
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1328
Grid_CART Running Time: 0.5954
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 24.8928
Grid_RF Running Time: 160.6576
++++++++++++++++++++
DataSet: poiV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 6 (* -|-------- ), 0.00, 0.00, 0.00, 0.06, 0.10
1 , Tuned_RF: Y-Def , 0 , 0 (*------------- | ), 0.00, 0.00, 0.00, 0.00, 0.06
2 , Grid_RF: Y-Def , 5 , 2 ( * | ), 0.05, 0.05, 0.05, 0.07, 0.07
2 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Grid_CART: Y-Def , 10 , 7 ( | * ), 0.05, 0.05, 0.10, 0.12, 0.12
2 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 4 (* -----|----------- ), 0.00, 0.00, 0.00, 0.04, 0.10
1 , Tuned_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.02
1 , Grid_RF: Y-Def , 2 , 1 ( * -- | ), 0.02, 0.02, 0.02, 0.03, 0.04
2 , Naive_RF: Y-Def , 6 , 0 ( |* ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Grid_CART: Y-Def , 7 , 3 ( | *------- ), 0.04, 0.04, 0.07, 0.07, 0.10
2 , Naive_CART: Y-Def , 11 , 0 ( | *), 0.11, 0.11, 0.11, 0.11, 0.11
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Grid_CART: Y-Def , 68 , 8 ( --* | ), 0.65, 0.68, 0.68, 0.76, 0.76
1 , Naive_RF: Y-Def , 71 , 0 ( * | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Grid_RF: Y-Def , 77 , 3 ( |*- ), 0.76, 0.76, 0.77, 0.79, 0.81
1 , Tuned_CART: Y-Def , 100 , 29 ( ----- | *), 0.63, 0.71, 1.00, 1.00, 1.00
1 , Tuned_RF: Y-Def , 100 , 17 (---------------|--- *), 0.50, 0.83, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*------------- | ), 0.00, 0.00, 0.00, 0.00, 0.11
1 , Tuned_CART: Y-Def , 1 , 10 ( * -|------- ), 0.01, 0.01, 0.01, 0.11, 0.17
2 , Grid_RF: Y-Def , 10 , 4 ( * | ), 0.09, 0.09, 0.10, 0.13, 0.13
3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Grid_CART: Y-Def , 18 , 13 ( | * ), 0.09, 0.09, 0.18, 0.22, 0.22
3 , Naive_CART: Y-Def , 20 , 0 ( | * ), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*------------- | ), 0.00, 0.00, 0.00, 0.00, 0.11
1 , Tuned_CART: Y-Def , 1 , 10 ( * -|-------- ), 0.01, 0.01, 0.01, 0.11, 0.18
2 , Grid_RF: Y-Def , 10 , 5 ( * | ), 0.09, 0.09, 0.10, 0.14, 0.14
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_CART: Y-Def , 18 , 13 ( | * ), 0.09, 0.09, 0.18, 0.22, 0.22
2 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 3 ( *--------- | ), 0.24, 0.24, 0.27, 0.27, 0.36
2 , Grid_RF: Y-Def , 35 , 3 ( * -| ), 0.34, 0.34, 0.35, 0.37, 0.39
3 , Tuned_CART: Y-Def , 48 , 6 ( ---------|------ * ), 0.30, 0.44, 0.48, 0.50, 0.50
3 , Grid_CART: Y-Def , 48 , 3 ( | * - ), 0.47, 0.47, 0.48, 0.50, 0.51
3 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
3 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.1534
Grid_CART Running Time: 0.681
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 22.5036
Grid_RF Running Time: 170.2114
++++++++++++++++++++
DataSet: poiV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_CART: Y-Def , 16 , 24 ( * --|------------- ), 0.00, 0.00, 0.16, 0.24, 0.53
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 26 , 0 ( --------*| ), 0.11, 0.26, 0.26, 0.26, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
2 , Grid_CART: Y-Def , 4 , 11 ( * | ---- ), 0.00, 0.00, 0.04, 0.11, 0.13
2 , Tuned_CART: Y-Def , 7 , 0 ( ------* | ), 0.04, 0.07, 0.07, 0.07, 0.07
2 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
2 , Tuned_CART: Y-Def , 86 , 0 ( | --* ), 0.79, 0.86, 0.86, 0.86, 0.86
2 , Grid_CART: Y-Def , 87 , 20 ( -|---- *-- ), 0.50, 0.70, 0.87, 0.90, 1.00
2 , Naive_RF: Y-Def , 92 , 0 ( | * ), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_CART: Y-Def , 26 , 38 ( * | ------------ ), 0.00, 0.00, 0.26, 0.38, 0.66
2 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Tuned_CART: Y-Def , 40 , 0 ( -------|--* ), 0.19, 0.40, 0.40, 0.40, 0.42
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_CART: Y-Def , 27 , 39 ( * | ------------ ), 0.00, 0.00, 0.27, 0.39, 0.66
2 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Naive_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_CART: Y-Def , 41 , 0 ( -------|--* ), 0.19, 0.41, 0.41, 0.41, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 ( ------*---| ), 0.52, 0.59, 0.59, 0.59, 0.64
1 , Naive_CART: Y-Def , 63 , 0 ( *| ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 69 , 18 (------- | * ------ ), 0.45, 0.54, 0.69, 0.72, 0.79
2 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
2 , Tuned_RF: Y-Def , 80 , 3 ( | * ), 0.77, 0.77, 0.80, 0.80, 0.80
2 , Grid_RF: Y-Def , 80 , 1 ( | --* ), 0.78, 0.80, 0.80, 0.81, 0.82
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.1084
Grid_CART Running Time: 0.5606
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 18.737
Grid_RF Running Time: 154.6946
++++++++++++++++++++
DataSet: synapseV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 24 , 2 ( --- * | ), 0.20, 0.22, 0.24, 0.24, 0.25
1 , Grid_CART: Y-Def , 26 , 11 (- * |------------- ), 0.16, 0.17, 0.26, 0.29, 0.41
1 , Grid_RF: Y-Def , 27 , 2 ( *-| ), 0.25, 0.25, 0.27, 0.27, 0.29
1 , Naive_RF: Y-Def , 27 , 0 ( * | ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Naive_CART: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
2 , Tuned_CART: Y-Def , 34 , 7 ( |--- * - ), 0.30, 0.32, 0.34, 0.39, 0.40
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 0 ( *- | ), 0.04, 0.04, 0.04, 0.04, 0.05
1 , Grid_RF: Y-Def , 4 , 1 ( * | ), 0.04, 0.04, 0.04, 0.05, 0.05
1 , Grid_CART: Y-Def , 5 , 7 (-----* | ---- ), 0.02, 0.05, 0.05, 0.12, 0.14
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_CART: Y-Def , 15 , 11 ( | * ), 0.07, 0.07, 0.15, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 53 , 16 (-- * | - ), 0.50, 0.52, 0.53, 0.68, 0.69
1 , Grid_CART: Y-Def , 62 , 11 ( --------- * | ------- ), 0.51, 0.60, 0.62, 0.71, 0.78
2 , Naive_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
2 , Tuned_RF: Y-Def , 72 , 3 ( | -- * ), 0.67, 0.69, 0.72, 0.72, 0.73
2 , Grid_RF: Y-Def , 73 , 1 ( | *- ), 0.72, 0.72, 0.73, 0.73, 0.75
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 36 , 3 ( - * | ), 0.32, 0.33, 0.36, 0.36, 0.37
1 , Grid_CART: Y-Def , 37 , 10 (--- *|------------- ), 0.25, 0.28, 0.37, 0.38, 0.50
1 , Naive_CART: Y-Def , 38 , 0 ( * ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Naive_RF: Y-Def , 39 , 0 ( |* ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Grid_RF: Y-Def , 40 , 3 ( | *-- ), 0.37, 0.37, 0.40, 0.40, 0.42
2 , Tuned_CART: Y-Def , 45 , 2 ( -|------ * ), 0.37, 0.44, 0.45, 0.46, 0.46
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 38 , 3 ( - *- | ), 0.34, 0.35, 0.38, 0.38, 0.40
1 , Grid_CART: Y-Def , 41 , 15 (-- *|------------- ), 0.27, 0.29, 0.41, 0.43, 0.56
1 , Naive_RF: Y-Def , 42 , 0 ( * ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Grid_RF: Y-Def , 43 , 3 ( |* ), 0.40, 0.40, 0.43, 0.43, 0.44
2 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Tuned_CART: Y-Def , 50 , 5 ( | ---- * - ), 0.44, 0.48, 0.50, 0.53, 0.54
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 62 , 2 (--------* ---| ), 0.57, 0.62, 0.62, 0.64, 0.66
1 , Tuned_CART: Y-Def , 64 , 0 ( -------*--|------ ), 0.60, 0.64, 0.64, 0.64, 0.70
2 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Tuned_RF: Y-Def , 71 , 1 ( | --* ), 0.70, 0.71, 0.71, 0.72, 0.72
3 , Grid_RF: Y-Def , 74 , 0 ( | *), 0.74, 0.74, 0.74, 0.74, 0.74
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 11, 'Grid_RF: Y-Def': 7}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1284
Grid_CART Running Time: 0.604
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 22.5846
Grid_RF Running Time: 155.8234
++++++++++++++++++++
DataSet: velocityV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 56 , 44 (- *------------- ), 0.06, 0.12, 0.56, 0.56, 1.00
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Naive_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
1 , Tuned_CART: Y-Def , 100 , 0 ( ----|-------------*), 0.43, 1.00, 1.00, 1.00, 1.00
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_RF: Y-Def , 100 , 0 ( | --*), 0.91, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 68 , 59 (-- | *------- ), 0.01, 0.09, 0.68, 0.68, 0.96
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_CART: Y-Def , 100 , 0 ( ---|-------------*), 0.41, 1.00, 1.00, 1.00, 1.00
2 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
2 , Grid_RF: Y-Def , 100 , 1 ( | --------*), 0.72, 0.99, 1.00, 1.00, 1.00
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_CART: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.35
1 , Tuned_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Grid_RF: Y-Def , 34 , 0 ( *--- | ), 0.34, 0.34, 0.34, 0.34, 0.39
1 , Grid_CART: Y-Def , 34 , 13 ( * -------|------------- ), 0.29, 0.29, 0.34, 0.41, 0.71
1 , Naive_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 39 , 20 (----- | *------- ), 0.11, 0.19, 0.39, 0.39, 0.51
1 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Tuned_CART: Y-Def , 50 , 0 ( | ---------* ), 0.38, 0.50, 0.50, 0.50, 0.50
1 , Tuned_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_RF: Y-Def , 50 , 0 ( | *- ), 0.50, 0.50, 0.50, 0.50, 0.54
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|------------- ), 0.00, 0.00, 0.00, 0.00, 0.49
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 1 (*--------------|--------- ), 0.00, 0.00, 0.00, 0.01, 0.41
1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_CART: Y-Def , 22 , 28 ( --- * | ), 0.07, 0.12, 0.22, 0.40, 0.40
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 47 , 7 (- *- | ), 0.39, 0.41, 0.47, 0.48, 0.49
2 , Tuned_CART: Y-Def , 49 , 1 ( -*--- | ), 0.48, 0.49, 0.49, 0.50, 0.53
2 , Naive_CART: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
2 , Naive_RF: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
3 , Tuned_RF: Y-Def , 67 , 1 ( | * ), 0.67, 0.67, 0.67, 0.68, 0.68
3 , Grid_RF: Y-Def , 68 , 1 ( | ---------*- ), 0.59, 0.68, 0.68, 0.69, 0.71
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 12, 'Grid_RF: Y-Def': 7}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1338
Grid_CART Running Time: 0.625
Naive_RF Running Time: 0.0092
Tuned_RF Running Time: 22.7392
Grid_RF Running Time: 163.2042
++++++++++++++++++++
DataSet: xercesV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 15 , 0 (* | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_RF: Y-Def , 17 , 3 ( *----- | ), 0.15, 0.15, 0.17, 0.18, 0.21
2 , Naive_CART: Y-Def , 23 , 0 ( * | ), 0.23, 0.23, 0.23, 0.23, 0.23
2 , Grid_CART: Y-Def , 23 , 0 ( ---* | ), 0.21, 0.23, 0.23, 0.23, 0.23
3 , Tuned_CART: Y-Def , 26 , 5 ( | * ---- ), 0.26, 0.26, 0.26, 0.31, 0.34
3 , Tuned_RF: Y-Def , 27 , 1 ( ---|- *- ), 0.23, 0.26, 0.27, 0.27, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 13 , 1 (* ----- | ), 0.13, 0.13, 0.13, 0.14, 0.15
1 , Naive_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Naive_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_CART: Y-Def , 15 , 3 (---- * | ), 0.13, 0.14, 0.15, 0.17, 0.17
1 , Tuned_RF: Y-Def , 16 , 1 (--------- *| ), 0.13, 0.15, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 2 ( | * ), 0.17, 0.17, 0.18, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 (* | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Grid_RF: Y-Def , 18 , 1 ( ---* -- | ), 0.17, 0.18, 0.18, 0.19, 0.20
2 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Tuned_CART: Y-Def , 21 , 1 ( ---* |----- ), 0.20, 0.21, 0.21, 0.22, 0.24
2 , Grid_CART: Y-Def , 21 , 3 ( --- * |--- ), 0.18, 0.19, 0.21, 0.22, 0.23
2 , Tuned_RF: Y-Def , 22 , 2 ( --- |* ---------- ), 0.20, 0.21, 0.22, 0.23, 0.27
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 (* | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Grid_RF: Y-Def , 18 , 2 ( *---- | ), 0.16, 0.16, 0.18, 0.18, 0.20
2 , Naive_CART: Y-Def , 22 , 0 ( *| ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Grid_CART: Y-Def , 22 , 1 ( --- *|- ), 0.20, 0.21, 0.22, 0.22, 0.23
3 , Tuned_CART: Y-Def , 23 , 3 ( -|-* ----- ), 0.22, 0.23, 0.23, 0.26, 0.28
3 , Tuned_RF: Y-Def , 24 , 2 ( ---|- * ------- ), 0.21, 0.23, 0.24, 0.25, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 26 , 0 (* | ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_RF: Y-Def , 28 , 4 ( * ----- | ), 0.26, 0.26, 0.28, 0.30, 0.34
2 , Naive_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Grid_CART: Y-Def , 36 , 0 ( ---* | ), 0.34, 0.36, 0.36, 0.36, 0.36
3 , Tuned_CART: Y-Def , 39 , 6 ( | * ---- ), 0.39, 0.39, 0.39, 0.45, 0.48
3 , Tuned_RF: Y-Def , 41 , 2 ( --|- *-- ), 0.36, 0.39, 0.41, 0.41, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 56 , 3 ( --* | ), 0.55, 0.56, 0.56, 0.59, 0.59
1 , Grid_CART: Y-Def , 56 , 0 ( -- *-|---- ), 0.55, 0.56, 0.57, 0.57, 0.60
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Grid_RF: Y-Def , 62 , 2 ( | * ), 0.61, 0.61, 0.62, 0.63, 0.63
2 , Tuned_RF: Y-Def , 63 , 0 ( | ----*- ), 0.61, 0.63, 0.63, 0.63, 0.64
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 13, 'Grid_RF: Y-Def': 7}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1776
Grid_CART Running Time: 0.6756
Naive_RF Running Time: 0.0092
Tuned_RF Running Time: 20.7356
Grid_RF Running Time: 173.3332
++++++++++++++++++++
DataSet: xercesV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 4 , 1 (* | ), 0.04, 0.04, 0.04, 0.05, 0.05
1 , Grid_CART: Y-Def , 6 , 5 ( * - | ), 0.04, 0.04, 0.06, 0.09, 0.10
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_RF: Y-Def , 11 , 1 ( ---- *-- | ), 0.07, 0.10, 0.11, 0.11, 0.13
2 , Naive_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
3 , Tuned_CART: Y-Def , 19 , 0 ( | ----*------- ), 0.16, 0.19, 0.19, 0.19, 0.25
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (*--- | ), 0.00, 0.00, 0.00, 0.00, 0.01
2 , Tuned_CART: Y-Def , 2 , 0 ( ----*------|------------- ), 0.01, 0.02, 0.02, 0.02, 0.07
2 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( | * ), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Tuned_CART: Y-Def , 95 , 0 ( ----|---* ), 0.91, 0.95, 0.95, 0.95, 0.95
2 , Grid_CART: Y-Def , 97 , 4 ( | -- * ), 0.95, 0.96, 0.97, 1.00, 1.00
2 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
2 , Grid_RF: Y-Def , 100 , 0 ( | ----------*), 0.95, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 9 , 1 ( * | ), 0.08, 0.08, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 12 , 8 (- * - | ), 0.07, 0.09, 0.12, 0.17, 0.19
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 20 , 1 ( ---- *-- | ), 0.14, 0.19, 0.20, 0.20, 0.23
3 , Naive_CART: Y-Def , 24 , 0 ( * ), 0.24, 0.24, 0.24, 0.24, 0.24
3 , Tuned_CART: Y-Def , 31 , 1 ( | ---*------- ), 0.27, 0.31, 0.31, 0.32, 0.40
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 9 , 1 ( * | ), 0.08, 0.08, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 12 , 8 (- * - | ), 0.07, 0.09, 0.12, 0.17, 0.19
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 20 , 1 ( ---- *-- | ), 0.14, 0.19, 0.20, 0.20, 0.23
3 , Naive_CART: Y-Def , 24 , 0 ( * ), 0.24, 0.24, 0.24, 0.24, 0.24
3 , Tuned_CART: Y-Def , 32 , 0 ( | ----*------ ), 0.27, 0.32, 0.32, 0.32, 0.40
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 43 , 2 (- *- | ), 0.41, 0.42, 0.43, 0.44, 0.45
1 , Naive_CART: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
2 , Grid_RF: Y-Def , 46 , 0 ( --* | ), 0.44, 0.46, 0.46, 0.46, 0.46
2 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Tuned_CART: Y-Def , 59 , 0 ( | --*---- ), 0.57, 0.59, 0.59, 0.59, 0.64
4 , Tuned_RF: Y-Def , 68 , 2 ( | - * ), 0.66, 0.67, 0.68, 0.69, 0.69
In terms of 3 : the times of better tuners are{'Tuned_RF: Y-Def': 10, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 14, 'Grid_RF: Y-Def': 7}
------------------------------------------------------------
Sender: LSF System <lsfadmin@n2d2-1>
Subject: Job 192183: </share3/wfu/miniconda/bin/python2.7 run.py run f1 true> Done
Job </share3/wfu/miniconda/bin/python2.7 run.py run f1 true> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>.
Job was executed on host(s) <n2d2-1>, in queue <serial>, as user <wfu> in cluster <henry2>.
</home/wfu> was used as the home directory.
</home/wfu/Github/Caret> was used as the working directory.
Started at Sun Feb 21 12:29:24 2016
Results reported at Sun Feb 21 17:00:53 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
/share3/wfu/miniconda/bin/python2.7 run.py run f1 true
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 16282.24 sec.
Max Memory : 71 MB
Max Swap : 856 MB
Max Processes : 3
Max Threads : 4
The output (if any) is above this job summary.
PS:
Read file <./err/f1_true.err.192183> for stderr output of this job.
auc_randomly_pick
gogogoogogo auc
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.1052
Grid_CART Running Time: 0.5452
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 21.854
Grid_RF Running Time: 155.9398
++++++++++++++++++++
DataSet: antV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 21 (* |-- ), 0.00, 0.00, 0.00, 0.21, 0.25
1 , Tuned_RF: Y-Def , 0 , 6 (* ---- | ), 0.00, 0.00, 0.00, 0.06, 0.12
1 , Grid_RF: Y-Def , 9 , 18 ( * --| ), 0.00, 0.00, 0.09, 0.18, 0.21
1 , Naive_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Grid_CART: Y-Def , 34 , 9 ( --|---- * -- ), 0.18, 0.28, 0.34, 0.37, 0.40
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 9 (* --|---- ), 0.00, 0.00, 0.00, 0.09, 0.14
1 , Grid_RF: Y-Def , 1 , 6 ( * --- | ), 0.00, 0.00, 0.01, 0.06, 0.08
1 , Tuned_RF: Y-Def , 5 , 10 ( * -| ), 0.00, 0.00, 0.05, 0.10, 0.11
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Grid_CART: Y-Def , 13 , 6 ( ---- | *--------- ), 0.05, 0.08, 0.13, 0.14, 0.20
2 , Naive_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 17 (* --|- ), 0.00, 0.00, 0.00, 0.17, 0.22
1 , Tuned_RF: Y-Def , 0 , 6 (* ----- | ), 0.00, 0.00, 0.00, 0.06, 0.12
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 24 , 26 ( | * -------- ), 0.00, 0.00, 0.24, 0.26, 0.37
2 , Grid_CART: Y-Def , 25 , 11 ( | * --- ), 0.19, 0.19, 0.25, 0.30, 0.34
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 20 (* | -- ), 0.00, 0.00, 0.00, 0.20, 0.22
1 , Tuned_RF: Y-Def , 0 , 6 (* ----- | ), 0.00, 0.00, 0.00, 0.06, 0.12
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_RF: Y-Def , 15 , 21 ( * | - ), 0.00, 0.00, 0.15, 0.21, 0.22
1 , Naive_RF: Y-Def , 16 , 0 ( *| ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_CART: Y-Def , 26 , 7 ( | - * --- ), 0.22, 0.23, 0.26, 0.30, 0.34
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 35 (* | -- ), 0.00, 0.00, 0.00, 0.35, 0.38
1 , Tuned_RF: Y-Def , 0 , 11 (* ----- | ), 0.00, 0.00, 0.00, 0.11, 0.21
1 , Grid_RF: Y-Def , 17 , 31 ( * | -- ), 0.00, 0.00, 0.17, 0.31, 0.35
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Grid_CART: Y-Def , 50 , 10 ( | ------ * ), 0.31, 0.42, 0.50, 0.52, 0.53
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 64 , 5 ( --- |*-- ), 0.56, 0.59, 0.64, 0.64, 0.67
2 , Tuned_RF: Y-Def , 67 , 10 ( |- * --- ), 0.64, 0.65, 0.67, 0.75, 0.79
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_CART: Y-Def , 74 , 4 ( | - *-- ), 0.69, 0.71, 0.74, 0.75, 0.77
2 , Grid_RF: Y-Def , 74 , 5 ( | -- * - ), 0.69, 0.72, 0.74, 0.77, 0.79
In terms of 5 : the times of better tuners are{'Tuned_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1552
Grid_CART Running Time: 0.586
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 23.6014
Grid_RF Running Time: 162.8554
++++++++++++++++++++
DataSet: antV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 10 (* --------|---- ), 0.00, 0.00, 0.00, 0.10, 0.26
1 , Grid_RF: Y-Def , 6 , 6 ( *-- | ), 0.00, 0.01, 0.06, 0.07, 0.09
2 , Grid_CART: Y-Def , 16 , 3 ( ----- * | ), 0.08, 0.15, 0.16, 0.18, 0.19
2 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 18 , 20 ( *|------------- ), 0.00, 0.00, 0.18, 0.20, 0.38
2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 1 (* -------- | ), 0.00, 0.00, 0.00, 0.01, 0.03
1 , Grid_RF: Y-Def , 0 , 0 (*--- | ), 0.00, 0.00, 0.00, 0.00, 0.01
2 , Grid_CART: Y-Def , 2 , 1 ( ----* | ), 0.01, 0.02, 0.02, 0.03, 0.03
2 , Tuned_CART: Y-Def , 4 , 5 ( | * -------- ), 0.00, 0.00, 0.04, 0.05, 0.07
2 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( | * ), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 66 (* | - ), 0.00, 0.00, 0.00, 0.66, 0.70
1 , Tuned_CART: Y-Def , 56 , 57 ( | * ), 0.00, 0.00, 0.57, 0.58, 0.63
2 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Grid_CART: Y-Def , 66 , 3 ( | --*- ), 0.57, 0.65, 0.66, 0.68, 0.73
2 , Grid_RF: Y-Def , 75 , 12 (---------------|------* --- ), 0.00, 0.75, 0.75, 0.87, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 18 (* ----|-------- ), 0.00, 0.00, 0.00, 0.18, 0.38
1 , Grid_RF: Y-Def , 12 , 12 (- *-- | ), 0.00, 0.02, 0.12, 0.14, 0.17
1 , Grid_CART: Y-Def , 26 , 3 ( ------|*-- ), 0.15, 0.25, 0.26, 0.28, 0.30
1 , Naive_RF: Y-Def , 26 , 0 ( |* ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Tuned_CART: Y-Def , 28 , 30 ( | * ---------- ), 0.00, 0.00, 0.28, 0.30, 0.47
1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 19 (* -----|------- ), 0.00, 0.00, 0.00, 0.19, 0.41
1 , Grid_RF: Y-Def , 12 , 12 (- *-- | ), 0.00, 0.02, 0.12, 0.14, 0.17
2 , Grid_CART: Y-Def , 27 , 5 ( ------ * - ), 0.15, 0.26, 0.27, 0.31, 0.32
2 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.29, 0.29, 0.29, 0.29, 0.29
2 , Tuned_CART: Y-Def , 30 , 33 ( |* ----------- ), 0.00, 0.00, 0.30, 0.33, 0.53
2 , Naive_CART: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 64 , 4 (---- * --- | ), 0.60, 0.63, 0.64, 0.67, 0.69
1 , Tuned_CART: Y-Def , 67 , 5 ( * --| ), 0.65, 0.65, 0.67, 0.70, 0.72
1 , Naive_RF: Y-Def , 71 , 0 ( *| ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Grid_RF: Y-Def , 79 , 1 ( | *-- ), 0.78, 0.78, 0.79, 0.79, 0.81
3 , Tuned_RF: Y-Def , 82 , 1 ( | - *), 0.80, 0.81, 0.82, 0.82, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.158
Grid_CART Running Time: 0.5906
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 21.1226
Grid_RF Running Time: 169.1104
++++++++++++++++++++
DataSet: antV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 19 , 9 ( *--------|-------- ), 0.11, 0.11, 0.19, 0.20, 0.40
1 , Grid_CART: Y-Def , 33 , 1 ( ----|--*------- ), 0.25, 0.33, 0.33, 0.34, 0.42
1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_RF: Y-Def , 34 , 12 ( -------|-- * ), 0.21, 0.33, 0.34, 0.45, 0.45
1 , Grid_RF: Y-Def , 37 , 6 ( --|- * ), 0.27, 0.32, 0.37, 0.38, 0.39
1 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 1 , 3 (* --------|----------- ), 0.01, 0.01, 0.01, 0.04, 0.12
1 , Tuned_RF: Y-Def , 3 , 4 ( * | ), 0.02, 0.02, 0.03, 0.06, 0.06
1 , Grid_RF: Y-Def , 4 , 2 ( -- * | ), 0.02, 0.03, 0.04, 0.05, 0.05
1 , Grid_CART: Y-Def , 4 , 2 ( * --- | ), 0.03, 0.03, 0.04, 0.05, 0.06
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_CART: Y-Def , 63 , 6 (--------- *|------------- ), 0.48, 0.58, 0.63, 0.63, 0.78
1 , Grid_CART: Y-Def , 68 , 6 ( --| * ), 0.62, 0.64, 0.68, 0.70, 0.70
1 , Grid_RF: Y-Def , 70 , 4 ( | - * ---- ), 0.67, 0.68, 0.70, 0.72, 0.76
1 , Tuned_RF: Y-Def , 72 , 8 ( | * --- ), 0.66, 0.66, 0.72, 0.74, 0.77
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 30 , 11 ( *-----|----- ), 0.19, 0.19, 0.30, 0.30, 0.44
1 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Grid_CART: Y-Def , 45 , 2 ( |---- *--- ), 0.37, 0.43, 0.45, 0.45, 0.50
1 , Tuned_RF: Y-Def , 46 , 8 ( ----|-------* ), 0.32, 0.46, 0.46, 0.54, 0.54
1 , Naive_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 49 , 4 ( | ----- * ), 0.40, 0.45, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 32 , 13 ( *------|--------- ), 0.20, 0.20, 0.32, 0.33, 0.55
1 , Grid_CART: Y-Def , 49 , 1 ( -|-----*----- ), 0.40, 0.49, 0.49, 0.50, 0.58
1 , Naive_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
1 , Tuned_RF: Y-Def , 50 , 12 ( -----|-----* ), 0.34, 0.49, 0.50, 0.61, 0.61
1 , Grid_RF: Y-Def , 54 , 6 ( |---- * ), 0.42, 0.48, 0.54, 0.54, 0.55
1 , Naive_CART: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_CART: Y-Def , 75 , 4 ( ---* -- ), 0.73, 0.75, 0.75, 0.79, 0.80
1 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Tuned_CART: Y-Def , 77 , 2 ( | --* -- ), 0.76, 0.77, 0.77, 0.79, 0.80
2 , Tuned_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Grid_RF: Y-Def , 83 , 1 ( | *), 0.82, 0.82, 0.83, 0.83, 0.83
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 3, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.2304
Grid_CART Running Time: 0.7424
Naive_RF Running Time: 0.0094
Tuned_RF Running Time: 24.3536
Grid_RF Running Time: 187.372
++++++++++++++++++++
DataSet: camelV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 4 ( *-- | ), 0.00, 0.00, 0.03, 0.04, 0.08
1 , Grid_RF: Y-Def , 24 , 20 ( *| ), 0.11, 0.11, 0.24, 0.31, 0.31
2 , Grid_CART: Y-Def , 38 , 3 ( --|----- *--- ), 0.21, 0.35, 0.38, 0.38, 0.44
2 , Tuned_CART: Y-Def , 41 , 5 ( | * ), 0.41, 0.41, 0.41, 0.46, 0.46
2 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 3 , 4 ( * - | ), 0.01, 0.01, 0.03, 0.05, 0.06
2 , Naive_RF: Y-Def , 13 , 0 ( |* ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Grid_CART: Y-Def , 15 , 1 ( ----|-- * ), 0.09, 0.14, 0.15, 0.15, 0.15
3 , Tuned_CART: Y-Def , 19 , 0 ( | -* ), 0.18, 0.19, 0.19, 0.19, 0.19
3 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_CART: Y-Def , 30 , 1 ( * | ), 0.29, 0.30, 0.30, 0.31, 0.32
1 , Grid_CART: Y-Def , 32 , 1 ( *- | ), 0.31, 0.32, 0.32, 0.33, 0.36
1 , Naive_RF: Y-Def , 40 , 0 ( *| ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Grid_RF: Y-Def , 57 , 12 ( | - * ), 0.49, 0.52, 0.58, 0.64, 0.65
1 , Tuned_RF: Y-Def , 70 , 72 ( | *--- ), 0.00, 0.00, 0.70, 0.72, 0.83
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 9 ( * ---- | ), 0.00, 0.00, 0.06, 0.09, 0.15
2 , Grid_RF: Y-Def , 34 , 19 ( - | * - ), 0.18, 0.19, 0.34, 0.38, 0.39
2 , Tuned_CART: Y-Def , 35 , 3 ( | *- ), 0.34, 0.34, 0.35, 0.37, 0.38
2 , Grid_CART: Y-Def , 35 , 1 ( | ------ *-- ), 0.25, 0.34, 0.35, 0.35, 0.40
2 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 9 ( * --- | ), 0.00, 0.00, 0.06, 0.09, 0.16
2 , Grid_RF: Y-Def , 39 , 26 ( | * - ), 0.19, 0.20, 0.39, 0.46, 0.47
2 , Grid_CART: Y-Def , 52 , 3 ( |-------- *-- ), 0.34, 0.50, 0.52, 0.53, 0.58
2 , Tuned_CART: Y-Def , 54 , 3 ( | * ), 0.54, 0.54, 0.54, 0.58, 0.58
2 , Naive_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 64 , 1 (-----* ------ | ), 0.61, 0.64, 0.64, 0.65, 0.68
1 , Tuned_CART: Y-Def , 66 , 2 ( ---- * | ), 0.63, 0.65, 0.66, 0.67, 0.67
2 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
2 , Tuned_RF: Y-Def , 75 , 1 ( | --* ), 0.74, 0.75, 0.75, 0.76, 0.76
3 , Grid_RF: Y-Def , 76 , 1 ( | * ), 0.76, 0.76, 0.76, 0.77, 0.77
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0036
Tuned_CART Running Time: 0.2746
Grid_CART Running Time: 0.928
Naive_RF Running Time: 0.0114
Tuned_RF Running Time: 29.4746
Grid_RF Running Time: 214.4946
++++++++++++++++++++
DataSet: camelV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 20 , 0 (-*- | ), 0.19, 0.20, 0.20, 0.20, 0.21
2 , Tuned_RF: Y-Def , 22 , 1 ( -- *- | ), 0.20, 0.21, 0.22, 0.22, 0.23
3 , Naive_RF: Y-Def , 27 , 0 ( *| ), 0.27, 0.27, 0.27, 0.27, 0.27
3 , Grid_CART: Y-Def , 28 , 1 ( |*------------ ), 0.27, 0.27, 0.28, 0.28, 0.35
3 , Tuned_CART: Y-Def , 32 , 9 ( ---- | *--- ), 0.21, 0.23, 0.32, 0.32, 0.34
3 , Naive_CART: Y-Def , 35 , 0 ( | *), 0.35, 0.35, 0.35, 0.35, 0.35
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 1 (* | ), 0.05, 0.05, 0.05, 0.06, 0.06
1 , Grid_RF: Y-Def , 6 , 1 ( * | ), 0.06, 0.06, 0.06, 0.07, 0.07
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Tuned_CART: Y-Def , 11 , 3 ( ----- |* --- ), 0.08, 0.10, 0.11, 0.13, 0.14
2 , Naive_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Grid_CART: Y-Def , 13 , 0 ( | --*------- ), 0.12, 0.13, 0.13, 0.13, 0.16
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 34 , 0 (-* | ), 0.33, 0.34, 0.34, 0.34, 0.34
2 , Tuned_CART: Y-Def , 37 , 2 ( -- *-------| ), 0.34, 0.35, 0.37, 0.37, 0.42
3 , Naive_CART: Y-Def , 41 , 0 ( *| ), 0.41, 0.41, 0.41, 0.41, 0.41
3 , Grid_RF: Y-Def , 41 , 0 ( *|-- ), 0.41, 0.41, 0.41, 0.41, 0.43
3 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
4 , Tuned_RF: Y-Def , 47 , 1 ( | --------* - ), 0.43, 0.47, 0.47, 0.48, 0.49
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 27 , 0 (*- | ), 0.27, 0.27, 0.27, 0.27, 0.28
2 , Tuned_RF: Y-Def , 30 , 3 ( --- * | ), 0.28, 0.29, 0.30, 0.31, 0.31
3 , Grid_CART: Y-Def , 31 , 1 ( --- *----|----- ), 0.29, 0.30, 0.31, 0.31, 0.35
3 , Naive_RF: Y-Def , 33 , 0 ( |* ), 0.33, 0.33, 0.33, 0.33, 0.33
3 , Tuned_CART: Y-Def , 34 , 7 (-- | * ------ ), 0.27, 0.28, 0.34, 0.35, 0.37
3 , Naive_CART: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 33 , 0 (-*-- | ), 0.32, 0.33, 0.33, 0.33, 0.35
1 , Tuned_RF: Y-Def , 36 , 2 ( -- *- | ), 0.33, 0.34, 0.36, 0.36, 0.37
2 , Naive_RF: Y-Def , 42 , 0 ( |* ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Grid_CART: Y-Def , 43 , 1 ( -| *--------- ), 0.41, 0.42, 0.43, 0.43, 0.49
2 , Tuned_CART: Y-Def , 47 , 11 ( ---- | * ), 0.35, 0.37, 0.47, 0.48, 0.48
2 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 63 , 3 ( * ------ | ), 0.61, 0.61, 0.63, 0.64, 0.66
2 , Tuned_CART: Y-Def , 67 , 1 ( | *----- ), 0.66, 0.66, 0.67, 0.67, 0.69
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
3 , Tuned_RF: Y-Def , 69 , 0 ( | *-- ), 0.69, 0.69, 0.69, 0.69, 0.70
4 , Grid_RF: Y-Def , 70 , 0 ( | *-- ), 0.70, 0.70, 0.70, 0.70, 0.71
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1056
Grid_CART Running Time: 0.5654
Naive_RF Running Time: 0.0084
Tuned_RF Running Time: 21.842
Grid_RF Running Time: 157.5212
++++++++++++++++++++
DataSet: ivyV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 2 , 7 (* | ), 0.00, 0.00, 0.02, 0.07, 0.07
1 , Naive_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Tuned_CART: Y-Def , 20 , 30 ( * -| ), 0.00, 0.00, 0.20, 0.30, 0.32
2 , Grid_CART: Y-Def , 32 , 17 ( - * ----------- ), 0.17, 0.20, 0.32, 0.37, 0.60
2 , Naive_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 1 (* | ), 0.00, 0.00, 0.00, 0.01, 0.01
1 , Tuned_CART: Y-Def , 5 , 7 ( * | ), 0.00, 0.00, 0.05, 0.07, 0.07
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Grid_CART: Y-Def , 11 , 9 ( --- | * --- ), 0.03, 0.05, 0.11, 0.14, 0.16
2 , Naive_CART: Y-Def , 19 , 0 ( | *), 0.19, 0.19, 0.19, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Grid_CART: Y-Def , 28 , 4 ( --|-* ---- ), 0.22, 0.29, 0.29, 0.32, 0.40
2 , Tuned_CART: Y-Def , 32 , 35 ( | *-- ), 0.00, 0.00, 0.32, 0.35, 0.37
2 , Grid_RF: Y-Def , 37 , 42 ( | * ---- ), 0.00, 0.00, 0.37, 0.42, 0.50
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 4 , 12 ( * | ), 0.00, 0.00, 0.04, 0.12, 0.12
2 , Naive_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Tuned_CART: Y-Def , 24 , 32 ( | * -- ), 0.00, 0.00, 0.24, 0.32, 0.34
2 , Grid_CART: Y-Def , 26 , 6 ( -|--* ------- ), 0.21, 0.26, 0.26, 0.32, 0.42
2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 4 , 13 ( * | ), 0.00, 0.00, 0.04, 0.13, 0.13
2 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Tuned_CART: Y-Def , 33 , 45 ( *| - ), 0.00, 0.00, 0.33, 0.45, 0.48
2 , Grid_CART: Y-Def , 47 , 19 ( -- | * ------- ), 0.29, 0.33, 0.47, 0.52, 0.69
2 , Naive_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Grid_CART: Y-Def , 72 , 4 (-------------- * ----- ), 0.61, 0.71, 0.72, 0.75, 0.78
1 , Tuned_CART: Y-Def , 74 , 2 ( | *--- ), 0.73, 0.73, 0.74, 0.75, 0.77
2 , Grid_RF: Y-Def , 81 , 1 ( | -* ), 0.80, 0.81, 0.81, 0.82, 0.82
2 , Tuned_RF: Y-Def , 82 , 1 ( | *), 0.81, 0.81, 0.82, 0.82, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1494
Grid_CART Running Time: 0.6198
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 22.5022
Grid_RF Running Time: 166.6952
++++++++++++++++++++
DataSet: jeditV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 44 , 10 (- * | ), 0.35, 0.36, 0.44, 0.46, 0.46
1 , Naive_RF: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Tuned_CART: Y-Def , 48 , 6 ( ------- *-|------------- ), 0.36, 0.43, 0.48, 0.49, 0.63
1 , Grid_RF: Y-Def , 48 , 4 ( * | ), 0.45, 0.45, 0.48, 0.49, 0.49
1 , Tuned_RF: Y-Def , 50 , 1 ( - |* ), 0.48, 0.49, 0.50, 0.50, 0.51
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 3 , 1 (-* ----- | ), 0.02, 0.03, 0.03, 0.04, 0.07
2 , Tuned_RF: Y-Def , 7 , 1 ( -* ---- | ), 0.06, 0.07, 0.07, 0.08, 0.10
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Grid_CART: Y-Def , 10 , 4 ( - *|- ), 0.06, 0.07, 0.10, 0.11, 0.12
2 , Tuned_CART: Y-Def , 12 , 1 ( -----|-* ---------- ), 0.08, 0.12, 0.12, 0.13, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 56 , 5 (--- * ---- | ), 0.47, 0.52, 0.56, 0.58, 0.64
1 , Grid_CART: Y-Def , 59 , 7 ( - * -- | ), 0.55, 0.56, 0.59, 0.63, 0.65
2 , Naive_CART: Y-Def , 66 , 0 ( *| ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Naive_RF: Y-Def , 66 , 0 ( *| ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_RF: Y-Def , 69 , 3 ( --- |*--- ), 0.62, 0.66, 0.69, 0.69, 0.74
3 , Grid_RF: Y-Def , 80 , 2 ( |------- *---- ), 0.68, 0.79, 0.80, 0.81, 0.87
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 49 , 4 ( - * -|- ), 0.45, 0.46, 0.49, 0.50, 0.52
1 , Tuned_CART: Y-Def , 52 , 2 (---------------| *------- ), 0.41, 0.51, 0.52, 0.53, 0.57
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 56 , 4 ( | * - ), 0.55, 0.55, 0.57, 0.59, 0.60
2 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
2 , Grid_RF: Y-Def , 59 , 3 ( | - * ), 0.57, 0.58, 0.59, 0.60, 0.60
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 59 , 8 (- * -| ), 0.51, 0.52, 0.59, 0.60, 0.61
1 , Tuned_CART: Y-Def , 62 , 6 (----------- | *----------- ), 0.51, 0.58, 0.62, 0.63, 0.70
1 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Tuned_RF: Y-Def , 64 , 1 ( | --* - ), 0.63, 0.64, 0.64, 0.65, 0.66
1 , Grid_RF: Y-Def , 64 , 2 ( |- *- ), 0.61, 0.62, 0.64, 0.64, 0.65
1 , Naive_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_CART: Y-Def , 76 , 3 ( --- * | ), 0.74, 0.75, 0.76, 0.78, 0.78
1 , Grid_CART: Y-Def , 76 , 1 ( --- * | ), 0.74, 0.75, 0.76, 0.76, 0.76
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 83 , 1 ( | * ), 0.83, 0.83, 0.83, 0.84, 0.84
2 , Grid_RF: Y-Def , 84 , 1 ( | *), 0.83, 0.83, 0.84, 0.84, 0.84
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1556
Grid_CART Running Time: 0.6314
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 21.8502
Grid_RF Running Time: 167.6572
++++++++++++++++++++
DataSet: jeditV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_RF: Y-Def , 56 , 0 ( ---*--| ), 0.54, 0.56, 0.56, 0.56, 0.58
2 , Tuned_RF: Y-Def , 62 , 2 ( |-- * ), 0.58, 0.60, 0.62, 0.62, 0.62
2 , Grid_CART: Y-Def , 62 , 10 ( | *----- ), 0.52, 0.52, 0.62, 0.62, 0.66
2 , Naive_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
2 , Tuned_CART: Y-Def , 64 , 2 (---------------|----- *---- ), 0.47, 0.62, 0.64, 0.64, 0.68
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (---* | ), 0.09, 0.10, 0.10, 0.10, 0.10
1 , Tuned_RF: Y-Def , 11 , 0 (------*-- | ), 0.09, 0.11, 0.11, 0.11, 0.12
1 , Grid_CART: Y-Def , 11 , 2 (------* --| ), 0.09, 0.11, 0.11, 0.13, 0.14
2 , Naive_RF: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Tuned_CART: Y-Def , 15 , 3 (--------- | *--------- ), 0.09, 0.12, 0.15, 0.15, 0.18
2 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Tuned_CART: Y-Def , 38 , 4 ( -----* | ----- ), 0.36, 0.38, 0.38, 0.42, 0.44
1 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_RF: Y-Def , 44 , 1 ( | -----* ---- ), 0.42, 0.44, 0.44, 0.45, 0.47
2 , Grid_RF: Y-Def , 45 , 1 ( | --- *- ), 0.43, 0.44, 0.45, 0.45, 0.46
2 , Grid_CART: Y-Def , 45 , 3 (---------------|-- *- ), 0.34, 0.42, 0.45, 0.45, 0.46
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 48 , 1 ( --| *---- ), 0.46, 0.47, 0.48, 0.48, 0.50
2 , Grid_RF: Y-Def , 49 , 1 ( | * --- ), 0.49, 0.49, 0.49, 0.50, 0.51
2 , Grid_CART: Y-Def , 51 , 3 (---------------|----- * ), 0.41, 0.49, 0.51, 0.52, 0.52
2 , Tuned_RF: Y-Def , 52 , 1 ( | ------ *), 0.49, 0.51, 0.52, 0.52, 0.52
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_RF: Y-Def , 69 , 1 ( -- |*- ), 0.67, 0.68, 0.69, 0.69, 0.70
1 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_CART: Y-Def , 73 , 1 (---------------|------- *- ), 0.62, 0.72, 0.73, 0.73, 0.74
1 , Tuned_RF: Y-Def , 73 , 2 ( | -- * ), 0.70, 0.71, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 73 , 7 ( ----- | *--- ), 0.64, 0.66, 0.73, 0.73, 0.75
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Tuned_CART: Y-Def , 78 , 5 ( * | ), 0.77, 0.77, 0.78, 0.82, 0.82
1 , Grid_CART: Y-Def , 82 , 1 ( -------|---* ), 0.77, 0.82, 0.82, 0.83, 0.83
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 85 , 1 ( | * ), 0.85, 0.85, 0.85, 0.86, 0.86
2 , Grid_RF: Y-Def , 86 , 1 ( | *- ), 0.85, 0.85, 0.86, 0.86, 0.87
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 6}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.143
Grid_CART Running Time: 0.6764
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 20.7158
Grid_RF Running Time: 171.3476
++++++++++++++++++++
DataSet: jeditV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 45 , 0 (---------------|---* ), 0.27, 0.45, 0.45, 0.45, 0.45
1 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 1 ( ----* | ), 0.05, 0.07, 0.07, 0.08, 0.08
1 , Tuned_CART: Y-Def , 9 , 2 (------ * | ), 0.04, 0.07, 0.09, 0.09, 0.09
1 , Grid_RF: Y-Def , 9 , 2 ( * | ), 0.07, 0.07, 0.09, 0.09, 0.09
2 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Grid_CART: Y-Def , 11 , 1 ( |* ), 0.11, 0.11, 0.11, 0.12, 0.12
2 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 7 , 1 (----* | ), 0.05, 0.07, 0.07, 0.08, 0.08
2 , Tuned_CART: Y-Def , 10 , 2 ( * | ------------ ), 0.10, 0.10, 0.10, 0.12, 0.17
2 , Grid_RF: Y-Def , 10 , 1 ( * -|- ), 0.10, 0.10, 0.10, 0.11, 0.12
2 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Tuned_RF: Y-Def , 12 , 2 ( | *--------- ), 0.10, 0.10, 0.12, 0.12, 0.16
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 12 , 2 (-------* | ), 0.08, 0.12, 0.12, 0.14, 0.14
2 , Tuned_CART: Y-Def , 16 , 3 ( *| ---------- ), 0.16, 0.16, 0.16, 0.19, 0.25
2 , Grid_RF: Y-Def , 16 , 2 ( *| -- ), 0.16, 0.16, 0.16, 0.18, 0.19
2 , Naive_RF: Y-Def , 17 , 0 ( * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_RF: Y-Def , 19 , 2 ( | *------ ), 0.17, 0.17, 0.19, 0.19, 0.23
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 59 , 1 (---------------|----* ), 0.41, 0.59, 0.59, 0.60, 0.60
1 , Tuned_CART: Y-Def , 60 , 1 ( | * ), 0.60, 0.60, 0.60, 0.61, 0.61
1 , Tuned_RF: Y-Def , 60 , 1 ( | * ), 0.60, 0.60, 0.60, 0.61, 0.61
1 , Grid_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 64 , 1 ( *--- | ), 0.63, 0.63, 0.64, 0.64, 0.66
1 , Tuned_CART: Y-Def , 65 , 0 ( ---*- | ), 0.63, 0.65, 0.65, 0.65, 0.66
1 , Grid_CART: Y-Def , 67 , 8 (------ * | ------- ), 0.59, 0.63, 0.67, 0.71, 0.75
1 , Grid_RF: Y-Def , 69 , 2 ( -------- *- ), 0.62, 0.67, 0.69, 0.69, 0.70
1 , Naive_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 7}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.0908
Grid_CART Running Time: 0.5494
Naive_RF Running Time: 0.0066
Tuned_RF Running Time: 22.6146
Grid_RF Running Time: 151.347
++++++++++++++++++++
DataSet: log4jV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 15 , 0 (---------*-----|-- ), 0.07, 0.15, 0.15, 0.15, 0.23
2 , Tuned_CART: Y-Def , 23 , 0 ( --|--*---------- ), 0.19, 0.23, 0.23, 0.23, 0.33
2 , Naive_RF: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Grid_RF: Y-Def , 27 , 3 ( --|---- * ), 0.19, 0.25, 0.27, 0.28, 0.28
2 , Grid_CART: Y-Def , 28 , 3 ( -|-------- * -- ), 0.20, 0.28, 0.29, 0.31, 0.33
2 , Naive_CART: Y-Def , 33 , 0 ( | *), 0.33, 0.33, 0.33, 0.33, 0.33
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.06
1 , Tuned_CART: Y-Def , 6 , 0 (-----*---------|------------- ), 0.00, 0.06, 0.06, 0.06, 0.31
1 , Grid_RF: Y-Def , 6 , 0 (-----* | ), 0.00, 0.06, 0.06, 0.06, 0.06
2 , Grid_CART: Y-Def , 12 , 0 ( ------*---|------------- ), 0.06, 0.12, 0.12, 0.12, 0.31
2 , Naive_RF: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 93 , 0 ( * | ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94
1 , Grid_CART: Y-Def , 96 , 0 (--------------*|-- ), 0.92, 0.96, 0.96, 0.96, 0.97
1 , Tuned_CART: Y-Def , 97 , 0 (---------------|--*---------- ), 0.92, 0.97, 0.97, 0.97, 1.00
2 , Grid_RF: Y-Def , 98 , 0 ( | *------ ), 0.98, 0.98, 0.98, 0.98, 1.00
3 , Tuned_RF: Y-Def , 100 , 0 ( | -----------*), 0.97, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 1 (---------- *---|---- ), 0.13, 0.26, 0.27, 0.27, 0.38
2 , Tuned_CART: Y-Def , 38 , 0 ( |----*-------- ), 0.32, 0.38, 0.38, 0.38, 0.49
2 , Naive_RF: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Grid_RF: Y-Def , 42 , 2 ( |------- * ), 0.32, 0.41, 0.42, 0.43, 0.44
2 , Grid_CART: Y-Def , 44 , 3 ( | --------* - ), 0.34, 0.44, 0.44, 0.47, 0.49
2 , Naive_CART: Y-Def , 49 , 0 ( | *), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 1 (----------- *--|----- ), 0.13, 0.26, 0.27, 0.27, 0.37
2 , Tuned_CART: Y-Def , 37 , 0 ( | ----*------- ), 0.32, 0.37, 0.37, 0.37, 0.45
2 , Naive_RF: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_RF: Y-Def , 42 , 3 ( | ------- * ), 0.32, 0.40, 0.42, 0.43, 0.43
2 , Grid_CART: Y-Def , 43 , 2 ( | ---------* ), 0.33, 0.43, 0.43, 0.45, 0.46
2 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 51 , 10 (- * | --- ), 0.48, 0.49, 0.51, 0.59, 0.61
1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_CART: Y-Def , 56 , 2 ( -------- * | ), 0.50, 0.55, 0.56, 0.58, 0.58
2 , Tuned_RF: Y-Def , 57 , 0 ( -|*- ), 0.57, 0.58, 0.58, 0.58, 0.59
3 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Grid_RF: Y-Def , 64 , 3 ( | -- *-- ), 0.60, 0.61, 0.64, 0.64, 0.66
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 8}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1196
Grid_CART Running Time: 0.6214
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 21.9782
Grid_RF Running Time: 161.0534
++++++++++++++++++++
DataSet: luceneV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Naive_RF: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 63 , 2 ( ---* | ), 0.61, 0.63, 0.63, 0.65, 0.66
1 , Tuned_CART: Y-Def , 67 , 3 (---------------| * --- ), 0.53, 0.66, 0.67, 0.69, 0.71
1 , Grid_RF: Y-Def , 67 , 0 ( |--* ), 0.66, 0.67, 0.67, 0.67, 0.68
2 , Tuned_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.76
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 33 , 3 ( * -- | ), 0.32, 0.32, 0.33, 0.35, 0.37
1 , Naive_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_CART: Y-Def , 40 , 6 ( *| -- ), 0.37, 0.37, 0.40, 0.43, 0.45
2 , Tuned_RF: Y-Def , 43 , 2 ( | *- ), 0.42, 0.42, 0.43, 0.44, 0.45
2 , Tuned_CART: Y-Def , 48 , 13 (-------------- | * - ), 0.26, 0.40, 0.48, 0.53, 0.54
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 67 , 4 (-- * -|------------- ), 0.65, 0.66, 0.67, 0.70, 0.75
1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Grid_CART: Y-Def , 70 , 2 ( *|- ), 0.68, 0.68, 0.70, 0.70, 0.71
2 , Tuned_RF: Y-Def , 72 , 1 ( | * ), 0.71, 0.71, 0.72, 0.72, 0.72
2 , Naive_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
2 , Grid_RF: Y-Def , 74 , 2 ( | --- * ), 0.72, 0.73, 0.74, 0.75, 0.75
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 62 , 0 (* | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 66 , 2 ( * -- | ), 0.65, 0.65, 0.66, 0.67, 0.68
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 67 , 1 (------------* | ), 0.62, 0.67, 0.67, 0.68, 0.68
2 , Grid_RF: Y-Def , 70 , 1 ( | * ), 0.70, 0.70, 0.70, 0.71, 0.71
3 , Tuned_RF: Y-Def , 73 , 1 ( | * ), 0.73, 0.73, 0.73, 0.74, 0.74
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 57 , 5 (-- * -|- ), 0.55, 0.56, 0.58, 0.61, 0.62
1 , Naive_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 61 , 3 ( *| ), 0.59, 0.59, 0.61, 0.62, 0.62
2 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Tuned_RF: Y-Def , 64 , 1 ( | ---* ), 0.63, 0.64, 0.64, 0.65, 0.65
3 , Grid_RF: Y-Def , 66 , 2 ( | * ), 0.65, 0.65, 0.66, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 64 , 1 ( -----* --|-- ), 0.62, 0.64, 0.64, 0.65, 0.67
1 , Grid_CART: Y-Def , 64 , 1 ( *---| ), 0.63, 0.63, 0.64, 0.64, 0.66
2 , Grid_RF: Y-Def , 71 , 1 ( | *- ), 0.70, 0.70, 0.71, 0.71, 0.72
3 , Tuned_RF: Y-Def , 72 , 0 ( | *), 0.72, 0.72, 0.72, 0.72, 0.72
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 8}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1394
Grid_CART Running Time: 0.5902
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 22.0634
Grid_RF Running Time: 162.503
++++++++++++++++++++
DataSet: poiV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 2 , 1 ( --* -- | ), 0.01, 0.02, 0.02, 0.03, 0.04
1 , Grid_RF: Y-Def , 3 , 3 ( *- | ), 0.00, 0.00, 0.03, 0.03, 0.04
2 , Tuned_CART: Y-Def , 7 , 2 ( ---------- | * --- ), 0.02, 0.06, 0.07, 0.08, 0.09
2 , Grid_CART: Y-Def , 7 , 1 (-------------- | *------ ), 0.00, 0.06, 0.07, 0.07, 0.10
2 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 2 (* | ), 0.00, 0.00, 0.00, 0.02, 0.02
1 , Grid_RF: Y-Def , 1 , 2 ( * | ), 0.00, 0.00, 0.01, 0.02, 0.02
2 , Grid_CART: Y-Def , 4 , 3 (---- * ---|-------- ), 0.00, 0.02, 0.04, 0.05, 0.10
2 , Tuned_CART: Y-Def , 6 , 4 ( ----- *| ---------- ), 0.02, 0.04, 0.06, 0.08, 0.12
2 , Naive_RF: Y-Def , 6 , 0 ( *| ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 11 , 0 ( | * ), 0.11, 0.11, 0.11, 0.11, 0.11
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Tuned_CART: Y-Def , 66 , 20 ( -------|- * ), 0.29, 0.58, 0.66, 0.77, 0.78
1 , Grid_CART: Y-Def , 69 , 10 (---------------|--- * - ), 0.00, 0.65, 0.69, 0.75, 0.80
1 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Grid_RF: Y-Def , 72 , 76 ( | *-- ), 0.00, 0.00, 0.72, 0.76, 0.81
2 , Tuned_RF: Y-Def , 85 , 24 ( | * ), 0.75, 0.76, 0.85, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 2 ( -* -- | ), 0.03, 0.04, 0.04, 0.06, 0.07
1 , Grid_RF: Y-Def , 6 , 6 ( *- | ), 0.00, 0.00, 0.06, 0.06, 0.07
2 , Tuned_CART: Y-Def , 13 , 4 ( -----------| * - ), 0.03, 0.11, 0.13, 0.15, 0.16
2 , Grid_CART: Y-Def , 13 , 2 (---------------| *------ ), 0.00, 0.11, 0.13, 0.13, 0.18
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 2 ( -* - | ), 0.03, 0.04, 0.04, 0.06, 0.07
1 , Grid_RF: Y-Def , 6 , 7 ( * | ), 0.00, 0.00, 0.06, 0.07, 0.07
2 , Tuned_CART: Y-Def , 13 , 4 ( -----------| * --- ), 0.03, 0.11, 0.13, 0.15, 0.17
2 , Grid_CART: Y-Def , 13 , 1 (---------------|- *------ ), 0.00, 0.12, 0.13, 0.13, 0.18
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 21 , 0 ( | *), 0.21, 0.21, 0.21, 0.21, 0.21
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 37 , 1 ( -- *--------- | ), 0.35, 0.36, 0.37, 0.37, 0.43
1 , Tuned_RF: Y-Def , 37 , 1 ( -* --- | ), 0.36, 0.37, 0.37, 0.38, 0.40
1 , Grid_RF: Y-Def , 37 , 2 (--- * ----- | ), 0.34, 0.36, 0.37, 0.38, 0.41
2 , Grid_CART: Y-Def , 48 , 7 ( ----- | * --- ), 0.40, 0.43, 0.48, 0.50, 0.52
2 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 4, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 8}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.1648
Grid_CART Running Time: 0.6464
Naive_RF Running Time: 0.0088
Tuned_RF Running Time: 20.4172
Grid_RF Running Time: 172.8334
++++++++++++++++++++
DataSet: poiV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 1 , 50 (* | - ), 0.00, 0.00, 0.01, 0.50, 0.53
1 , Tuned_CART: Y-Def , 16 , 26 ( * | ), 0.00, 0.00, 0.16, 0.26, 0.26
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 11 (* | ---- ), 0.00, 0.00, 0.00, 0.11, 0.13
1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Tuned_CART: Y-Def , 3 , 7 ( * | ), 0.00, 0.00, 0.03, 0.07, 0.07
1 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
2 , Tuned_CART: Y-Def , 86 , 86 ( | * ), 0.00, 0.00, 0.86, 0.86, 0.90
2 , Grid_CART: Y-Def , 87 , 38 (-------------- | *-- ), 0.00, 0.50, 0.87, 0.88, 1.00
2 , Naive_RF: Y-Def , 92 , 0 ( | * ), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_CART: Y-Def , 2 , 64 (* | ), 0.00, 0.00, 0.02, 0.64, 0.66
2 , Tuned_CART: Y-Def , 28 , 40 ( * | ), 0.00, 0.00, 0.28, 0.40, 0.40
2 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_CART: Y-Def , 2 , 64 (* | ), 0.00, 0.00, 0.02, 0.64, 0.66
2 , Tuned_CART: Y-Def , 28 , 41 ( * | ), 0.00, 0.00, 0.28, 0.41, 0.41
2 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Naive_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 ( --* | ), 0.56, 0.59, 0.59, 0.59, 0.59
1 , Naive_CART: Y-Def , 63 , 0 ( |* ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 66 , 5 (---------------|- * --- ), 0.39, 0.64, 0.66, 0.69, 0.73
2 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
2 , Grid_RF: Y-Def , 79 , 2 ( | * ), 0.78, 0.79, 0.79, 0.81, 0.81
2 , Tuned_RF: Y-Def , 80 , 1 ( | -* ), 0.78, 0.80, 0.80, 0.81, 0.82
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 8}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.128
Grid_CART Running Time: 0.5586
Naive_RF Running Time: 0.0068
Tuned_RF Running Time: 20.3234
Grid_RF Running Time: 156.9548
++++++++++++++++++++
DataSet: synapseV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 17 , 14 (------ * | ), 0.00, 0.09, 0.17, 0.23, 0.23
1 , Grid_RF: Y-Def , 17 , 2 ( * | ), 0.16, 0.16, 0.17, 0.18, 0.19
1 , Grid_CART: Y-Def , 22 , 11 ( ---- |* --- ), 0.09, 0.15, 0.22, 0.26, 0.31
1 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_CART: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
1 , Tuned_CART: Y-Def , 38 , 7 (---------------|------- *- ), 0.00, 0.32, 0.38, 0.39, 0.41
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Tuned_RF: Y-Def , 3 , 3 (- * | ), 0.00, 0.01, 0.03, 0.04, 0.04
2 , Grid_CART: Y-Def , 4 , 1 ( ---* | ), 0.02, 0.04, 0.04, 0.05, 0.05
2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
3 , Tuned_CART: Y-Def , 7 , 5 (-----------* | ---------- ), 0.00, 0.07, 0.07, 0.12, 0.18
3 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 62 , 16 (---------------|--- * - ), 0.00, 0.52, 0.62, 0.68, 0.71
1 , Naive_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_CART: Y-Def , 70 , 5 ( | -- * ), 0.61, 0.66, 0.70, 0.71, 0.72
1 , Tuned_RF: Y-Def , 71 , 3 (---------------|----------*-- ), 0.00, 0.71, 0.71, 0.74, 0.80
1 , Grid_RF: Y-Def , 77 , 1 ( | * ), 0.77, 0.77, 0.77, 0.78, 0.80
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 28 , 19 (--------- |* ), 0.00, 0.16, 0.28, 0.35, 0.35
1 , Grid_RF: Y-Def , 28 , 4 ( |*- ), 0.26, 0.26, 0.28, 0.30, 0.31
1 , Grid_CART: Y-Def , 33 , 14 ( ----- | * --- ), 0.16, 0.24, 0.33, 0.38, 0.43
1 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Naive_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Tuned_CART: Y-Def , 45 , 6 (---------------|----------* ), 0.00, 0.44, 0.45, 0.50, 0.50
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 28 , 20 (--------- * ), 0.00, 0.17, 0.29, 0.37, 0.37
1 , Grid_RF: Y-Def , 28 , 4 ( *- ), 0.27, 0.27, 0.29, 0.31, 0.32
1 , Grid_CART: Y-Def , 35 , 15 ( ----- | * ---- ), 0.16, 0.26, 0.35, 0.41, 0.47
1 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 53 , 6 (---------------|--------- * ), 0.00, 0.48, 0.53, 0.54, 0.56
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 65 , 1 ( ------*-| ), 0.62, 0.65, 0.65, 0.66, 0.67
1 , Tuned_CART: Y-Def , 69 , 6 ( -- | * -- ), 0.63, 0.64, 0.69, 0.70, 0.71
1 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Tuned_RF: Y-Def , 72 , 1 ( | * - ), 0.72, 0.72, 0.72, 0.73, 0.74
2 , Grid_RF: Y-Def , 73 , 2 ( | * ), 0.72, 0.72, 0.73, 0.74, 0.74
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 9}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1182
Grid_CART Running Time: 0.5672
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 22.3704
Grid_RF Running Time: 158.2924
++++++++++++++++++++
DataSet: velocityV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 46 , 0 ( ----------*---|------------- ), 0.17, 0.46, 0.46, 0.46, 0.98
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Grid_CART: Y-Def , 91 , 9 (---------------|-------- *-- ), 0.12, 0.84, 0.91, 0.93, 1.00
1 , Tuned_RF: Y-Def , 97 , 6 ( | ----- * ), 0.78, 0.92, 0.97, 0.98, 1.00
1 , Grid_RF: Y-Def , 97 , 1 ( | --* ), 0.89, 0.96, 0.97, 0.97, 1.00
1 , Naive_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 41 , 3 ( --*----|------------- ), 0.33, 0.40, 0.41, 0.43, 0.97
1 , Grid_CART: Y-Def , 77 , 15 (---------------|------* -- ), 0.08, 0.76, 0.77, 0.91, 0.96
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Grid_RF: Y-Def , 90 , 11 ( | * ), 0.87, 0.88, 0.90, 0.99, 0.99
2 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_RF: Y-Def , 94 , 16 ( | --- * ), 0.74, 0.82, 0.94, 0.98, 0.99
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 ( |* ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_RF: Y-Def , 34 , 1 ( | * - ), 0.34, 0.34, 0.34, 0.35, 0.36
1 , Grid_RF: Y-Def , 34 , 1 ( |-* ), 0.33, 0.34, 0.34, 0.35, 0.35
1 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Tuned_CART: Y-Def , 35 , 2 (---------------|- *- ), 0.21, 0.34, 0.35, 0.36, 0.37
1 , Grid_CART: Y-Def , 36 , 3 ( | *-------- ), 0.34, 0.34, 0.36, 0.37, 0.43
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 1 (---------------|--*-------- ), 0.19, 0.40, 0.40, 0.41, 0.50
1 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Tuned_RF: Y-Def , 50 , 1 ( | --*- ), 0.48, 0.50, 0.50, 0.51, 0.52
1 , Grid_RF: Y-Def , 50 , 2 ( | * ), 0.50, 0.50, 0.50, 0.52, 0.52
1 , Grid_CART: Y-Def , 50 , 1 (---------------|-----------*- ), 0.19, 0.50, 0.50, 0.51, 0.53
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_RF: Y-Def , 10 , 25 (- * |----- ), 0.01, 0.03, 0.10, 0.29, 0.38
1 , Grid_RF: Y-Def , 16 , 19 ( * - | ), 0.01, 0.01, 0.16, 0.20, 0.22
1 , Grid_CART: Y-Def , 22 , 21 ( ----- * | - ), 0.07, 0.15, 0.22, 0.36, 0.37
1 , Naive_RF: Y-Def , 28 , 0 ( * ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Tuned_CART: Y-Def , 50 , 23 ( -------------| * ), 0.05, 0.28, 0.50, 0.51, 0.52
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 46 , 10 ( -- * | --- ), 0.43, 0.44, 0.46, 0.54, 0.56
1 , Tuned_CART: Y-Def , 50 , 9 (------ * | -- ), 0.41, 0.46, 0.50, 0.55, 0.57
1 , Grid_CART: Y-Def , 50 , 6 (---------- * | - ), 0.41, 0.49, 0.50, 0.55, 0.56
1 , Naive_CART: Y-Def , 52 , 0 ( *| ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Tuned_RF: Y-Def , 53 , 7 ( --- |* ------ ), 0.48, 0.50, 0.53, 0.58, 0.63
1 , Naive_RF: Y-Def , 53 , 0 ( |* ), 0.53, 0.53, 0.53, 0.53, 0.53
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 5, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 9}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1494
Grid_CART Running Time: 0.6224
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 21.6756
Grid_RF Running Time: 165.197
++++++++++++++++++++
DataSet: xercesV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_RF: Y-Def , 17 , 4 ( * | ), 0.13, 0.14, 0.17, 0.18, 0.18
1 , Grid_CART: Y-Def , 21 , 5 ( ---- *| ), 0.13, 0.18, 0.21, 0.23, 0.23
2 , Naive_CART: Y-Def , 23 , 0 ( * ), 0.23, 0.23, 0.23, 0.23, 0.23
2 , Tuned_CART: Y-Def , 26 , 15 (---------------| * ), 0.05, 0.24, 0.26, 0.39, 0.39
2 , Tuned_RF: Y-Def , 26 , 2 ( -| * ), 0.21, 0.24, 0.26, 0.26, 0.27
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 11 , 1 ( --* | ), 0.10, 0.11, 0.11, 0.12, 0.12
1 , Grid_RF: Y-Def , 11 , 4 (-------- * | ), 0.07, 0.10, 0.11, 0.14, 0.14
2 , Naive_RF: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_CART: Y-Def , 15 , 4 ( -------|--- * ), 0.10, 0.14, 0.15, 0.18, 0.18
2 , Grid_CART: Y-Def , 15 , 1 ( |--- *----- ), 0.13, 0.14, 0.15, 0.15, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Grid_RF: Y-Def , 18 , 4 ( ---*| -------- ), 0.16, 0.18, 0.18, 0.22, 0.27
1 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_CART: Y-Def , 21 , 5 ( -------- | * ), 0.12, 0.17, 0.21, 0.22, 0.22
1 , Tuned_CART: Y-Def , 23 , 4 (---------------|------* ), 0.09, 0.23, 0.23, 0.27, 0.27
2 , Tuned_RF: Y-Def , 27 , 2 ( | * ), 0.26, 0.26, 0.27, 0.28, 0.28
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Grid_RF: Y-Def , 18 , 0 ( -----* | ), 0.14, 0.18, 0.18, 0.18, 0.19
1 , Naive_CART: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Grid_CART: Y-Def , 22 , 4 ( -------- | * ), 0.12, 0.18, 0.22, 0.22, 0.22
2 , Tuned_CART: Y-Def , 24 , 8 (---------------|----* ), 0.07, 0.24, 0.24, 0.32, 0.32
2 , Tuned_RF: Y-Def , 26 , 2 ( | - *-- ), 0.24, 0.25, 0.26, 0.27, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 26 , 0 ( * | ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_RF: Y-Def , 28 , 5 ( -- * | ), 0.22, 0.25, 0.29, 0.30, 0.30
1 , Grid_CART: Y-Def , 34 , 6 ( ------ | * ), 0.22, 0.30, 0.34, 0.36, 0.36
2 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Tuned_CART: Y-Def , 39 , 14 (---------------|--- * ), 0.10, 0.38, 0.39, 0.52, 0.52
2 , Tuned_RF: Y-Def , 40 , 2 ( | -- * ), 0.34, 0.38, 0.40, 0.40, 0.41
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 57 , 4 ( ---|-* ), 0.56, 0.58, 0.58, 0.61, 0.61
1 , Grid_CART: Y-Def , 59 , 5 ( | * ), 0.55, 0.55, 0.59, 0.60, 0.60
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Grid_RF: Y-Def , 60 , 2 ( | ---* -- ), 0.59, 0.60, 0.60, 0.62, 0.63
2 , Tuned_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 6, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 9}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1658
Grid_CART Running Time: 0.6872
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 22.3342
Grid_RF Running Time: 175.7794
++++++++++++++++++++
DataSet: xercesV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (----* | ), 0.03, 0.05, 0.05, 0.05, 0.05
2 , Grid_CART: Y-Def , 8 , 1 ( ------- *---| ), 0.04, 0.07, 0.08, 0.08, 0.10
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
3 , Tuned_RF: Y-Def , 10 , 1 ( |* ), 0.10, 0.10, 0.10, 0.11, 0.11
4 , Naive_CART: Y-Def , 13 , 0 ( | * ), 0.13, 0.13, 0.13, 0.13, 0.13
4 , Tuned_CART: Y-Def , 16 , 0 ( | ------*), 0.13, 0.16, 0.16, 0.16, 0.16
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.01
1 , Grid_CART: Y-Def , 0 , 1 (* ----------|- ), 0.00, 0.00, 0.00, 0.01, 0.03
1 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_CART: Y-Def , 5 , 0 ( | *), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_RF: Y-Def , 96 , 5 ( --|--- * ), 0.92, 0.95, 0.96, 1.00, 1.00
1 , Grid_CART: Y-Def , 97 , 8 (------------- | * ), 0.85, 0.92, 0.97, 1.00, 1.00
2 , Tuned_RF: Y-Def , 98 , 1 ( | *--- ), 0.97, 0.97, 0.98, 0.98, 1.00
2 , Tuned_CART: Y-Def , 100 , 0 ( | ----*), 0.98, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 1 (-- * | ), 0.07, 0.09, 0.10, 0.10, 0.10
2 , Grid_CART: Y-Def , 14 , 1 (---------* ----| ), 0.07, 0.14, 0.14, 0.15, 0.18
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Tuned_RF: Y-Def , 19 , 2 ( | *- ), 0.18, 0.18, 0.19, 0.20, 0.21
4 , Naive_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
4 , Tuned_CART: Y-Def , 28 , 1 ( | ---- *), 0.24, 0.27, 0.28, 0.28, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 1 (-- * | ), 0.07, 0.09, 0.10, 0.10, 0.10
2 , Grid_CART: Y-Def , 14 , 1 (---------* ----| ), 0.07, 0.14, 0.14, 0.15, 0.18
2 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Tuned_RF: Y-Def , 19 , 2 ( | *- ), 0.18, 0.18, 0.19, 0.20, 0.21
4 , Naive_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
4 , Tuned_CART: Y-Def , 28 , 1 ( | ---- *), 0.24, 0.27, 0.28, 0.28, 0.28
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 43 , 1 (-* | ), 0.42, 0.43, 0.43, 0.44, 0.44
1 , Naive_CART: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
2 , Grid_RF: Y-Def , 45 , 1 ( -* | ), 0.44, 0.45, 0.45, 0.46, 0.46
2 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Tuned_CART: Y-Def , 56 , 4 ( ----*| ---- ), 0.52, 0.56, 0.56, 0.60, 0.64
4 , Tuned_RF: Y-Def , 66 , 3 ( | * - ), 0.66, 0.66, 0.66, 0.69, 0.70
In terms of 5 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 6, 'Tuned_CART: Y-Def': 11, 'Grid_RF: Y-Def': 9}
------------------------------------------------------------
Sender: LSF System <lsfadmin@n2d2-5>
Subject: Job 192185: </share3/wfu/miniconda/bin/python2.7 run.py run auc true> Done
Job </share3/wfu/miniconda/bin/python2.7 run.py run auc true> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>.
Job was executed on host(s) <n2d2-5>, in queue <serial>, as user <wfu> in cluster <henry2>.
</home/wfu> was used as the home directory.
</home/wfu/Github/Caret> was used as the working directory.
Started at Sun Feb 21 12:29:24 2016
Results reported at Sun Feb 21 17:00:36 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
/share3/wfu/miniconda/bin/python2.7 run.py run auc true
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 16265.08 sec.
Max Memory : 71 MB
Max Swap : 855 MB
Max Processes : 3
Max Threads : 4
The output (if any) is above this job summary.
PS:
Read file <./err/auc_true.err.192185> for stderr output of this job.
precision_uniformly_pick
gogogoogogo precision
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.1174
Grid_CART Running Time: 0.5264
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 21.3378
Grid_RF Running Time: 148.2282
++++++++++++++++++++
DataSet: antV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*- | ), 0.00, 0.00, 0.00, 0.00, 0.03
1 , Naive_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Grid_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Tuned_CART: Y-Def , 34 , 13 ( ------|- *- ), 0.12, 0.21, 0.34, 0.34, 0.37
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 3 , 0 ( * | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Grid_CART: Y-Def , 3 , 0 ( * | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Tuned_RF: Y-Def , 4 , 3 (---- * -- | ), 0.00, 0.03, 0.04, 0.06, 0.08
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_CART: Y-Def , 11 , 1 ( --------- *|------------- ), 0.03, 0.10, 0.11, 0.11, 0.22
2 , Naive_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*-- | ), 0.00, 0.00, 0.00, 0.00, 0.04
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 16 , 0 ( * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 28 , 1 ( ------|---------- *- ), 0.10, 0.27, 0.28, 0.28, 0.30
2 , Grid_RF: Y-Def , 30 , 0 ( | *), 0.30, 0.30, 0.30, 0.30, 0.30
2 , Grid_CART: Y-Def , 30 , 0 ( | *), 0.30, 0.30, 0.30, 0.30, 0.30
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*- | ), 0.00, 0.00, 0.00, 0.00, 0.03
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_RF: Y-Def , 16 , 0 ( *| ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_RF: Y-Def , 17 , 0 ( * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Grid_CART: Y-Def , 17 , 0 ( * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 30 , 14 ( --| * ), 0.14, 0.17, 0.30, 0.31, 0.32
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*-- | ), 0.00, 0.00, 0.00, 0.00, 0.06
2 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Grid_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Grid_CART: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
2 , Naive_RF: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 49 , 15 ( ---|--- * ), 0.22, 0.34, 0.49, 0.49, 0.52
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Tuned_CART: Y-Def , 57 , 11 ( ------- * | ---- ), 0.47, 0.54, 0.58, 0.65, 0.69
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 69 , 2 ( | - *--- ), 0.66, 0.67, 0.69, 0.69, 0.73
2 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
In terms of 2 : the times of better tuners are{'Grid_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1344
Grid_CART Running Time: 0.609
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 24.6624
Grid_RF Running Time: 153.2068
++++++++++++++++++++
DataSet: antV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 3 (* ------- | ), 0.00, 0.00, 0.00, 0.03, 0.10
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 21 , 3 ( |---- * ), 0.15, 0.19, 0.21, 0.22, 0.22
3 , Grid_CART: Y-Def , 23 , 0 ( | * ), 0.23, 0.23, 0.23, 0.23, 0.23
3 , Naive_CART: Y-Def , 28 , 0 ( | *), 0.28, 0.28, 0.28, 0.28, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*------- | ), 0.00, 0.00, 0.00, 0.00, 0.02
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_CART: Y-Def , 3 , 1 ( * | ), 0.03, 0.03, 0.03, 0.04, 0.04
2 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( | * ), 0.05, 0.05, 0.05, 0.05, 0.05
3 , Grid_CART: Y-Def , 7 , 0 ( | *), 0.07, 0.07, 0.07, 0.07, 0.07
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 62 (* | ----------- ), 0.00, 0.00, 0.00, 0.62, 1.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 53 , 0 ( * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 66 , 8 ( |-- * ), 0.53, 0.62, 0.66, 0.70, 0.70
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 6 (* --------- | ), 0.00, 0.00, 0.00, 0.06, 0.18
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 32 , 4 ( | ------ * ), 0.23, 0.30, 0.32, 0.34, 0.34
2 , Grid_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Naive_CART: Y-Def , 39 , 0 ( | *), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 6 (* --------- | ), 0.00, 0.00, 0.00, 0.06, 0.19
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.29, 0.29, 0.29, 0.29, 0.29
2 , Tuned_CART: Y-Def , 35 , 4 ( | ---- * ), 0.26, 0.32, 0.35, 0.36, 0.36
3 , Grid_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
3 , Naive_CART: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
2 , Tuned_CART: Y-Def , 70 , 0 ( ------*| ), 0.66, 0.70, 0.70, 0.70, 0.71
2 , Naive_RF: Y-Def , 71 , 0 ( * ), 0.71, 0.71, 0.71, 0.71, 0.71
3 , Tuned_RF: Y-Def , 81 , 0 ( | -*), 0.80, 0.81, 0.81, 0.81, 0.81
3 , Grid_RF: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Grid_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 1}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1712
Grid_CART Running Time: 0.62
Naive_RF Running Time: 0.0088
Tuned_RF Running Time: 26.6416
Grid_RF Running Time: 159.4484
++++++++++++++++++++
DataSet: antV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 27 , 14 ( * | ----- ), 0.19, 0.19, 0.27, 0.33, 0.39
1 , Tuned_RF: Y-Def , 33 , 13 (---------------|-* - ), 0.13, 0.33, 0.33, 0.46, 0.48
1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Grid_RF: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Naive_CART: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 3 , 3 (----* -- | ), 0.01, 0.03, 0.03, 0.06, 0.07
1 , Tuned_RF: Y-Def , 3 , 3 (----* -- | ), 0.01, 0.03, 0.03, 0.06, 0.07
2 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Grid_CART: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_CART: Y-Def , 62 , 11 ( -- * | ------- ), 0.58, 0.60, 0.62, 0.71, 0.78
1 , Grid_CART: Y-Def , 65 , 0 ( * ), 0.65, 0.65, 0.65, 0.65, 0.65
2 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Tuned_RF: Y-Def , 73 , 10 ( | * ---- ), 0.65, 0.65, 0.73, 0.75, 0.79
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 13 ( - * ---- ), 0.29, 0.30, 0.40, 0.43, 0.47
1 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
2 , Tuned_RF: Y-Def , 46 , 8 (---------------|-----* ), 0.23, 0.46, 0.46, 0.54, 0.55
2 , Naive_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Grid_CART: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
2 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 17 ( *| ---- ), 0.32, 0.32, 0.43, 0.49, 0.55
1 , Tuned_RF: Y-Def , 49 , 12 (---------------|---* - ), 0.24, 0.49, 0.49, 0.61, 0.63
1 , Naive_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
2 , Grid_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
2 , Grid_RF: Y-Def , 56 , 0 ( | * ), 0.56, 0.56, 0.56, 0.56, 0.56
2 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 75 , 2 ( -- * -- ), 0.73, 0.74, 0.75, 0.76, 0.77
1 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
2 , Grid_CART: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
3 , Tuned_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
4 , Grid_RF: Y-Def , 83 , 0 ( | *), 0.83, 0.83, 0.83, 0.83, 0.83
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 1}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.2094
Grid_CART Running Time: 0.6948
Naive_RF Running Time: 0.01
Tuned_RF Running Time: 23.0834
Grid_RF Running Time: 174.409
++++++++++++++++++++
DataSet: camelV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 1 ( *-- | ), 0.02, 0.03, 0.04, 0.04, 0.09
1 , Grid_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Grid_CART: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Tuned_CART: Y-Def , 16 , 11 ( * | ), 0.08, 0.08, 0.16, 0.19, 0.20
2 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_CART: Y-Def , 3 , 3 ( * - | ), 0.01, 0.01, 0.03, 0.04, 0.05
2 , Naive_RF: Y-Def , 13 , 0 ( |* ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 28 , 0 (* | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Tuned_CART: Y-Def , 48 , 3 ( ----- *---- | ), 0.36, 0.46, 0.48, 0.49, 0.60
1 , Grid_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_RF: Y-Def , 66 , 37 ( - * ), 0.60, 0.63, 0.66, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 2 ( *------ | ), 0.05, 0.06, 0.07, 0.08, 0.16
1 , Grid_RF: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_CART: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Tuned_CART: Y-Def , 22 , 12 ( * | ), 0.14, 0.15, 0.22, 0.27, 0.27
2 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
2 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 3 ( *---- | ), 0.05, 0.06, 0.07, 0.09, 0.17
1 , Grid_RF: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_CART: Y-Def , 28 , 16 ( * -| ), 0.15, 0.16, 0.28, 0.32, 0.33
2 , Naive_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 52 , 0 (* | ), 0.52, 0.52, 0.52, 0.52, 0.52
2 , Tuned_CART: Y-Def , 57 , 5 ( * --| ), 0.58, 0.58, 0.58, 0.62, 0.64
2 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
3 , Tuned_RF: Y-Def , 72 , 0 ( | --* ), 0.71, 0.72, 0.72, 0.72, 0.73
4 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
4 , Naive_RF: Y-Def , 74 , 0 ( | *), 0.74, 0.74, 0.74, 0.74, 0.74
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 3, 'Grid_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 1}
Naive_CART Running Time: 0.0034
Tuned_CART Running Time: 0.3158
Grid_CART Running Time: 0.9008
Naive_RF Running Time: 0.0126
Tuned_RF Running Time: 36.679
Grid_RF Running Time: 197.4004
++++++++++++++++++++
DataSet: camelV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Tuned_CART: Y-Def , 15 , 10 (----- * -|--- ), 0.02, 0.08, 0.15, 0.18, 0.24
2 , Grid_CART: Y-Def , 18 , 0 ( *| ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Tuned_RF: Y-Def , 20 , 16 ( - |*- ), 0.04, 0.05, 0.20, 0.21, 0.22
2 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Naive_CART: Y-Def , 35 , 0 ( | *), 0.35, 0.35, 0.35, 0.35, 0.35
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 4 , 5 ( * -- | ), 0.00, 0.00, 0.04, 0.05, 0.06
2 , Tuned_CART: Y-Def , 7 , 2 (------------ | *---- ), 0.00, 0.05, 0.07, 0.07, 0.09
2 , Grid_CART: Y-Def , 7 , 0 ( | * ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 8 , 0 ( | * ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Tuned_CART: Y-Def , 38 , 5 (-- *---- | ), 0.29, 0.33, 0.38, 0.38, 0.45
1 , Naive_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Naive_RF: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
2 , Tuned_RF: Y-Def , 52 , 26 ( - *| ), 0.47, 0.49, 0.52, 0.75, 0.76
2 , Grid_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Tuned_CART: Y-Def , 21 , 12 (------- *| --- ), 0.05, 0.13, 0.21, 0.25, 0.29
2 , Grid_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Tuned_RF: Y-Def , 28 , 19 ( | * ), 0.09, 0.09, 0.29, 0.29, 0.30
2 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Naive_CART: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 11 , 0 ( * | ), 0.11, 0.11, 0.11, 0.11, 0.11
2 , Tuned_CART: Y-Def , 27 , 16 (------ *| ---- ), 0.05, 0.15, 0.27, 0.31, 0.38
2 , Grid_CART: Y-Def , 30 , 0 ( |* ), 0.30, 0.30, 0.30, 0.30, 0.30
2 , Tuned_RF: Y-Def , 34 , 24 ( - | * ), 0.09, 0.10, 0.34, 0.34, 0.36
2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 65 , 3 (---------------| * ), 0.52, 0.62, 0.65, 0.65, 0.65
2 , Grid_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 69 , 4 ( | * - ), 0.66, 0.66, 0.69, 0.70, 0.71
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 3, 'Grid_RF: Y-Def': 2, 'Tuned_CART: Y-Def': 2}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1256
Grid_CART Running Time: 0.538
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 22.2482
Grid_RF Running Time: 148.9184
++++++++++++++++++++
DataSet: ivyV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 13 (- * -- | ), 0.00, 0.02, 0.05, 0.15, 0.17
1 , Grid_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Tuned_CART: Y-Def , 15 , 13 ( * -| ), 0.07, 0.07, 0.15, 0.20, 0.22
1 , Naive_CART: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 3 (* -- | ), 0.00, 0.00, 0.00, 0.03, 0.04
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_CART: Y-Def , 1 , 2 ( * ------ | ), 0.00, 0.00, 0.01, 0.02, 0.06
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Naive_CART: Y-Def , 19 , 0 ( | *), 0.19, 0.19, 0.19, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Tuned_RF: Y-Def , 35 , 15 (----------* -|------------- ), 0.00, 0.35, 0.35, 0.50, 1.00
1 , Tuned_CART: Y-Def , 54 , 13 ( ----- |* ), 0.32, 0.47, 0.54, 0.60, 0.60
1 , Grid_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 9 , 17 (---- * | -- ), 0.00, 0.04, 0.09, 0.21, 0.23
1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Naive_RF: Y-Def , 14 , 0 ( *| ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Grid_RF: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 23 , 13 ( | * -- ), 0.13, 0.13, 0.23, 0.26, 0.28
2 , Naive_CART: Y-Def , 28 , 0 ( | *), 0.28, 0.28, 0.28, 0.28, 0.28
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 9 , 21 (-- * --| ), 0.00, 0.04, 0.09, 0.25, 0.29
1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Grid_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_CART: Y-Def , 26 , 20 ( *| -- ), 0.13, 0.13, 0.26, 0.33, 0.36
1 , Naive_CART: Y-Def , 55 , 0 ( | *), 0.55, 0.55, 0.55, 0.55, 0.55
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Naive_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Tuned_CART: Y-Def , 68 , 22 ( | * ), 0.47, 0.47, 0.68, 0.69, 0.69
2 , Naive_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
2 , Tuned_RF: Y-Def , 80 , 3 ( | - *), 0.77, 0.78, 0.80, 0.81, 0.81
2 , Grid_RF: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 3, 'Tuned_CART: Y-Def': 2}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1462
Grid_CART Running Time: 0.5826
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 23.14
Grid_RF Running Time: 158.5398
++++++++++++++++++++
DataSet: jeditV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 34 , 0 (--------*------|------------- ), 0.27, 0.34, 0.34, 0.34, 0.53
1 , Grid_RF: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Tuned_RF: Y-Def , 49 , 3 ( -|----- *- ), 0.40, 0.46, 0.49, 0.49, 0.51
2 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 3 , 0 ( * | ), 0.03, 0.03, 0.03, 0.03, 0.03
2 , Tuned_RF: Y-Def , 6 , 1 ( *- | ), 0.05, 0.05, 0.06, 0.06, 0.07
2 , Tuned_CART: Y-Def , 8 , 2 (---------- *|------------- ), 0.01, 0.06, 0.08, 0.08, 0.15
2 , Naive_RF: Y-Def , 8 , 0 ( *| ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
3 , Grid_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Tuned_CART: Y-Def , 56 , 8 (---* ------|------------- ), 0.53, 0.57, 0.57, 0.64, 0.88
1 , Naive_CART: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Tuned_RF: Y-Def , 73 , 4 ( -----| * ), 0.65, 0.71, 0.73, 0.75, 0.75
3 , Grid_RF: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 42 , 2 (* ------------|-- ), 0.42, 0.42, 0.42, 0.44, 0.53
1 , Grid_CART: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_RF: Y-Def , 51 , 0 ( *| ), 0.51, 0.51, 0.51, 0.51, 0.51
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
2 , Tuned_RF: Y-Def , 59 , 3 ( --|-------- * ), 0.50, 0.57, 0.59, 0.59, 0.60
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 49 , 1 (-------* ------|------------ ), 0.43, 0.49, 0.49, 0.50, 0.65
1 , Grid_RF: Y-Def , 54 , 0 ( *| ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Grid_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Tuned_RF: Y-Def , 64 , 2 ( |-------- *- ), 0.56, 0.62, 0.64, 0.64, 0.66
2 , Naive_CART: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 68 , 0 (* | ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Naive_CART: Y-Def , 71 , 0 ( * | ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Tuned_CART: Y-Def , 75 , 2 ( * |- ), 0.74, 0.74, 0.75, 0.76, 0.77
3 , Tuned_RF: Y-Def , 82 , 1 ( | * ), 0.82, 0.82, 0.82, 0.83, 0.83
3 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
4 , Grid_RF: Y-Def , 83 , 0 ( | *), 0.83, 0.83, 0.83, 0.83, 0.83
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 4, 'Tuned_CART: Y-Def': 3}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1526
Grid_CART Running Time: 0.6194
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 25.6848
Grid_RF Running Time: 157.605
++++++++++++++++++++
DataSet: jeditV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 0 (----*----------| ), 0.39, 0.43, 0.43, 0.43, 0.52
1 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Grid_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 56 , 6 ( --------|- * -- ), 0.45, 0.54, 0.56, 0.60, 0.62
2 , Naive_CART: Y-Def , 64 , 0 ( | *), 0.64, 0.64, 0.64, 0.64, 0.64
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 5 , 0 (--*------------|---- ), 0.04, 0.05, 0.05, 0.05, 0.13
1 , Tuned_RF: Y-Def , 8 , 2 ( -----* --| ), 0.06, 0.08, 0.08, 0.10, 0.11
1 , Grid_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Grid_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Naive_RF: Y-Def , 13 , 0 ( | * ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Grid_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_RF: Y-Def , 48 , 3 ( ---- |* - ), 0.43, 0.46, 0.48, 0.49, 0.50
2 , Grid_RF: Y-Def , 48 , 0 ( |* ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Tuned_CART: Y-Def , 55 , 5 ( -------------|--- *-- ), 0.37, 0.50, 0.55, 0.55, 0.58
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 40 , 0 (* | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Naive_RF: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
2 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
2 , Tuned_CART: Y-Def , 48 , 4 ( --- | *---- ), 0.43, 0.44, 0.48, 0.48, 0.50
3 , Tuned_RF: Y-Def , 50 , 2 ( |-------* -- ), 0.47, 0.50, 0.50, 0.52, 0.53
3 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 (------*--------| ), 0.55, 0.59, 0.59, 0.59, 0.65
1 , Grid_CART: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
2 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Grid_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 69 , 4 ( ------|--- * --- ), 0.61, 0.67, 0.69, 0.71, 0.73
2 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 76 , 0 ( * | ), 0.76, 0.76, 0.76, 0.76, 0.76
2 , Tuned_CART: Y-Def , 80 , 0 ( --|*- ), 0.79, 0.80, 0.80, 0.80, 0.81
3 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
3 , Tuned_RF: Y-Def , 85 , 1 ( | * ), 0.85, 0.85, 0.85, 0.86, 0.86
3 , Grid_RF: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 4, 'Tuned_CART: Y-Def': 4}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1592
Grid_CART Running Time: 0.6034
Naive_RF Running Time: 0.009
Tuned_RF Running Time: 23.46
Grid_RF Running Time: 160.4878
++++++++++++++++++++
DataSet: jeditV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 36 , 18 (--------------*| ), 0.18, 0.36, 0.36, 0.54, 0.54
1 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_RF: Y-Def , 45 , 9 ( | * ), 0.36, 0.36, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 2 ( *--- | ), 0.03, 0.03, 0.05, 0.05, 0.07
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Tuned_CART: Y-Def , 8 , 6 (--- *| ), 0.00, 0.02, 0.08, 0.08, 0.08
2 , Naive_RF: Y-Def , 10 , 0 ( | * ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Grid_CART: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14
2 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Tuned_CART: Y-Def , 13 , 9 ( -----* | ----------- ), 0.08, 0.13, 0.13, 0.22, 0.33
2 , Grid_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_RF: Y-Def , 16 , 1 ( ----*---| ), 0.12, 0.16, 0.16, 0.17, 0.20
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 11 , 0 ( * | ), 0.11, 0.11, 0.11, 0.11, 0.11
2 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 21 , 2 ( ---------|---* ------ ), 0.13, 0.21, 0.21, 0.23, 0.27
2 , Tuned_RF: Y-Def , 23 , 1 ( |-------*-- ), 0.19, 0.23, 0.23, 0.24, 0.25
2 , Grid_RF: Y-Def , 23 , 0 ( | * ), 0.23, 0.23, 0.23, 0.23, 0.23
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 52 , 17 (---------------| * ), 0.30, 0.51, 0.52, 0.68, 0.68
1 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_RF: Y-Def , 61 , 9 ( | * ), 0.52, 0.52, 0.61, 0.61, 0.61
1 , Grid_RF: Y-Def , 61 , 0 ( | * ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 64 , 2 ( * ----| ), 0.63, 0.63, 0.64, 0.65, 0.68
1 , Grid_RF: Y-Def , 64 , 0 ( * | ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Tuned_CART: Y-Def , 67 , 4 (--------- *| ), 0.57, 0.64, 0.67, 0.68, 0.68
1 , Naive_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 4, 'Tuned_CART: Y-Def': 5}
Naive_CART Running Time: 0.0006
Tuned_CART Running Time: 0.093
Grid_CART Running Time: 0.5258
Naive_RF Running Time: 0.0066
Tuned_RF Running Time: 21.2554
Grid_RF Running Time: 143.2534
++++++++++++++++++++
DataSet: log4jV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 16 , 0 (* | ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_RF: Y-Def , 21 , 4 ( * -|----- ), 0.20, 0.20, 0.21, 0.24, 0.28
2 , Naive_RF: Y-Def , 24 , 0 ( *| ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Tuned_CART: Y-Def , 25 , 2 ( ------- *----- ), 0.19, 0.23, 0.25, 0.25, 0.28
3 , Grid_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
3 , Naive_CART: Y-Def , 33 , 0 ( | *), 0.33, 0.33, 0.33, 0.33, 0.33
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_CART: Y-Def , 6 , 0 ( *----- | ), 0.06, 0.06, 0.06, 0.06, 0.12
2 , Tuned_RF: Y-Def , 6 , 0 (-----*----- | ), 0.00, 0.06, 0.06, 0.06, 0.12
3 , Naive_RF: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
3 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
3 , Grid_CART: Y-Def , 31 , 0 ( | *), 0.31, 0.31, 0.31, 0.31, 0.31
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 91 , 0 (* | ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Naive_RF: Y-Def , 93 , 0 ( * | ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_CART: Y-Def , 97 , 1 ( |---* ), 0.96, 0.97, 0.97, 0.98, 0.98
2 , Tuned_RF: Y-Def , 97 , 1 ( --|---* ------ ), 0.95, 0.97, 0.97, 0.98, 1.00
3 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 28 , 0 (* | ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Tuned_RF: Y-Def , 34 , 6 ( * |----- ), 0.33, 0.33, 0.34, 0.39, 0.43
2 , Naive_RF: Y-Def , 38 , 0 ( *| ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_CART: Y-Def , 40 , 4 ( -------- | *--- ), 0.31, 0.37, 0.40, 0.41, 0.43
3 , Grid_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Naive_CART: Y-Def , 49 , 0 ( | *), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 28 , 0 (* | ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Tuned_RF: Y-Def , 34 , 5 ( * |-------- ), 0.33, 0.33, 0.34, 0.38, 0.43
2 , Naive_RF: Y-Def , 37 , 0 ( *| ), 0.37, 0.37, 0.37, 0.37, 0.37
2 , Grid_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Tuned_CART: Y-Def , 40 , 3 ( ---------- | *---- ), 0.31, 0.37, 0.40, 0.40, 0.43
2 , Naive_CART: Y-Def , 46 , 0 ( | *), 0.46, 0.46, 0.46, 0.46, 0.46
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_CART: Y-Def , 56 , 3 (----- * |-------- ), 0.51, 0.53, 0.56, 0.57, 0.60
2 , Tuned_RF: Y-Def , 59 , 0 ( --|-----*------- ), 0.56, 0.59, 0.59, 0.59, 0.62
2 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Grid_RF: Y-Def , 62 , 0 ( | *), 0.62, 0.62, 0.62, 0.62, 0.62
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 5, 'Tuned_CART: Y-Def': 6}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1168
Grid_CART Running Time: 0.585
Naive_RF Running Time: 0.0088
Tuned_RF Running Time: 22.0808
Grid_RF Running Time: 152.184
++++++++++++++++++++
DataSet: luceneV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 25 , 0 (* | ), 0.25, 0.25, 0.25, 0.25, 0.25
2 , Grid_CART: Y-Def , 31 , 0 ( * | ), 0.31, 0.31, 0.31, 0.31, 0.31
3 , Naive_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
3 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
3 , Grid_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
4 , Tuned_RF: Y-Def , 75 , 0 ( | -----*), 0.66, 0.75, 0.75, 0.75, 0.76
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Grid_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
3 , Naive_RF: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
3 , Grid_RF: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
3 , Naive_CART: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
4 , Tuned_RF: Y-Def , 45 , 2 ( | ----- * ), 0.37, 0.43, 0.45, 0.45, 0.47
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_RF: Y-Def , 71 , 2 (--- * --- | ), 0.68, 0.70, 0.71, 0.72, 0.74
1 , Grid_RF: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Naive_RF: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
2 , Grid_CART: Y-Def , 78 , 0 ( |* ), 0.78, 0.78, 0.78, 0.78, 0.78
3 , Tuned_CART: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 39 , 0 (* | ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Grid_CART: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
3 , Naive_CART: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
3 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
3 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
4 , Tuned_RF: Y-Def , 73 , 1 ( | -----* ), 0.67, 0.73, 0.73, 0.74, 0.75
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 0 (* | ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
3 , Naive_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
3 , Tuned_RF: Y-Def , 63 , 3 ( | --- * --- ), 0.59, 0.62, 0.63, 0.65, 0.68
3 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
3 , Grid_RF: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Grid_RF: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
3 , Tuned_RF: Y-Def , 72 , 1 ( | ------ *- ), 0.68, 0.71, 0.72, 0.72, 0.73
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 6, 'Tuned_CART: Y-Def': 7}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1642
Grid_CART Running Time: 0.5848
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 22.68
Grid_RF Running Time: 153.0938
++++++++++++++++++++
DataSet: poiV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_RF: Y-Def , 2 , 1 (----* ------- | ), 0.00, 0.02, 0.02, 0.03, 0.06
3 , Tuned_CART: Y-Def , 8 , 4 (--------- | *------- ), 0.00, 0.04, 0.08, 0.08, 0.11
3 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
3 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 2 (* | ), 0.00, 0.00, 0.00, 0.02, 0.02
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_CART: Y-Def , 4 , 4 ( *----|----------- ), 0.00, 0.00, 0.04, 0.04, 0.10
2 , Naive_RF: Y-Def , 6 , 0 ( |* ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 11 , 0 ( | *), 0.11, 0.11, 0.11, 0.11, 0.11
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_CART: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.65
2 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Tuned_CART: Y-Def , 77 , 11 (---------------|--- *--- ), 0.00, 0.66, 0.77, 0.77, 0.91
2 , Tuned_RF: Y-Def , 83 , 1 ( | ---*---- ), 0.72, 0.83, 0.83, 0.84, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_RF: Y-Def , 3 , 3 (----* -------| ), 0.00, 0.03, 0.03, 0.06, 0.11
3 , Tuned_CART: Y-Def , 15 , 7 (----------- | *----- ), 0.00, 0.08, 0.15, 0.15, 0.19
3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Naive_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Tuned_RF: Y-Def , 3 , 3 (----* -------|- ), 0.00, 0.03, 0.03, 0.06, 0.12
3 , Tuned_CART: Y-Def , 15 , 7 (----------- | *------ ), 0.00, 0.08, 0.15, 0.15, 0.20
3 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
3 , Naive_CART: Y-Def , 21 , 0 ( | *), 0.21, 0.21, 0.21, 0.21, 0.21
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 12 (- * | ), 0.25, 0.26, 0.27, 0.38, 0.39
1 , Grid_RF: Y-Def , 31 , 0 ( * | ), 0.31, 0.31, 0.31, 0.31, 0.31
2 , Grid_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Tuned_CART: Y-Def , 43 , 2 ( -------|--- * ), 0.32, 0.41, 0.43, 0.43, 0.44
2 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
2 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 6, 'Tuned_CART: Y-Def': 8}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.162
Grid_CART Running Time: 0.6194
Naive_RF Running Time: 0.0092
Tuned_RF Running Time: 22.2662
Grid_RF Running Time: 161.231
++++++++++++++++++++
DataSet: poiV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|------------- ), 0.00, 0.00, 0.00, 0.00, 0.26
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 26 , 0 ( | *), 0.26, 0.26, 0.26, 0.26, 0.26
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 2 (* ---------- | ), 0.00, 0.00, 0.00, 0.02, 0.07
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 20 (* ---------|------------ ), 0.00, 0.00, 0.00, 0.20, 0.86
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 92 , 0 ( | *), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|------------- ), 0.00, 0.00, 0.00, 0.00, 0.40
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 39 , 0 ( | *), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|------------- ), 0.00, 0.00, 0.00, 0.00, 0.41
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 40 , 0 ( | *), 0.40, 0.40, 0.40, 0.40, 0.40
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 (-* | ), 0.58, 0.59, 0.59, 0.59, 0.59
2 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Grid_CART: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
3 , Grid_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
3 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
4 , Tuned_RF: Y-Def , 79 , 1 ( | *- ), 0.79, 0.79, 0.79, 0.80, 0.81
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 4, 'Grid_RF: Y-Def': 6, 'Tuned_CART: Y-Def': 9}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1332
Grid_CART Running Time: 0.5502
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 23.019
Grid_RF Running Time: 148.1254
++++++++++++++++++++
DataSet: synapseV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 1 (-*------ | ), 0.02, 0.03, 0.03, 0.04, 0.10
2 , Grid_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
3 , Grid_RF: Y-Def , 19 , 0 ( | * ), 0.19, 0.19, 0.19, 0.19, 0.19
4 , Tuned_CART: Y-Def , 26 , 2 ( --|------ *--- ), 0.15, 0.24, 0.26, 0.26, 0.30
4 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
4 , Naive_CART: Y-Def , 31 , 0 ( | *), 0.31, 0.31, 0.31, 0.31, 0.31
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
3 , Tuned_CART: Y-Def , 4 , 1 (-------* -- | ), 0.00, 0.04, 0.04, 0.05, 0.06
3 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
3 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 68 , 0 ( * | ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Tuned_CART: Y-Def , 72 , 4 ( ---* |------------- ), 0.67, 0.72, 0.72, 0.76, 1.00
1 , Grid_RF: Y-Def , 77 , 0 ( |* ), 0.77, 0.77, 0.77, 0.77, 0.77
2 , Tuned_RF: Y-Def , 100 , 10 ( | ------ *), 0.80, 0.90, 1.00, 1.00, 1.00
2 , Grid_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 2 (-* -------- | ), 0.04, 0.06, 0.06, 0.08, 0.18
2 , Grid_CART: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
3 , Grid_RF: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
4 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
4 , Tuned_CART: Y-Def , 38 , 3 ( | -------- *-- ), 0.26, 0.36, 0.38, 0.39, 0.42
4 , Naive_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 2 (-*-------- | ), 0.04, 0.06, 0.06, 0.08, 0.18
2 , Grid_CART: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
3 , Grid_RF: Y-Def , 32 , 0 ( | * ), 0.32, 0.32, 0.32, 0.32, 0.32
3 , Tuned_CART: Y-Def , 41 , 3 ( |-------- *- ), 0.26, 0.38, 0.41, 0.41, 0.45
3 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
3 , Naive_CART: Y-Def , 45 , 0 ( | *), 0.45, 0.45, 0.45, 0.45, 0.45
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 55 , 0 (* | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 57 , 0 ( * | ), 0.58, 0.58, 0.58, 0.58, 0.58
2 , Tuned_CART: Y-Def , 69 , 3 ( ----|- * ), 0.63, 0.67, 0.69, 0.70, 0.70
2 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
3 , Grid_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
4 , Tuned_RF: Y-Def , 74 , 1 ( | - * ), 0.72, 0.73, 0.74, 0.74, 0.75
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 5, 'Grid_RF: Y-Def': 6, 'Tuned_CART: Y-Def': 9}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1338
Grid_CART Running Time: 0.5412
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 22.085
Grid_RF Running Time: 148.4532
++++++++++++++++++++
DataSet: velocityV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Tuned_CART: Y-Def , 46 , 39 (-------------* | --- ), 0.00, 0.46, 0.46, 0.85, 0.94
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Naive_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
2 , Tuned_RF: Y-Def , 100 , 17 ( | -- *), 0.74, 0.83, 1.00, 1.00, 1.00
2 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 41 , 25 (-----------* | ------ ), 0.03, 0.41, 0.41, 0.66, 0.86
1 , Grid_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Tuned_RF: Y-Def , 100 , 30 ( | - *), 0.65, 0.70, 1.00, 1.00, 1.00
2 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
2 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
2 , Tuned_RF: Y-Def , 34 , 2 ( | *- ), 0.34, 0.34, 0.34, 0.36, 0.37
2 , Grid_RF: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34
2 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Tuned_CART: Y-Def , 36 , 0 (---------------|-----------*- ), 0.00, 0.36, 0.36, 0.36, 0.39
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 30 , 0 ( |* ), 0.30, 0.30, 0.30, 0.30, 0.30
1 , Tuned_CART: Y-Def , 40 , 12 (---------------|------* - ), 0.00, 0.40, 0.40, 0.52, 0.54
2 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
2 , Tuned_RF: Y-Def , 50 , 0 ( | * ), 0.49, 0.50, 0.50, 0.50, 0.52
2 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
2 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 43 (* | -- ), 0.00, 0.00, 0.00, 0.43, 0.47
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Grid_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_CART: Y-Def , 47 , 27 (-------------- | * ), 0.00, 0.24, 0.47, 0.51, 0.51
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 40 , 0 (* | ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_CART: Y-Def , 50 , 4 ( ---* -|--- ), 0.47, 0.50, 0.50, 0.54, 0.59
2 , Naive_CART: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
2 , Naive_RF: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
3 , Tuned_RF: Y-Def , 68 , 9 ( | -- * ), 0.57, 0.59, 0.68, 0.68, 0.68
3 , Grid_RF: Y-Def , 69 , 0 ( | *), 0.69, 0.69, 0.69, 0.69, 0.69
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 5, 'Grid_RF: Y-Def': 6, 'Tuned_CART: Y-Def': 10}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1454
Grid_CART Running Time: 0.596
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 24.0082
Grid_RF Running Time: 155.9866
++++++++++++++++++++
DataSet: xercesV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Tuned_RF: Y-Def , 8 , 1 (-------- *- | ), 0.00, 0.07, 0.08, 0.08, 0.10
2 , Naive_RF: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_CART: Y-Def , 17 , 15 ( | * --- ), 0.08, 0.08, 0.17, 0.23, 0.26
2 , Grid_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Naive_CART: Y-Def , 23 , 0 ( | * ), 0.23, 0.23, 0.23, 0.23, 0.23
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
2 , Tuned_RF: Y-Def , 4 , 3 (- * | ), 0.00, 0.01, 0.04, 0.04, 0.04
3 , Grid_CART: Y-Def , 8 , 0 ( *| ), 0.08, 0.08, 0.08, 0.08, 0.08
4 , Tuned_CART: Y-Def , 12 , 2 ( | --* ----- ), 0.11, 0.12, 0.12, 0.14, 0.17
4 , Naive_RF: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14
4 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Tuned_CART: Y-Def , 20 , 9 ( -- *-- | ), 0.09, 0.12, 0.20, 0.21, 0.25
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Grid_CART: Y-Def , 26 , 0 ( * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_RF: Y-Def , 27 , 3 (---------------|*------------ ), 0.00, 0.27, 0.27, 0.30, 0.50
3 , Grid_RF: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_RF: Y-Def , 13 , 1 (-------------- |*- ), 0.00, 0.12, 0.13, 0.13, 0.15
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 13 ( - | * - ), 0.09, 0.10, 0.18, 0.23, 0.24
2 , Grid_CART: Y-Def , 20 , 0 ( | * ), 0.20, 0.20, 0.20, 0.20, 0.20
2 , Naive_CART: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Tuned_RF: Y-Def , 15 , 2 (--------- *- | ), 0.00, 0.13, 0.15, 0.15, 0.18
2 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 28 , 21 ( | * -- ), 0.15, 0.15, 0.29, 0.36, 0.39
2 , Grid_CART: Y-Def , 28 , 0 ( | * ), 0.29, 0.29, 0.29, 0.29, 0.29
2 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Grid_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
2 , Tuned_CART: Y-Def , 56 , 0 ( ---* |-------- ), 0.55, 0.56, 0.56, 0.57, 0.60
2 , Grid_RF: Y-Def , 56 , 0 ( |* ), 0.57, 0.57, 0.57, 0.57, 0.57
3 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
3 , Tuned_RF: Y-Def , 61 , 0 ( | ---*- ), 0.60, 0.61, 0.61, 0.61, 0.62
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 6, 'Grid_RF: Y-Def': 7, 'Tuned_CART: Y-Def': 10}
Naive_CART Running Time: 0.0016
Tuned_CART Running Time: 0.1892
Grid_CART Running Time: 0.6254
Naive_RF Running Time: 0.0082
Tuned_RF Running Time: 23.0876
Grid_RF Running Time: 164.4226
++++++++++++++++++++
DataSet: xercesV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Tuned_RF: Y-Def , 6 , 8 ( * | ------- ), 0.00, 0.00, 0.06, 0.08, 0.11
2 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_CART: Y-Def , 10 , 6 ( ------- | * ), 0.02, 0.05, 0.10, 0.11, 0.11
2 , Grid_CART: Y-Def , 10 , 0 ( | * ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.01
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 1 , 0 ( * | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_CART: Y-Def , 5 , 0 ( | *), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_CART: Y-Def , 93 , 0 ( * ), 0.93, 0.93, 0.93, 0.93, 0.93
2 , Tuned_CART: Y-Def , 100 , 0 ( ----|-------------*), 0.91, 1.00, 1.00, 1.00, 1.00
2 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
2 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Tuned_RF: Y-Def , 12 , 14 (- *| ------ ), 0.00, 0.01, 0.12, 0.15, 0.20
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 11 ( ------- | * -- ), 0.04, 0.09, 0.18, 0.20, 0.21
2 , Grid_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Naive_CART: Y-Def , 24 , 0 ( | *), 0.24, 0.24, 0.24, 0.24, 0.24
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Tuned_RF: Y-Def , 12 , 14 (- *| ------ ), 0.00, 0.01, 0.12, 0.15, 0.20
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 11 ( ------- | * -- ), 0.04, 0.09, 0.18, 0.20, 0.21
2 , Grid_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
2 , Naive_CART: Y-Def , 24 , 0 ( | *), 0.24, 0.24, 0.24, 0.24, 0.24
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 44 , 0 (* | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Grid_CART: Y-Def , 47 , 0 ( * | ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
2 , Grid_RF: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
3 , Tuned_CART: Y-Def , 60 , 2 ( --* --------- ), 0.58, 0.60, 0.60, 0.62, 0.71
4 , Tuned_RF: Y-Def , 69 , 6 ( | -* ), 0.68, 0.69, 0.69, 0.75, 0.75
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 10, 'Grid_CART: Y-Def': 6, 'Grid_RF: Y-Def': 7, 'Tuned_CART: Y-Def': 11}
------------------------------------------------------------
Sender: LSF System <lsfadmin@n2d1-9>
Subject: Job 192182: </share3/wfu/miniconda/bin/python2.7 run.py run precision false> Done
Job </share3/wfu/miniconda/bin/python2.7 run.py run precision false> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>.
Job was executed on host(s) <n2d1-9>, in queue <serial>, as user <wfu> in cluster <henry2>.
</home/wfu> was used as the home directory.
</home/wfu/Github/Caret> was used as the working directory.
Started at Sun Feb 21 12:29:24 2016
Results reported at Sun Feb 21 16:48:27 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
/share3/wfu/miniconda/bin/python2.7 run.py run precision false
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 15535.94 sec.
Max Memory : 71 MB
Max Swap : 855 MB
Max Processes : 3
Max Threads : 4
The output (if any) is above this job summary.
PS:
Read file <./err/precision_false.err.192182> for stderr output of this job.
check the following codes
- R part including tuning and default
- DE code
- wrapper
precision_randomly_pick
gogogoogogo precision
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1074
Grid_CART Running Time: 0.4952
Naive_RF Running Time: 0.0066
Tuned_RF Running Time: 19.7174
Grid_RF Running Time: 142.9316
++++++++++++++++++++
DataSet: antV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*- | ), 0.00, 0.00, 0.00, 0.00, 0.03
1 , Naive_CART: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Naive_RF: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Grid_CART: Y-Def , 21 , 16 ( ----- | * ), 0.12, 0.18, 0.21, 0.34, 0.34
2 , Grid_RF: Y-Def , 25 , 4 ( ---|- *- ), 0.15, 0.21, 0.25, 0.25, 0.28
2 , Tuned_CART: Y-Def , 34 , 13 ( ------|- *- ), 0.12, 0.21, 0.34, 0.34, 0.37
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 3 (---- * -- | ), 0.00, 0.03, 0.04, 0.06, 0.08
1 , Grid_RF: Y-Def , 7 , 1 ( -*-- | ), 0.06, 0.07, 0.07, 0.08, 0.09
2 , Grid_CART: Y-Def , 9 , 2 ( *--|------------- ), 0.07, 0.07, 0.09, 0.09, 0.22
2 , Naive_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_CART: Y-Def , 11 , 1 ( --------- *|------------- ), 0.03, 0.10, 0.11, 0.11, 0.22
2 , Naive_CART: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*-- | ), 0.00, 0.00, 0.00, 0.00, 0.04
1 , Naive_CART: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
2 , Naive_RF: Y-Def , 16 , 0 ( * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_CART: Y-Def , 18 , 10 ( -| * ---- ), 0.15, 0.16, 0.18, 0.26, 0.31
2 , Grid_RF: Y-Def , 25 , 4 ( | --- * - ), 0.21, 0.24, 0.25, 0.28, 0.29
2 , Tuned_CART: Y-Def , 28 , 1 ( ------|---------- *- ), 0.10, 0.27, 0.28, 0.28, 0.30
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*- | ), 0.00, 0.00, 0.00, 0.00, 0.03
1 , Naive_CART: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_RF: Y-Def , 16 , 0 ( *| ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Grid_CART: Y-Def , 21 , 6 ( --| * ------- ), 0.14, 0.18, 0.21, 0.24, 0.32
2 , Grid_RF: Y-Def , 26 , 4 ( |---- * ), 0.18, 0.22, 0.26, 0.26, 0.27
2 , Tuned_CART: Y-Def , 30 , 14 ( --| * ), 0.14, 0.17, 0.30, 0.31, 0.32
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*-- | ), 0.00, 0.00, 0.00, 0.00, 0.06
2 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
2 , Naive_RF: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Grid_CART: Y-Def , 35 , 16 ( ---|- * - ), 0.22, 0.31, 0.35, 0.47, 0.49
2 , Grid_RF: Y-Def , 39 , 4 ( -|---- *- ), 0.26, 0.35, 0.39, 0.39, 0.42
2 , Tuned_CART: Y-Def , 49 , 15 ( ---|--- * ), 0.22, 0.34, 0.49, 0.49, 0.52
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 57 , 11 ( ------- * | ---- ), 0.47, 0.54, 0.58, 0.65, 0.69
1 , Grid_CART: Y-Def , 59 , 6 ( --- *| - ), 0.55, 0.58, 0.59, 0.63, 0.64
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 69 , 2 ( | - *--- ), 0.66, 0.67, 0.69, 0.69, 0.73
2 , Grid_RF: Y-Def , 69 , 0 ( | -* ), 0.68, 0.69, 0.69, 0.69, 0.70
In terms of 2 : the times of better tuners are{'Tuned_CART: Y-Def': 1, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1288
Grid_CART Running Time: 0.5204
Naive_RF Running Time: 0.0068
Tuned_RF Running Time: 22.4446
Grid_RF Running Time: 148.1214
++++++++++++++++++++
DataSet: antV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 3 (* ------- | ), 0.00, 0.00, 0.00, 0.03, 0.10
1 , Grid_RF: Y-Def , 0 , 5 (* --------- | ), 0.00, 0.00, 0.00, 0.05, 0.14
2 , Grid_CART: Y-Def , 16 , 2 ( |-* - ), 0.15, 0.16, 0.16, 0.18, 0.19
2 , Naive_RF: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 21 , 3 ( |---- * ), 0.15, 0.19, 0.21, 0.22, 0.22
2 , Naive_CART: Y-Def , 28 , 0 ( | *), 0.28, 0.28, 0.28, 0.28, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (*---------- | ), 0.00, 0.00, 0.00, 0.00, 0.02
1 , Grid_RF: Y-Def , 0 , 0 (*--------------|- ), 0.00, 0.00, 0.00, 0.00, 0.03
2 , Tuned_CART: Y-Def , 3 , 1 ( | * ), 0.03, 0.03, 0.03, 0.04, 0.04
2 , Grid_CART: Y-Def , 3 , 1 ( ----------|-* ------ ), 0.01, 0.03, 0.03, 0.04, 0.05
2 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
2 , Naive_CART: Y-Def , 5 , 0 ( | *), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 62 (* | ----------- ), 0.00, 0.00, 0.00, 0.62, 1.00
1 , Grid_RF: Y-Def , 0 , 61 (* | ------ ), 0.00, 0.00, 0.00, 0.61, 0.83
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 62 , 11 ( | *-- ), 0.54, 0.55, 0.62, 0.66, 0.73
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 66 , 8 ( |-- * ), 0.53, 0.62, 0.66, 0.70, 0.70
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 6 (* --------- | ), 0.00, 0.00, 0.00, 0.06, 0.18
1 , Grid_RF: Y-Def , 0 , 10 (* --------|- ), 0.00, 0.00, 0.00, 0.10, 0.23
2 , Grid_CART: Y-Def , 25 , 2 ( | *--- ), 0.25, 0.25, 0.25, 0.27, 0.30
2 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 32 , 4 ( | ------ * ), 0.23, 0.30, 0.32, 0.34, 0.34
2 , Naive_CART: Y-Def , 39 , 0 ( | *), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 6 (* --------- | ), 0.00, 0.00, 0.00, 0.06, 0.19
1 , Grid_RF: Y-Def , 0 , 10 (* ---------| ), 0.00, 0.00, 0.00, 0.10, 0.24
2 , Grid_CART: Y-Def , 27 , 3 ( | * -- ), 0.26, 0.27, 0.27, 0.30, 0.32
2 , Naive_RF: Y-Def , 28 , 0 ( | * ), 0.29, 0.29, 0.29, 0.29, 0.29
3 , Tuned_CART: Y-Def , 35 , 4 ( | ---- * ), 0.26, 0.32, 0.35, 0.36, 0.36
3 , Naive_CART: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 60 , 0 (* | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_CART: Y-Def , 65 , 5 (---- * ----| ), 0.60, 0.63, 0.65, 0.68, 0.71
1 , Tuned_CART: Y-Def , 70 , 0 ( ------*| ), 0.66, 0.70, 0.70, 0.70, 0.71
1 , Naive_RF: Y-Def , 71 , 0 ( * ), 0.71, 0.71, 0.71, 0.71, 0.71
2 , Grid_RF: Y-Def , 79 , 2 ( | ---- * ), 0.75, 0.78, 0.79, 0.80, 0.80
3 , Tuned_RF: Y-Def , 81 , 0 ( | -*), 0.80, 0.81, 0.81, 0.81, 0.81
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0018
Tuned_CART Running Time: 0.1506
Grid_CART Running Time: 0.564
Naive_RF Running Time: 0.0076
Tuned_RF Running Time: 24.3496
Grid_RF Running Time: 155.4216
++++++++++++++++++++
DataSet: antV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 27 , 14 ( * | ----- ), 0.19, 0.19, 0.27, 0.33, 0.39
1 , Tuned_RF: Y-Def , 33 , 13 (---------------|-* - ), 0.13, 0.33, 0.33, 0.46, 0.48
1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_RF: Y-Def , 37 , 8 ( -----| * ), 0.25, 0.31, 0.37, 0.39, 0.39
1 , Grid_CART: Y-Def , 39 , 4 ( | -- *- ), 0.33, 0.36, 0.39, 0.40, 0.42
1 , Naive_CART: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 3 , 3 (----* -- | ), 0.01, 0.03, 0.03, 0.06, 0.07
1 , Tuned_RF: Y-Def , 3 , 3 (----* -- | ), 0.01, 0.03, 0.03, 0.06, 0.07
1 , Grid_RF: Y-Def , 4 , 2 ( -- * | ), 0.02, 0.03, 0.04, 0.05, 0.05
2 , Grid_CART: Y-Def , 6 , 2 ( --------* | ----- ), 0.03, 0.06, 0.06, 0.08, 0.10
2 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_CART: Y-Def , 62 , 11 ( -- * | ------- ), 0.58, 0.60, 0.62, 0.71, 0.78
1 , Grid_CART: Y-Def , 65 , 12 ( - *---- ), 0.53, 0.54, 0.65, 0.66, 0.70
2 , Grid_RF: Y-Def , 70 , 2 ( | -- *----- ), 0.67, 0.69, 0.70, 0.71, 0.76
2 , Tuned_RF: Y-Def , 73 , 10 ( | * ---- ), 0.65, 0.65, 0.73, 0.75, 0.79
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 13 ( - * ---- ), 0.29, 0.30, 0.40, 0.43, 0.47
1 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Tuned_RF: Y-Def , 46 , 8 (---------------|-----* ), 0.23, 0.46, 0.46, 0.54, 0.55
1 , Grid_CART: Y-Def , 47 , 4 ( | -- * - ), 0.43, 0.45, 0.47, 0.49, 0.50
1 , Naive_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 49 , 5 ( -|--- * ), 0.38, 0.44, 0.49, 0.49, 0.50
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 17 ( *| ---- ), 0.32, 0.32, 0.43, 0.49, 0.55
1 , Tuned_RF: Y-Def , 49 , 12 (---------------|---* - ), 0.24, 0.49, 0.49, 0.61, 0.63
1 , Naive_RF: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
1 , Grid_RF: Y-Def , 54 , 8 ( ---|- * ), 0.40, 0.47, 0.54, 0.55, 0.56
1 , Grid_CART: Y-Def , 55 , 5 ( | - * ), 0.49, 0.51, 0.55, 0.57, 0.57
1 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 75 , 2 ( -- * -- ), 0.73, 0.74, 0.75, 0.76, 0.77
1 , Grid_CART: Y-Def , 75 , 2 ( -- * -- ), 0.73, 0.74, 0.75, 0.76, 0.77
1 , Naive_RF: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
2 , Tuned_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Grid_RF: Y-Def , 83 , 1 ( | *), 0.82, 0.82, 0.83, 0.83, 0.83
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 2, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 2, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.187
Grid_CART Running Time: 0.6546
Naive_RF Running Time: 0.009
Tuned_RF Running Time: 21.0994
Grid_RF Running Time: 171.8328
++++++++++++++++++++
DataSet: camelV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 1 ( *-- | ), 0.02, 0.03, 0.04, 0.04, 0.09
2 , Tuned_CART: Y-Def , 16 , 11 ( * | ), 0.08, 0.08, 0.16, 0.19, 0.20
2 , Grid_RF: Y-Def , 20 , 9 ( ------ * | ), 0.07, 0.17, 0.20, 0.26, 0.27
3 , Grid_CART: Y-Def , 31 , 7 ( ---|--* -- ), 0.21, 0.30, 0.31, 0.37, 0.40
3 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
3 , Naive_CART: Y-Def , 48 , 0 ( | *), 0.48, 0.48, 0.48, 0.48, 0.48
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_RF: Y-Def , 2 , 1 (--* | ), 0.00, 0.02, 0.02, 0.03, 0.03
2 , Tuned_CART: Y-Def , 3 , 3 ( * - | ), 0.01, 0.01, 0.03, 0.04, 0.05
3 , Grid_CART: Y-Def , 10 , 3 ( --* |-- ), 0.09, 0.10, 0.10, 0.13, 0.14
3 , Naive_RF: Y-Def , 13 , 0 ( |* ), 0.13, 0.13, 0.13, 0.13, 0.13
3 , Naive_CART: Y-Def , 23 , 0 ( | *), 0.23, 0.23, 0.23, 0.23, 0.23
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 28 , 0 (* | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Grid_CART: Y-Def , 36 , 1 (--* | ), 0.31, 0.35, 0.36, 0.36, 0.37
1 , Naive_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Tuned_CART: Y-Def , 48 , 3 ( ----- *---- | ), 0.36, 0.46, 0.48, 0.49, 0.60
3 , Grid_RF: Y-Def , 57 , 6 ( -* -|-- ), 0.56, 0.58, 0.58, 0.63, 0.73
3 , Tuned_RF: Y-Def , 66 , 37 ( - * ), 0.60, 0.63, 0.66, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 2 ( *------ | ), 0.05, 0.06, 0.07, 0.08, 0.16
2 , Tuned_CART: Y-Def , 22 , 12 ( * | ), 0.14, 0.15, 0.22, 0.27, 0.27
3 , Grid_RF: Y-Def , 30 , 10 ( ---------| * -- ), 0.13, 0.26, 0.30, 0.36, 0.38
3 , Grid_CART: Y-Def , 33 , 4 ( |------* ), 0.25, 0.33, 0.33, 0.37, 0.37
3 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
3 , Naive_RF: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 7 , 3 ( *---- | ), 0.05, 0.06, 0.07, 0.09, 0.17
2 , Tuned_CART: Y-Def , 28 , 16 ( * -| ), 0.15, 0.16, 0.28, 0.32, 0.33
2 , Grid_RF: Y-Def , 34 , 13 ( --------- * - ), 0.14, 0.29, 0.34, 0.41, 0.42
3 , Grid_CART: Y-Def , 46 , 7 ( |----- * - ), 0.34, 0.45, 0.46, 0.52, 0.54
3 , Naive_CART: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
3 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 57 , 5 (* --- | ), 0.58, 0.58, 0.58, 0.62, 0.64
1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_CART: Y-Def , 63 , 4 ( - * -- | ), 0.60, 0.61, 0.63, 0.65, 0.66
2 , Tuned_RF: Y-Def , 72 , 0 ( | --* ), 0.71, 0.72, 0.72, 0.72, 0.73
3 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
3 , Grid_RF: Y-Def , 76 , 0 ( | -*), 0.75, 0.76, 0.76, 0.76, 0.76
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 3, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 3, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.003
Tuned_CART Running Time: 0.2908
Grid_CART Running Time: 0.8224
Naive_RF Running Time: 0.0158
Tuned_RF Running Time: 33.4104
Grid_RF Running Time: 195.2108
++++++++++++++++++++
DataSet: camelV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 15 , 10 (----- * -|--- ), 0.02, 0.08, 0.15, 0.18, 0.24
1 , Grid_RF: Y-Def , 18 , 2 ( ------ *| ), 0.09, 0.16, 0.18, 0.18, 0.19
1 , Tuned_RF: Y-Def , 20 , 16 ( - |*- ), 0.04, 0.05, 0.20, 0.21, 0.22
2 , Grid_CART: Y-Def , 27 , 2 ( | - *---- ), 0.25, 0.26, 0.27, 0.28, 0.32
2 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Naive_CART: Y-Def , 35 , 0 ( | *), 0.35, 0.35, 0.35, 0.35, 0.35
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 5 ( * -- | ), 0.00, 0.00, 0.04, 0.05, 0.06
1 , Grid_RF: Y-Def , 5 , 2 ( ---- *- | ), 0.01, 0.03, 0.05, 0.05, 0.06
1 , Tuned_CART: Y-Def , 7 , 2 (----------- |*--- ), 0.00, 0.05, 0.07, 0.07, 0.09
1 , Naive_RF: Y-Def , 8 , 0 ( | * ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
2 , Grid_CART: Y-Def , 13 , 0 ( | ----*), 0.11, 0.13, 0.13, 0.13, 0.13
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 34 , 2 ( * | ), 0.32, 0.32, 0.34, 0.34, 0.36
1 , Tuned_CART: Y-Def , 38 , 5 (-- *---- | ), 0.29, 0.33, 0.38, 0.38, 0.45
1 , Naive_CART: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Naive_RF: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
2 , Grid_RF: Y-Def , 46 , 11 ( - * |-------- ), 0.41, 0.43, 0.46, 0.54, 0.68
2 , Tuned_RF: Y-Def , 52 , 26 ( - *| ), 0.47, 0.49, 0.52, 0.75, 0.76
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 21 , 12 (------- *| --- ), 0.05, 0.13, 0.21, 0.25, 0.29
1 , Grid_RF: Y-Def , 25 , 1 ( ------|--* ), 0.15, 0.25, 0.25, 0.26, 0.26
1 , Tuned_RF: Y-Def , 28 , 19 ( | * ), 0.09, 0.09, 0.29, 0.29, 0.30
1 , Grid_CART: Y-Def , 28 , 3 ( | * --- ), 0.28, 0.28, 0.29, 0.31, 0.34
1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Naive_CART: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 27 , 16 (------ *| ---- ), 0.05, 0.15, 0.27, 0.31, 0.38
1 , Grid_RF: Y-Def , 30 , 3 ( --------|* ), 0.16, 0.28, 0.30, 0.31, 0.31
1 , Tuned_RF: Y-Def , 34 , 24 ( - | * ), 0.09, 0.10, 0.34, 0.34, 0.36
2 , Grid_CART: Y-Def , 41 , 3 ( | --* -- ), 0.38, 0.40, 0.41, 0.43, 0.47
2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Naive_CART: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 64 , 2 ( -| *- ), 0.61, 0.62, 0.64, 0.64, 0.65
1 , Tuned_CART: Y-Def , 65 , 3 (---------------| * ), 0.52, 0.62, 0.65, 0.65, 0.65
2 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
2 , Tuned_RF: Y-Def , 69 , 4 ( | * - ), 0.66, 0.66, 0.69, 0.70, 0.71
2 , Grid_RF: Y-Def , 70 , 2 ( | * ), 0.68, 0.68, 0.70, 0.70, 0.71
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 4, 'Grid_RF: Y-Def': 1}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1062
Grid_CART Running Time: 0.502
Naive_RF Running Time: 0.0066
Tuned_RF Running Time: 20.442
Grid_RF Running Time: 143.7604
++++++++++++++++++++
DataSet: ivyV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 13 (- * - | ), 0.00, 0.02, 0.05, 0.15, 0.17
1 , Naive_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Tuned_CART: Y-Def , 15 , 13 ( * - | ), 0.07, 0.07, 0.15, 0.20, 0.22
1 , Grid_RF: Y-Def , 17 , 3 ( * | ), 0.17, 0.17, 0.17, 0.20, 0.20
2 , Grid_CART: Y-Def , 27 , 20 ( * ---- ), 0.25, 0.25, 0.27, 0.45, 0.52
2 , Naive_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 3 (* -- | ), 0.00, 0.00, 0.00, 0.03, 0.04
1 , Tuned_CART: Y-Def , 1 , 2 ( * ------ | ), 0.00, 0.00, 0.01, 0.02, 0.06
1 , Grid_RF: Y-Def , 1 , 0 (-*- | ), 0.00, 0.01, 0.01, 0.01, 0.02
2 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Grid_CART: Y-Def , 9 , 1 ( *|------- ), 0.08, 0.08, 0.09, 0.09, 0.15
2 , Naive_CART: Y-Def , 19 , 0 ( | *), 0.19, 0.19, 0.19, 0.19, 0.19
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_CART: Y-Def , 28 , 3 ( -*- | ), 0.25, 0.27, 0.28, 0.30, 0.36
2 , Tuned_RF: Y-Def , 35 , 15 (----------* -|------------- ), 0.00, 0.35, 0.35, 0.50, 1.00
2 , Tuned_CART: Y-Def , 54 , 13 ( ----- |* ), 0.32, 0.47, 0.54, 0.60, 0.60
2 , Grid_RF: Y-Def , 66 , 13 ( ---| *--- ), 0.43, 0.53, 0.66, 0.66, 0.77
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 9 , 17 (-- * |- ), 0.00, 0.04, 0.09, 0.21, 0.23
1 , Naive_RF: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Tuned_CART: Y-Def , 23 , 13 ( | * - ), 0.13, 0.13, 0.23, 0.26, 0.28
2 , Naive_CART: Y-Def , 28 , 0 ( | * ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Grid_RF: Y-Def , 28 , 4 ( | -- * ), 0.24, 0.26, 0.28, 0.30, 0.30
2 , Grid_CART: Y-Def , 28 , 13 ( | * - ), 0.25, 0.25, 0.28, 0.38, 0.40
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 9 , 21 (- * -- | ), 0.00, 0.04, 0.09, 0.25, 0.29
1 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_CART: Y-Def , 26 , 20 ( * | ), 0.13, 0.13, 0.26, 0.33, 0.36
1 , Grid_RF: Y-Def , 28 , 5 ( * | ), 0.29, 0.29, 0.29, 0.33, 0.33
2 , Grid_CART: Y-Def , 42 , 21 ( | * - ), 0.39, 0.39, 0.42, 0.60, 0.64
2 , Naive_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 61 , 0 ( * | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Grid_CART: Y-Def , 67 , 3 ( |-* ----- ), 0.65, 0.67, 0.67, 0.70, 0.76
1 , Tuned_CART: Y-Def , 68 , 22 ( | * ), 0.47, 0.47, 0.68, 0.69, 0.69
1 , Naive_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
2 , Tuned_RF: Y-Def , 80 , 3 ( | - *), 0.77, 0.78, 0.80, 0.81, 0.81
2 , Grid_RF: Y-Def , 81 , 2 ( | *), 0.79, 0.79, 0.81, 0.81, 0.81
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 1, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 2}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1306
Grid_CART Running Time: 0.5536
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 21.0508
Grid_RF Running Time: 153.4818
++++++++++++++++++++
DataSet: jeditV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 34 , 0 (--------*------|------------- ), 0.27, 0.34, 0.34, 0.34, 0.53
1 , Grid_CART: Y-Def , 43 , 1 (---------------|--*-- ), 0.27, 0.43, 0.43, 0.44, 0.46
2 , Grid_RF: Y-Def , 46 , 5 ( | * - ), 0.43, 0.43, 0.46, 0.48, 0.49
2 , Naive_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
2 , Tuned_RF: Y-Def , 49 , 3 ( -|----- *- ), 0.40, 0.46, 0.49, 0.49, 0.51
2 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 3 , 1 ( --* | ), 0.02, 0.03, 0.03, 0.04, 0.04
2 , Tuned_RF: Y-Def , 6 , 1 ( *- | ), 0.05, 0.05, 0.06, 0.06, 0.07
2 , Grid_CART: Y-Def , 7 , 3 ( ------ * | ------ ), 0.03, 0.06, 0.07, 0.09, 0.12
2 , Tuned_CART: Y-Def , 8 , 2 (---------- *|------------- ), 0.01, 0.06, 0.08, 0.08, 0.15
2 , Naive_RF: Y-Def , 8 , 0 ( *| ), 0.08, 0.08, 0.08, 0.08, 0.08
2 , Naive_CART: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 56 , 8 (---* ------|------------- ), 0.53, 0.57, 0.57, 0.64, 0.88
1 , Grid_CART: Y-Def , 65 , 7 (-------- * -|- ), 0.53, 0.63, 0.65, 0.70, 0.73
1 , Naive_CART: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_RF: Y-Def , 73 , 4 ( -----| * ), 0.65, 0.71, 0.73, 0.75, 0.75
2 , Grid_RF: Y-Def , 80 , 3 ( | *----- ), 0.79, 0.79, 0.80, 0.82, 0.87
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 42 , 2 ( * ----------|--- ), 0.42, 0.42, 0.42, 0.44, 0.53
1 , Grid_CART: Y-Def , 51 , 7 (---------- |* ), 0.40, 0.47, 0.51, 0.54, 0.54
2 , Naive_RF: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
2 , Tuned_RF: Y-Def , 59 , 3 ( -|--------- * ), 0.50, 0.57, 0.59, 0.59, 0.60
2 , Grid_RF: Y-Def , 59 , 3 ( | -- * ), 0.56, 0.57, 0.59, 0.59, 0.60
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 49 , 1 (-------* ------|------------ ), 0.43, 0.49, 0.49, 0.50, 0.65
1 , Grid_CART: Y-Def , 57 , 4 (---------------|-- * - ), 0.43, 0.57, 0.58, 0.60, 0.61
2 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Grid_RF: Y-Def , 63 , 5 ( | *- ), 0.59, 0.59, 0.63, 0.64, 0.65
2 , Tuned_RF: Y-Def , 64 , 2 ( |-------- *- ), 0.56, 0.62, 0.64, 0.64, 0.66
2 , Naive_CART: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_CART: Y-Def , 75 , 2 ( * -- | ), 0.74, 0.74, 0.75, 0.76, 0.77
1 , Grid_CART: Y-Def , 79 , 2 ( --------- | *---- ), 0.73, 0.77, 0.79, 0.79, 0.81
2 , Tuned_RF: Y-Def , 82 , 1 ( | * ), 0.82, 0.82, 0.82, 0.83, 0.83
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Grid_RF: Y-Def , 84 , 1 ( | -- *), 0.82, 0.83, 0.84, 0.84, 0.84
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 4, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 5, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1424
Grid_CART Running Time: 0.552
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 23.4662
Grid_RF Running Time: 154.6222
++++++++++++++++++++
DataSet: jeditV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 0 (----*--------- | ), 0.39, 0.43, 0.43, 0.43, 0.52
2 , Grid_CART: Y-Def , 52 , 14 ( ------*| ), 0.47, 0.52, 0.52, 0.66, 0.66
2 , Naive_RF: Y-Def , 54 , 0 ( |* ), 0.54, 0.54, 0.54, 0.54, 0.54
2 , Tuned_RF: Y-Def , 56 , 6 ( ---------| * -- ), 0.45, 0.54, 0.56, 0.60, 0.62
2 , Grid_RF: Y-Def , 56 , 2 ( | *-- ), 0.54, 0.54, 0.56, 0.56, 0.58
2 , Naive_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 5 , 0 (--*------------|---- ), 0.04, 0.05, 0.05, 0.05, 0.13
1 , Tuned_RF: Y-Def , 8 , 2 ( -----* --| ), 0.06, 0.08, 0.08, 0.10, 0.11
2 , Grid_RF: Y-Def , 10 , 0 ( --*-| ), 0.09, 0.10, 0.10, 0.10, 0.11
2 , Grid_CART: Y-Def , 11 , 2 ( --|* ----- ), 0.10, 0.11, 0.11, 0.13, 0.15
2 , Naive_RF: Y-Def , 13 , 0 ( | * ), 0.13, 0.13, 0.13, 0.13, 0.13
2 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Grid_CART: Y-Def , 40 , 3 ( --- * - | ), 0.37, 0.39, 0.40, 0.42, 0.43
2 , Grid_RF: Y-Def , 43 , 1 ( ---*----|-- ), 0.41, 0.43, 0.43, 0.44, 0.49
3 , Tuned_RF: Y-Def , 48 , 3 ( ---- |* - ), 0.43, 0.46, 0.48, 0.49, 0.50
3 , Tuned_CART: Y-Def , 55 , 5 ( -------------|--- *-- ), 0.37, 0.50, 0.55, 0.55, 0.58
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Naive_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 47 , 4 (-------- * | ----- ), 0.42, 0.45, 0.47, 0.49, 0.51
1 , Tuned_CART: Y-Def , 48 , 4 ( --- |*---- ), 0.43, 0.44, 0.48, 0.48, 0.50
2 , Grid_RF: Y-Def , 49 , 1 ( --| *--------- ), 0.47, 0.48, 0.49, 0.49, 0.53
2 , Tuned_RF: Y-Def , 50 , 2 ( --|-----* -- ), 0.47, 0.50, 0.50, 0.52, 0.53
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 (-----*-------- | ), 0.55, 0.59, 0.59, 0.59, 0.65
2 , Grid_CART: Y-Def , 65 , 9 ( ----*| - ), 0.62, 0.65, 0.65, 0.74, 0.75
2 , Naive_RF: Y-Def , 66 , 0 ( |* ), 0.66, 0.66, 0.66, 0.66, 0.66
2 , Grid_RF: Y-Def , 68 , 2 ( | *--- ), 0.67, 0.67, 0.68, 0.69, 0.71
2 , Tuned_RF: Y-Def , 69 , 4 ( -------|- * --- ), 0.61, 0.67, 0.69, 0.71, 0.73
2 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 73 , 0 (* | ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Tuned_CART: Y-Def , 80 , 0 ( --*|- ), 0.79, 0.80, 0.80, 0.80, 0.81
1 , Grid_CART: Y-Def , 81 , 2 ( ------ | *- ), 0.76, 0.79, 0.81, 0.81, 0.82
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Tuned_RF: Y-Def , 85 , 1 ( | * ), 0.85, 0.85, 0.85, 0.86, 0.86
2 , Grid_RF: Y-Def , 86 , 1 ( | *- ), 0.85, 0.85, 0.86, 0.86, 0.87
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 5, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 6, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0014
Tuned_CART Running Time: 0.1432
Grid_CART Running Time: 0.5734
Naive_RF Running Time: 0.0078
Tuned_RF Running Time: 21.5852
Grid_RF Running Time: 157.4484
++++++++++++++++++++
DataSet: jeditV2
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 36 , 18 (--------------*| ), 0.18, 0.36, 0.36, 0.54, 0.54
1 , Naive_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_RF: Y-Def , 45 , 9 ( | * ), 0.36, 0.36, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 45 , 0 ( | * ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 5 , 2 ( *--- | ), 0.03, 0.03, 0.05, 0.05, 0.07
1 , Tuned_CART: Y-Def , 8 , 6 (--- *| ), 0.00, 0.02, 0.08, 0.08, 0.08
1 , Grid_RF: Y-Def , 8 , 1 ( ---- *| ), 0.05, 0.07, 0.08, 0.08, 0.09
2 , Naive_RF: Y-Def , 10 , 0 ( | * ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Grid_CART: Y-Def , 12 , 3 ( -------| * ), 0.05, 0.09, 0.12, 0.12, 0.12
2 , Naive_CART: Y-Def , 17 , 0 ( | *), 0.17, 0.17, 0.17, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 7 , 2 ( * ------- | ), 0.07, 0.07, 0.07, 0.09, 0.16
1 , Naive_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_RF: Y-Def , 11 , 2 ( *--- | ), 0.10, 0.10, 0.11, 0.12, 0.15
2 , Tuned_CART: Y-Def , 13 , 9 ( -----* | ----------- ), 0.08, 0.13, 0.13, 0.22, 0.33
2 , Tuned_RF: Y-Def , 16 , 1 ( ----*---| ), 0.12, 0.16, 0.16, 0.17, 0.20
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 13 , 3 ( --* ----|------- ), 0.12, 0.13, 0.13, 0.16, 0.23
1 , Grid_RF: Y-Def , 17 , 2 ( --* |----- ), 0.16, 0.17, 0.17, 0.19, 0.22
1 , Naive_RF: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
2 , Tuned_CART: Y-Def , 21 , 2 ( ---------|---* ------ ), 0.13, 0.21, 0.21, 0.23, 0.27
2 , Tuned_RF: Y-Def , 23 , 1 ( |-------*-- ), 0.19, 0.23, 0.23, 0.24, 0.25
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 52 , 17 (---------------| * ), 0.30, 0.51, 0.52, 0.68, 0.68
1 , Naive_CART: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 59 , 1 ( | *- ), 0.59, 0.59, 0.59, 0.60, 0.61
1 , Grid_RF: Y-Def , 60 , 1 ( | * ), 0.60, 0.60, 0.60, 0.61, 0.61
1 , Tuned_RF: Y-Def , 61 , 9 ( | * ), 0.52, 0.52, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_RF: Y-Def , 64 , 2 ( * ----| ), 0.63, 0.63, 0.64, 0.65, 0.68
1 , Tuned_CART: Y-Def , 67 , 4 (--------- *| ), 0.57, 0.64, 0.67, 0.68, 0.68
1 , Grid_RF: Y-Def , 67 , 1 ( --*|- ), 0.66, 0.67, 0.67, 0.68, 0.69
1 , Grid_CART: Y-Def , 67 , 13 ( - *| - ), 0.63, 0.64, 0.67, 0.77, 0.78
1 , Naive_RF: Y-Def , 78 , 0 ( | *), 0.78, 0.78, 0.78, 0.78, 0.78
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 7, 'Grid_RF: Y-Def': 3}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.0904
Grid_CART Running Time: 0.4748
Naive_RF Running Time: 0.0062
Tuned_RF Running Time: 19.8068
Grid_RF Running Time: 139.0292
++++++++++++++++++++
DataSet: log4jV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 21 , 4 ( * ------ | ), 0.20, 0.20, 0.21, 0.24, 0.28
1 , Grid_CART: Y-Def , 23 , 12 ( * | ---------- ), 0.20, 0.20, 0.23, 0.32, 0.39
1 , Naive_RF: Y-Def , 24 , 0 ( * | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Tuned_CART: Y-Def , 25 , 2 (----- *---- | ), 0.19, 0.23, 0.25, 0.25, 0.28
1 , Grid_RF: Y-Def , 27 , 4 (------- * | ), 0.19, 0.24, 0.27, 0.28, 0.28
1 , Naive_CART: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 6 , 0 ( *------ | ), 0.06, 0.06, 0.06, 0.06, 0.12
1 , Tuned_RF: Y-Def , 6 , 0 (-------*------ | ), 0.00, 0.06, 0.06, 0.06, 0.12
1 , Grid_RF: Y-Def , 6 , 12 ( * -|----- ), 0.00, 0.00, 0.06, 0.12, 0.18
1 , Grid_CART: Y-Def , 6 , 6 ( * -|----- ), 0.06, 0.06, 0.06, 0.12, 0.18
1 , Naive_RF: Y-Def , 18 , 0 ( | * ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_CART: Y-Def , 25 , 0 ( | *), 0.25, 0.25, 0.25, 0.25, 0.25
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 93 , 0 (* | ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Naive_CART: Y-Def , 94 , 0 ( * | ), 0.94, 0.94, 0.94, 0.94, 0.94
1 , Tuned_CART: Y-Def , 97 , 1 ( ---|-* ), 0.96, 0.97, 0.97, 0.98, 0.98
1 , Tuned_RF: Y-Def , 97 , 1 ( -------|-* -------- ), 0.95, 0.97, 0.97, 0.98, 1.00
1 , Grid_CART: Y-Def , 97 , 0 ( -------|-* ), 0.95, 0.97, 0.97, 0.97, 0.97
1 , Grid_RF: Y-Def , 98 , 4 ( -------- | * ), 0.94, 0.96, 0.98, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 34 , 6 ( * ----- | ), 0.33, 0.33, 0.34, 0.39, 0.43
1 , Grid_CART: Y-Def , 38 , 14 ( * | -------- ), 0.34, 0.34, 0.38, 0.48, 0.55
1 , Naive_RF: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_CART: Y-Def , 40 , 4 (------- *-- | ), 0.31, 0.37, 0.40, 0.41, 0.43
1 , Grid_RF: Y-Def , 42 , 4 ( -------- * | ), 0.32, 0.39, 0.42, 0.43, 0.43
1 , Naive_CART: Y-Def , 49 , 0 ( | * ), 0.49, 0.49, 0.49, 0.49, 0.49
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 34 , 5 ( * ------| ), 0.33, 0.33, 0.34, 0.38, 0.43
1 , Grid_CART: Y-Def , 37 , 13 ( * | ---------- ), 0.33, 0.33, 0.37, 0.46, 0.54
1 , Naive_RF: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Tuned_CART: Y-Def , 40 , 3 (------- *---| ), 0.31, 0.37, 0.40, 0.40, 0.43
1 , Grid_RF: Y-Def , 42 , 3 ( --------- *| ), 0.32, 0.39, 0.42, 0.42, 0.42
1 , Naive_CART: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_CART: Y-Def , 56 , 3 ( ---- * ---|- ), 0.51, 0.53, 0.56, 0.57, 0.60
1 , Grid_CART: Y-Def , 56 , 10 ( * | ---- ), 0.50, 0.50, 0.56, 0.60, 0.62
2 , Tuned_RF: Y-Def , 59 , 0 ( -----*----- ), 0.56, 0.59, 0.59, 0.59, 0.62
2 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
3 , Grid_RF: Y-Def , 63 , 1 ( | *------ ), 0.62, 0.62, 0.63, 0.63, 0.67
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 8, 'Grid_RF: Y-Def': 4}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.113
Grid_CART Running Time: 0.5236
Naive_RF Running Time: 0.007
Tuned_RF Running Time: 20.298
Grid_RF Running Time: 148.7308
++++++++++++++++++++
DataSet: luceneV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 25 , 0 (* | ), 0.25, 0.25, 0.25, 0.25, 0.25
2 , Naive_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
2 , Grid_CART: Y-Def , 60 , 3 ( | * ), 0.60, 0.60, 0.60, 0.63, 0.63
2 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
3 , Grid_RF: Y-Def , 66 , 1 ( | * ), 0.65, 0.65, 0.66, 0.66, 0.67
4 , Tuned_RF: Y-Def , 75 , 0 ( | -----*), 0.66, 0.75, 0.75, 0.75, 0.76
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
2 , Grid_RF: Y-Def , 35 , 2 ( | * ), 0.32, 0.33, 0.35, 0.35, 0.37
2 , Grid_CART: Y-Def , 35 , 8 ( | --* ), 0.32, 0.35, 0.35, 0.43, 0.43
2 , Naive_RF: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
2 , Naive_CART: Y-Def , 37 , 0 ( | * ), 0.37, 0.37, 0.37, 0.37, 0.37
3 , Tuned_RF: Y-Def , 45 , 2 ( | ----- * ), 0.37, 0.43, 0.45, 0.45, 0.47
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_RF: Y-Def , 71 , 2 (--- * --- | ), 0.68, 0.70, 0.71, 0.72, 0.74
1 , Grid_CART: Y-Def , 71 , 3 ( *--- | ), 0.68, 0.68, 0.71, 0.71, 0.73
2 , Naive_RF: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
2 , Grid_RF: Y-Def , 74 , 2 ( * | ), 0.72, 0.72, 0.74, 0.74, 0.74
3 , Tuned_CART: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 39 , 0 (* | ), 0.39, 0.39, 0.39, 0.39, 0.39
2 , Naive_CART: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
2 , Grid_CART: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.66
2 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
3 , Grid_RF: Y-Def , 69 , 0 ( | * ), 0.68, 0.69, 0.69, 0.69, 0.70
3 , Tuned_RF: Y-Def , 73 , 1 ( | -----* ), 0.67, 0.73, 0.73, 0.74, 0.75
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 0 (* | ), 0.40, 0.40, 0.40, 0.40, 0.40
2 , Naive_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Grid_CART: Y-Def , 62 , 3 ( | * ), 0.59, 0.59, 0.62, 0.62, 0.63
3 , Tuned_RF: Y-Def , 63 , 3 ( | --- * --- ), 0.59, 0.62, 0.63, 0.65, 0.68
3 , Naive_RF: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
3 , Grid_RF: Y-Def , 66 , 2 ( | * ), 0.64, 0.64, 0.66, 0.66, 0.66
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_CART: Y-Def , 59 , 0 (* | ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Grid_CART: Y-Def , 63 , 0 ( *----- | ), 0.63, 0.63, 0.63, 0.63, 0.66
2 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
3 , Grid_RF: Y-Def , 69 , 1 ( | --* ), 0.68, 0.69, 0.69, 0.70, 0.70
3 , Tuned_RF: Y-Def , 72 , 1 ( | ------ *- ), 0.68, 0.71, 0.72, 0.72, 0.73
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 6, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 9, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.002
Tuned_CART Running Time: 0.1404
Grid_CART Running Time: 0.5324
Naive_RF Running Time: 0.0072
Tuned_RF Running Time: 20.9038
Grid_RF Running Time: 150.281
++++++++++++++++++++
DataSet: poiV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 1 (* ------- | ), 0.00, 0.00, 0.00, 0.01, 0.04
1 , Tuned_RF: Y-Def , 2 , 1 (----* ------- | ), 0.00, 0.02, 0.02, 0.03, 0.06
2 , Tuned_CART: Y-Def , 8 , 4 (--------- | *------- ), 0.00, 0.04, 0.08, 0.08, 0.11
2 , Grid_CART: Y-Def , 8 , 3 ( ----- | *---- ), 0.03, 0.05, 0.08, 0.08, 0.10
2 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Naive_CART: Y-Def , 12 , 0 ( | *), 0.12, 0.12, 0.12, 0.12, 0.12
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 2 (* | ), 0.00, 0.00, 0.00, 0.02, 0.02
1 , Grid_RF: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.02
2 , Tuned_CART: Y-Def , 4 , 4 ( *----|----------- ), 0.00, 0.00, 0.04, 0.04, 0.10
2 , Grid_CART: Y-Def , 5 , 1 ( -------- *-|----------- ), 0.01, 0.04, 0.05, 0.05, 0.10
2 , Naive_RF: Y-Def , 6 , 0 ( |* ), 0.06, 0.06, 0.06, 0.06, 0.06
2 , Naive_CART: Y-Def , 11 , 0 ( | *), 0.11, 0.11, 0.11, 0.11, 0.11
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 65 , 0 ( | * ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Grid_CART: Y-Def , 71 , 7 ( | - *- ), 0.65, 0.68, 0.71, 0.75, 0.80
1 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Tuned_CART: Y-Def , 77 , 11 (---------------|--- *--- ), 0.00, 0.66, 0.77, 0.77, 0.91
1 , Grid_RF: Y-Def , 78 , 25 (---------------|------ * ), 0.00, 0.75, 0.78, 1.00, 1.00
1 , Tuned_RF: Y-Def , 83 , 1 ( | ---*---- ), 0.72, 0.83, 0.83, 0.84, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 2 (* --------- | ), 0.00, 0.00, 0.00, 0.02, 0.08
1 , Tuned_RF: Y-Def , 3 , 3 (----* -------| ), 0.00, 0.03, 0.03, 0.06, 0.11
2 , Grid_CART: Y-Def , 14 , 6 ( ----- | * ---- ), 0.06, 0.09, 0.14, 0.15, 0.18
2 , Tuned_CART: Y-Def , 15 , 7 (----------- | *----- ), 0.00, 0.08, 0.15, 0.15, 0.19
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 20 , 0 ( | *), 0.20, 0.20, 0.20, 0.20, 0.20
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 0 , 2 (* --------- | ), 0.00, 0.00, 0.00, 0.02, 0.08
1 , Tuned_RF: Y-Def , 3 , 3 (----* -------|- ), 0.00, 0.03, 0.03, 0.06, 0.12
2 , Grid_CART: Y-Def , 14 , 6 ( ---- | * ---- ), 0.06, 0.09, 0.14, 0.15, 0.18
2 , Tuned_CART: Y-Def , 15 , 7 (----------- | *------ ), 0.00, 0.08, 0.15, 0.15, 0.20
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Naive_CART: Y-Def , 21 , 0 ( | *), 0.21, 0.21, 0.21, 0.21, 0.21
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 27 , 12 (- * -| ), 0.25, 0.26, 0.27, 0.38, 0.39
1 , Grid_RF: Y-Def , 38 , 2 ( ------ *|--- ), 0.31, 0.36, 0.38, 0.38, 0.42
2 , Tuned_CART: Y-Def , 43 , 2 ( -------|-- * ), 0.32, 0.41, 0.43, 0.43, 0.44
3 , Grid_CART: Y-Def , 48 , 4 ( | ------- * - ), 0.40, 0.46, 0.48, 0.50, 0.51
3 , Naive_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
3 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 7, 'Grid_CART: Y-Def': 2, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.0022
Tuned_CART Running Time: 0.1404
Grid_CART Running Time: 0.586
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 20.3372
Grid_RF Running Time: 159.5052
++++++++++++++++++++
DataSet: poiV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*------------- | ), 0.00, 0.00, 0.00, 0.00, 0.26
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 1 , 8 (* -----------|------------- ), 0.00, 0.00, 0.01, 0.08, 0.53
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 26 , 0 ( *| ), 0.26, 0.26, 0.26, 0.26, 0.26
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 2 (* ---------- | ), 0.00, 0.00, 0.00, 0.02, 0.07
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 4 (* --------|--------- ), 0.00, 0.00, 0.00, 0.04, 0.13
1 , Naive_RF: Y-Def , 2 , 0 ( * | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 20 (* ----------|--------- ), 0.00, 0.00, 0.00, 0.20, 0.86
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
2 , Grid_CART: Y-Def , 78 , 37 (-------------- | * --- ), 0.00, 0.50, 0.78, 0.87, 1.00
2 , Naive_RF: Y-Def , 92 , 0 ( | * ), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|-- ), 0.00, 0.00, 0.00, 0.00, 0.40
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 2 , 15 (* ---------|------------- ), 0.00, 0.00, 0.02, 0.15, 0.66
1 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*--------------|-- ), 0.00, 0.00, 0.00, 0.00, 0.41
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 2 , 16 (* --------|------------- ), 0.00, 0.00, 0.02, 0.16, 0.66
1 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 59 , 0 (-* | ), 0.58, 0.59, 0.59, 0.59, 0.59
1 , Naive_CART: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
2 , Grid_CART: Y-Def , 69 , 9 ( - * | -------- ), 0.63, 0.64, 0.69, 0.73, 0.79
3 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
3 , Tuned_RF: Y-Def , 79 , 1 ( | *- ), 0.79, 0.79, 0.79, 0.80, 0.81
3 , Grid_RF: Y-Def , 80 , 2 ( | *- ), 0.78, 0.78, 0.80, 0.80, 0.82
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 8, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 10, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.0008
Tuned_CART Running Time: 0.1154
Grid_CART Running Time: 0.502
Naive_RF Running Time: 0.0066
Tuned_RF Running Time: 21.1508
Grid_RF Running Time: 144.3962
++++++++++++++++++++
DataSet: synapseV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 1 (-*------ | ), 0.02, 0.03, 0.03, 0.04, 0.10
2 , Grid_RF: Y-Def , 18 , 1 ( |*----- ), 0.17, 0.18, 0.18, 0.19, 0.24
2 , Grid_CART: Y-Def , 19 , 9 ( | * -- ), 0.17, 0.18, 0.19, 0.27, 0.29
2 , Tuned_CART: Y-Def , 26 , 2 ( --|------ *--- ), 0.15, 0.24, 0.26, 0.26, 0.30
2 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
2 , Naive_CART: Y-Def , 31 , 0 ( | *), 0.31, 0.31, 0.31, 0.31, 0.31
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
2 , Grid_RF: Y-Def , 2 , 0 ( *- | ), 0.02, 0.02, 0.02, 0.02, 0.03
2 , Tuned_CART: Y-Def , 4 , 1 (-------* -- | ), 0.00, 0.04, 0.04, 0.05, 0.06
3 , Grid_CART: Y-Def , 6 , 3 ( * |----------- ), 0.05, 0.05, 0.06, 0.08, 0.14
3 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
3 , Naive_CART: Y-Def , 15 , 0 ( | *), 0.15, 0.15, 0.15, 0.15, 0.15
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_CART: Y-Def , 59 , 8 (-- * ---- | ), 0.51, 0.54, 0.59, 0.62, 0.70
1 , Naive_RF: Y-Def , 68 , 0 ( * | ), 0.68, 0.68, 0.68, 0.68, 0.68
2 , Tuned_CART: Y-Def , 72 , 4 ( ---* |------------- ), 0.67, 0.72, 0.72, 0.76, 1.00
2 , Grid_RF: Y-Def , 77 , 1 ( |* ), 0.76, 0.77, 0.77, 0.78, 0.80
2 , Tuned_RF: Y-Def , 100 , 10 ( | ------ *), 0.80, 0.90, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 2 (-* -------- | ), 0.04, 0.06, 0.06, 0.08, 0.18
2 , Grid_CART: Y-Def , 28 , 9 ( | * -- ), 0.27, 0.28, 0.29, 0.37, 0.40
2 , Grid_RF: Y-Def , 30 , 3 ( | - *----- ), 0.28, 0.29, 0.30, 0.31, 0.37
2 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
2 , Tuned_CART: Y-Def , 38 , 3 ( | -------- *-- ), 0.26, 0.36, 0.38, 0.39, 0.42
2 , Naive_RF: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 2 (-*-------- | ), 0.04, 0.06, 0.06, 0.08, 0.18
2 , Grid_RF: Y-Def , 31 , 1 ( | -*---- ), 0.29, 0.31, 0.31, 0.32, 0.38
2 , Grid_CART: Y-Def , 32 , 12 ( | - * ), 0.29, 0.31, 0.32, 0.43, 0.43
2 , Tuned_CART: Y-Def , 41 , 3 ( |-------- *- ), 0.26, 0.38, 0.41, 0.41, 0.45
2 , Naive_RF: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
2 , Naive_CART: Y-Def , 45 , 0 ( | *), 0.45, 0.45, 0.45, 0.45, 0.45
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 62 , 3 (-------* ---|------ ), 0.58, 0.62, 0.62, 0.65, 0.71
1 , Tuned_CART: Y-Def , 69 , 3 ( -------| * ), 0.63, 0.67, 0.69, 0.70, 0.70
1 , Naive_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
2 , Grid_RF: Y-Def , 73 , 1 ( | *- ), 0.72, 0.72, 0.73, 0.73, 0.74
2 , Tuned_RF: Y-Def , 74 , 1 ( | -- * ), 0.72, 0.73, 0.74, 0.74, 0.75
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 9, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 11, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.001
Tuned_CART Running Time: 0.1258
Grid_CART Running Time: 0.5096
Naive_RF Running Time: 0.0068
Tuned_RF Running Time: 20.3458
Grid_RF Running Time: 145.8466
++++++++++++++++++++
DataSet: velocityV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 46 , 39 (-------------* | --- ), 0.00, 0.46, 0.46, 0.85, 0.94
1 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Grid_CART: Y-Def , 91 , 8 ( | - * ), 0.84, 0.89, 0.91, 0.97, 1.00
1 , Naive_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
1 , Tuned_RF: Y-Def , 100 , 17 ( | -- *), 0.74, 0.83, 1.00, 1.00, 1.00
1 , Grid_RF: Y-Def , 100 , 0 ( | *), 0.97, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 41 , 25 (-----------* | ------ ), 0.03, 0.41, 0.41, 0.66, 0.86
2 , Grid_CART: Y-Def , 77 , 14 ( | ----* -- ), 0.62, 0.76, 0.77, 0.90, 0.94
2 , Naive_RF: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
2 , Naive_CART: Y-Def , 94 , 0 ( | * ), 0.94, 0.94, 0.94, 0.94, 0.94
2 , Grid_RF: Y-Def , 99 , 1 ( | *), 0.97, 0.99, 0.99, 1.00, 1.00
2 , Tuned_RF: Y-Def , 100 , 30 ( | - *), 0.65, 0.70, 1.00, 1.00, 1.00
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 33 , 0 ( | * ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_RF: Y-Def , 34 , 2 ( | *- ), 0.34, 0.34, 0.34, 0.36, 0.37
1 , Grid_RF: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Tuned_CART: Y-Def , 36 , 0 (---------------|---------*- ), 0.00, 0.36, 0.36, 0.36, 0.39
1 , Grid_CART: Y-Def , 36 , 1 ( | -*--- ), 0.34, 0.36, 0.36, 0.37, 0.42
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 40 , 12 (---------------|-----* - ), 0.00, 0.40, 0.40, 0.52, 0.54
1 , Naive_RF: Y-Def , 47 , 0 ( | * ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Tuned_RF: Y-Def , 50 , 0 ( | -* ), 0.49, 0.50, 0.50, 0.50, 0.52
1 , Grid_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Grid_CART: Y-Def , 53 , 2 ( | *- ), 0.50, 0.51, 0.53, 0.53, 0.57
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 0 , 43 (* | --- ), 0.00, 0.00, 0.00, 0.43, 0.47
1 , Grid_RF: Y-Def , 1 , 1 (*- | ), 0.00, 0.00, 0.01, 0.01, 0.05
1 , Naive_CART: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
2 , Naive_RF: Y-Def , 28 , 0 ( |* ), 0.28, 0.28, 0.28, 0.28, 0.28
2 , Grid_CART: Y-Def , 36 , 19 ( ---- | *-------- ), 0.11, 0.18, 0.36, 0.37, 0.52
2 , Tuned_CART: Y-Def , 47 , 27 (------------- | * ), 0.00, 0.24, 0.47, 0.51, 0.51
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 50 , 4 (----* ------| ), 0.47, 0.50, 0.50, 0.54, 0.59
1 , Naive_CART: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Naive_RF: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_CART: Y-Def , 56 , 1 ( -------- *--|----- ), 0.49, 0.55, 0.56, 0.56, 0.63
2 , Tuned_RF: Y-Def , 68 , 9 ( --| * ), 0.57, 0.59, 0.68, 0.68, 0.68
2 , Grid_RF: Y-Def , 68 , 3 ( | - * ), 0.65, 0.66, 0.68, 0.69, 0.69
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 10, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 12, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.0012
Tuned_CART Running Time: 0.1308
Grid_CART Running Time: 0.5414
Naive_RF Running Time: 0.0074
Tuned_RF Running Time: 22.0806
Grid_RF Running Time: 152.418
++++++++++++++++++++
DataSet: xercesV0
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 8 , 1 (-------- *- | ), 0.00, 0.07, 0.08, 0.08, 0.10
2 , Naive_RF: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
2 , Tuned_CART: Y-Def , 17 , 15 ( | * --- ), 0.08, 0.08, 0.17, 0.23, 0.26
2 , Grid_RF: Y-Def , 17 , 3 ( ---|- * ), 0.11, 0.15, 0.17, 0.18, 0.18
2 , Grid_CART: Y-Def , 21 , 5 ( | - * ), 0.17, 0.18, 0.21, 0.23, 0.23
2 , Naive_CART: Y-Def , 23 , 0 ( | * ), 0.23, 0.23, 0.23, 0.23, 0.23
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 4 , 3 (- * | ), 0.00, 0.01, 0.04, 0.04, 0.04
2 , Grid_RF: Y-Def , 9 , 2 ( ----------- * ), 0.02, 0.08, 0.09, 0.10, 0.10
3 , Tuned_CART: Y-Def , 12 , 2 ( | --* ----- ), 0.11, 0.12, 0.12, 0.14, 0.17
3 , Naive_RF: Y-Def , 14 , 0 ( | * ), 0.14, 0.14, 0.14, 0.14, 0.14
3 , Naive_CART: Y-Def , 15 , 0 ( | * ), 0.15, 0.15, 0.15, 0.15, 0.15
3 , Grid_CART: Y-Def , 15 , 2 ( | ---------* ), 0.10, 0.15, 0.15, 0.17, 0.17
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Grid_CART: Y-Def , 19 , 4 ( *- | ), 0.17, 0.17, 0.19, 0.21, 0.23
1 , Tuned_CART: Y-Def , 20 , 9 ( -- *-- | ), 0.09, 0.12, 0.20, 0.21, 0.25
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_RF: Y-Def , 24 , 5 ( *|---------- ), 0.22, 0.23, 0.24, 0.28, 0.44
1 , Tuned_RF: Y-Def , 27 , 3 (---------------|*------------ ), 0.00, 0.27, 0.27, 0.30, 0.50
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 13 , 1 (-------------- |*- ), 0.00, 0.12, 0.13, 0.13, 0.15
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 13 ( - | * - ), 0.09, 0.10, 0.18, 0.23, 0.24
2 , Grid_RF: Y-Def , 19 , 2 ( | -* - ), 0.18, 0.19, 0.19, 0.21, 0.22
2 , Grid_CART: Y-Def , 20 , 2 ( | - * - ), 0.18, 0.19, 0.20, 0.21, 0.22
2 , Naive_CART: Y-Def , 22 , 0 ( | * ), 0.22, 0.22, 0.22, 0.22, 0.22
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 15 , 2 (--------- *- | ), 0.00, 0.13, 0.15, 0.15, 0.18
2 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
2 , Tuned_CART: Y-Def , 28 , 21 ( | * -- ), 0.15, 0.15, 0.29, 0.36, 0.39
2 , Grid_RF: Y-Def , 28 , 4 ( |---- * ), 0.20, 0.27, 0.29, 0.31, 0.31
3 , Grid_CART: Y-Def , 34 , 6 ( | - * ), 0.29, 0.30, 0.34, 0.36, 0.36
3 , Naive_CART: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 56 , 0 ( ---* |-------- ), 0.55, 0.56, 0.56, 0.57, 0.60
1 , Grid_CART: Y-Def , 56 , 4 (------------- |* ), 0.51, 0.56, 0.57, 0.60, 0.60
2 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
2 , Tuned_RF: Y-Def , 61 , 0 ( | ---*- ), 0.60, 0.61, 0.61, 0.61, 0.62
2 , Grid_RF: Y-Def , 61 , 0 ( | --------*- ), 0.58, 0.61, 0.61, 0.61, 0.62
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 11, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 13, 'Grid_RF: Y-Def': 5}
Naive_CART Running Time: 0.002
Tuned_CART Running Time: 0.17
Grid_CART Running Time: 0.6036
Naive_RF Running Time: 0.008
Tuned_RF Running Time: 21.2192
Grid_RF Running Time: 161.5044
++++++++++++++++++++
DataSet: xercesV1
++++++++++++++++++++
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 2 , 1 ( * | ), 0.02, 0.02, 0.02, 0.03, 0.03
2 , Tuned_RF: Y-Def , 6 , 8 ( * | ------- ), 0.00, 0.00, 0.06, 0.08, 0.11
2 , Grid_CART: Y-Def , 6 , 5 ( * | ------- ), 0.04, 0.04, 0.06, 0.09, 0.12
2 , Naive_RF: Y-Def , 9 , 0 ( | * ), 0.09, 0.09, 0.09, 0.09, 0.09
2 , Tuned_CART: Y-Def , 10 , 6 ( ------- | * ), 0.02, 0.05, 0.10, 0.11, 0.11
2 , Naive_CART: Y-Def , 13 , 0 ( | *), 0.13, 0.13, 0.13, 0.13, 0.13
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (*---- | ), 0.00, 0.00, 0.00, 0.00, 0.01
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 0 , 1 (* ----------|------------- ), 0.00, 0.00, 0.00, 0.01, 0.05
1 , Naive_RF: Y-Def , 4 , 0 ( | * ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_CART: Y-Def , 5 , 0 ( | *), 0.05, 0.05, 0.05, 0.05, 0.05
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 85 , 0 (* | ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Naive_CART: Y-Def , 88 , 0 ( * | ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_CART: Y-Def , 96 , 5 (---------------|--- * ), 0.85, 0.95, 0.96, 1.00, 1.00
1 , Tuned_CART: Y-Def , 100 , 0 ( ----|-------------*), 0.91, 1.00, 1.00, 1.00, 1.00
1 , Tuned_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
1 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 1 ( --* | ), 0.04, 0.05, 0.05, 0.06, 0.06
2 , Tuned_RF: Y-Def , 12 , 14 (- *| ------ ), 0.00, 0.01, 0.12, 0.15, 0.20
2 , Grid_CART: Y-Def , 12 , 8 ( -- *| ----- ), 0.08, 0.09, 0.12, 0.17, 0.21
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 11 ( ------- | * -- ), 0.04, 0.09, 0.18, 0.20, 0.21
2 , Naive_CART: Y-Def , 24 , 0 ( | *), 0.24, 0.24, 0.24, 0.24, 0.24
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 1 ( --* | ), 0.04, 0.05, 0.05, 0.06, 0.06
2 , Tuned_RF: Y-Def , 12 , 14 (- *| ------ ), 0.00, 0.01, 0.12, 0.15, 0.20
2 , Grid_CART: Y-Def , 12 , 8 ( -- *| ----- ), 0.08, 0.09, 0.12, 0.17, 0.21
2 , Naive_RF: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
2 , Tuned_CART: Y-Def , 18 , 11 ( ------- | * -- ), 0.04, 0.09, 0.18, 0.20, 0.21
2 , Naive_CART: Y-Def , 24 , 0 ( | *), 0.24, 0.24, 0.24, 0.24, 0.24
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 42 , 2 (*-- | ), 0.41, 0.41, 0.42, 0.43, 0.45
1 , Naive_CART: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
2 , Grid_RF: Y-Def , 47 , 5 ( * -- | ), 0.46, 0.46, 0.47, 0.51, 0.53
2 , Naive_RF: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
3 , Tuned_CART: Y-Def , 60 , 2 ( -|* -------- ), 0.58, 0.60, 0.60, 0.62, 0.71
4 , Tuned_RF: Y-Def , 69 , 6 ( | -* ), 0.68, 0.69, 0.69, 0.75, 0.75
In terms of 2 : the times of better tuners are{'Tuned_RF: Y-Def': 12, 'Grid_CART: Y-Def': 3, 'Tuned_CART: Y-Def': 14, 'Grid_RF: Y-Def': 5}
------------------------------------------------------------
Sender: LSF System <lsfadmin@n2d1-10>
Subject: Job 192181: </share3/wfu/miniconda/bin/python2.7 run.py run precision true> Done
Job </share3/wfu/miniconda/bin/python2.7 run.py run precision true> was submitted from host <login01.hpc.ncsu.edu> by user <wfu> in cluster <henry2>.
Job was executed on host(s) <n2d1-10>, in queue <serial>, as user <wfu> in cluster <henry2>.
</home/wfu> was used as the home directory.
</home/wfu/Github/Caret> was used as the working directory.
Started at Sun Feb 21 12:29:24 2016
Results reported at Sun Feb 21 16:40:31 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
/share3/wfu/miniconda/bin/python2.7 run.py run precision true
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 15061.32 sec.
Max Memory : 71 MB
Max Swap : 855 MB
Max Processes : 3
Max Threads : 4
The output (if any) is above this job summary.
PS:
Read file <./err/precision_true.err.192181> for stderr output of this job.
What's the Caret?
Wei: Caret is nothing but grid search!
here's the description of train function, which is method the paper authors used.
'''
train can be used to tune models by picking the complexity parameters that are associated with the optimal resampling statistics. For particular model, a grid of parameters (if any) is created and the model is trained on slightly different data for each candidate combination of tuning parameters. Across each data set, the performance of held-out samples is calculated and the mean and stan- dard deviation is summarized for each combination. The combination with the optimal resampling statistic is chosen as the final model and the entire training set is used to fit a final model.
'''
more details can be found here:link
results of 0209 tuning goal is F score
Tuning objective: f
Begin time: 2016-02-10 04:40:02
Dataset: antV0
------------------------------
The.cart.max_features: 0.03
The.cart.max_depth: 42
The.cart.min_samples_split: 12
The.cart.min_samples_leaf: 13
The.option.threshold: 0.19
evaluation: 50
Tuned_CART Running Time: 3.003
------------------------------
Grid_CART Running Time: 1.103
------------------------------
Naive_CART Running Time: 0.11
------------------------------
The.rf.min_samples_split: 15
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 14
The.rf.n_estimators: 104
The.rf.max_features: 0.57
The.option.threshold: 0.01
evaluation: 60
Tuned_RF Running Time: 17.482
------------------------------
Grid_RF Running Time: 82.096
------------------------------
Naive_RF Running Time: 0.394
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 21 , 0 (* | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_CART: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
1 , Grid_CART: Y-Def , 83 , 0 ( | * ), 0.83, 0.83, 0.83, 0.83, 0.83
1 , Grid_RF: Y-Def , 91 , 0 ( | *), 0.91, 0.91, 0.91, 0.91, 0.91
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Tuned_CART: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Naive_RF: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_CART: Y-Def , 68 , 0 ( | * ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_RF: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Grid_RF: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Grid_CART: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Naive_RF: Y-Def , 92 , 0 ( * | ), 0.92, 0.92, 0.92, 0.92, 0.92
1 , Tuned_CART: Y-Def , 96 , 0 ( | *), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Tuned_RF: Y-Def , 96 , 0 ( | *), 0.96, 0.96, 0.96, 0.96, 0.96
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 34 , 0 (* | ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Naive_CART: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Tuned_CART: Y-Def , 84 , 0 ( | * ), 0.84, 0.84, 0.84, 0.84, 0.84
1 , Naive_RF: Y-Def , 84 , 0 ( | * ), 0.84, 0.84, 0.84, 0.84, 0.84
1 , Grid_CART: Y-Def , 86 , 0 ( | * ), 0.86, 0.86, 0.86, 0.86, 0.86
1 , Grid_RF: Y-Def , 90 , 0 ( | *), 0.90, 0.90, 0.90, 0.90, 0.90
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 31 , 0 (* | ), 0.31, 0.31, 0.31, 0.31, 0.31
1 , Tuned_RF: Y-Def , 34 , 0 ( * | ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_CART: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_CART: Y-Def , 75 , 0 ( | *), 0.75, 0.75, 0.75, 0.75, 0.75
End time :2016-02-10 04:41:46
Tuning objective: f
Begin time: 2016-02-10 04:41:46
Dataset: antV1
------------------------------
The.cart.max_features: 0.71
The.cart.max_depth: 46
The.cart.min_samples_split: 7
The.cart.min_samples_leaf: 20
The.option.threshold: 0.67
evaluation: 60
Tuned_CART Running Time: 4.951
------------------------------
Grid_CART Running Time: 1.338
------------------------------
Naive_CART Running Time: 0.131
------------------------------
The.rf.min_samples_split: 16
The.rf.min_samples_leaf : 14
The.rf.max_leaf_nodes: 22
The.rf.n_estimators: 108
The.rf.max_features: 0.88
The.option.threshold: 0.85
evaluation: 50
Tuned_RF Running Time: 16.919
------------------------------
Grid_RF Running Time: 87.064
------------------------------
Naive_RF Running Time: 0.629
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 11 , 0 ( * | ), 0.11, 0.11, 0.11, 0.11, 0.11
1 , Naive_RF: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_CART: Y-Def , 28 , 0 ( | *), 0.28, 0.28, 0.28, 0.28, 0.28
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_CART: Y-Def , 3 , 0 ( * | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Naive_RF: Y-Def , 4 , 0 ( *| ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_CART: Y-Def , 8 , 0 ( | *), 0.08, 0.08, 0.08, 0.08, 0.08
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Naive_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Grid_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_RF: Y-Def , 67 , 0 ( | * ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Grid_RF: Y-Def , 83 , 0 ( | *), 0.83, 0.83, 0.83, 0.83, 0.83
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_CART: Y-Def , 19 , 0 ( *| ), 0.19, 0.19, 0.19, 0.19, 0.19
1 , Naive_CART: Y-Def , 37 , 0 ( | *), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Naive_RF: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_CART: Y-Def , 21 , 0 ( *| ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_CART: Y-Def , 43 , 0 ( | *), 0.43, 0.43, 0.43, 0.43, 0.43
End time :2016-02-10 04:43:38
Tuning objective: f
Begin time: 2016-02-10 04:43:38
Dataset: antV2
------------------------------
The.cart.max_features: 0.1
The.cart.max_depth: 47
The.cart.min_samples_split: 20
The.cart.min_samples_leaf: 13
The.option.threshold: 0.11
evaluation: 80
Tuned_CART Running Time: 9.834
------------------------------
Grid_CART Running Time: 1.555
------------------------------
Naive_CART Running Time: 0.276
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 17
The.rf.max_leaf_nodes: 40
The.rf.n_estimators: 75
The.rf.max_features: 0.5
The.option.threshold: 0.11
evaluation: 60
Tuned_RF Running Time: 24.245
------------------------------
Grid_RF Running Time: 99.614
------------------------------
Naive_RF Running Time: 0.748
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 37 , 0 (* | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Grid_RF: Y-Def , 39 , 0 ( * | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_CART: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Tuned_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_CART: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Naive_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_CART: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Tuned_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Tuned_CART: Y-Def , 38 , 0 ( | *), 0.38, 0.38, 0.38, 0.38, 0.38
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 33 , 0 (* | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Naive_CART: Y-Def , 42 , 0 ( * | ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Tuned_RF: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Naive_RF: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_RF: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_CART: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 49 , 0 ( * | ), 0.49, 0.49, 0.49, 0.49, 0.49
1 , Tuned_RF: Y-Def , 53 , 0 ( | * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Naive_RF: Y-Def , 57 , 0 ( | *), 0.58, 0.58, 0.58, 0.58, 0.58
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 53 , 0 (* | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_RF: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_CART: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Tuned_RF: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Naive_RF: Y-Def , 70 , 0 ( | *), 0.70, 0.70, 0.70, 0.70, 0.70
End time :2016-02-10 04:45:54
Tuning objective: f
Begin time: 2016-02-10 04:45:54
Dataset: camelV0
------------------------------
The.cart.max_features: 0.01
The.cart.max_depth: 2
The.cart.min_samples_split: 20
The.cart.min_samples_leaf: 9
The.option.threshold: 0.01
evaluation: 60
Tuned_CART Running Time: 10.639
------------------------------
Grid_CART Running Time: 2.042
------------------------------
Naive_CART Running Time: 0.31
------------------------------
The.rf.min_samples_split: 6
The.rf.min_samples_leaf : 17
The.rf.max_leaf_nodes: 40
The.rf.n_estimators: 75
The.rf.max_features: 1
The.option.threshold: 0.01
evaluation: 60
Tuned_RF Running Time: 25.901
------------------------------
Grid_RF Running Time: 111.04
------------------------------
Naive_RF Running Time: 1.131
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 12 , 0 ( * | ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 82 , 0 ( | * ), 0.82, 0.82, 0.82, 0.82, 0.82
1 , Grid_RF: Y-Def , 95 , 0 ( | *), 0.95, 0.95, 0.95, 0.95, 0.95
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_CART: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Grid_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Grid_RF: Y-Def , 69 , 0 ( | *), 0.69, 0.69, 0.69, 0.69, 0.69
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 87 , 0 ( | * ), 0.87, 0.87, 0.87, 0.87, 0.87
1 , Grid_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Naive_CART: Y-Def , 89 , 0 ( | *), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Naive_RF: Y-Def , 91 , 0 ( | *), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Tuned_RF: Y-Def , 92 , 0 ( | *), 0.92, 0.92, 0.92, 0.92, 0.92
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Naive_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
1 , Naive_CART: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Grid_CART: Y-Def , 85 , 0 ( | * ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Grid_RF: Y-Def , 91 , 0 ( | *), 0.91, 0.91, 0.91, 0.91, 0.91
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Tuned_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Grid_RF: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Grid_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Naive_CART: Y-Def , 63 , 0 ( | * ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Naive_RF: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
End time :2016-02-10 04:48:25
Tuning objective: f
Begin time: 2016-02-10 04:48:25
Dataset: camelV1
------------------------------
The.cart.max_features: 0.71
The.cart.max_depth: 1
The.cart.min_samples_split: 20
The.cart.min_samples_leaf: 1
The.option.threshold: 1
evaluation: 90
Tuned_CART Running Time: 23.16
------------------------------
Grid_CART Running Time: 2.671
------------------------------
Naive_CART Running Time: 0.396
------------------------------
The.rf.min_samples_split: 1
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 21
The.rf.n_estimators: 122
The.rf.max_features: 0.24
The.option.threshold: 0.95
evaluation: 70
Tuned_RF Running Time: 40.527
------------------------------
Grid_RF Running Time: 124.852
------------------------------
Naive_RF Running Time: 1.554
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Grid_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_RF: Y-Def , 34 , 0 ( | * ), 0.34, 0.34, 0.34, 0.34, 0.34
1 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Grid_CART: Y-Def , 42 , 0 ( | * ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 0 , 0 (* | ), 0.00, 0.00, 0.00, 0.00, 0.00
1 , Grid_RF: Y-Def , 7 , 0 ( * | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Naive_CART: Y-Def , 14 , 0 ( |* ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Grid_CART: Y-Def , 16 , 0 ( | * ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Tuned_RF: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 25 , 0 ( | *), 0.25, 0.25, 0.25, 0.25, 0.25
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 28 , 0 (* | ), 0.28, 0.28, 0.28, 0.28, 0.28
1 , Naive_RF: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_CART: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Naive_CART: Y-Def , 39 , 0 ( * | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Grid_RF: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Tuned_CART: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 2 , 0 (* | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Grid_RF: Y-Def , 28 , 0 ( | * ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_RF: Y-Def , 31 , 0 ( | * ), 0.31, 0.31, 0.31, 0.31, 0.31
1 , Naive_CART: Y-Def , 39 , 0 ( | * ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Grid_CART: Y-Def , 40 , 0 ( | *), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Naive_RF: Y-Def , 41 , 0 ( | *), 0.41, 0.41, 0.41, 0.41, 0.41
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 2 , 0 (* | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Grid_RF: Y-Def , 36 , 0 ( |* ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Tuned_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Naive_CART: Y-Def , 53 , 0 ( | * ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Grid_CART: Y-Def , 55 , 0 ( | * ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_RF: Y-Def , 62 , 0 ( | *), 0.62, 0.62, 0.62, 0.62, 0.62
End time :2016-02-10 04:51:38
Tuning objective: f
Begin time: 2016-02-10 04:51:38
Dataset: ivyV0
------------------------------
The.cart.max_features: 0.99
The.cart.max_depth: 43
The.cart.min_samples_split: 4
The.cart.min_samples_leaf: 7
The.option.threshold: 0.72
evaluation: 50
Tuned_CART Running Time: 3.442
------------------------------
Grid_CART Running Time: 1.208
------------------------------
Naive_CART Running Time: 0.115
------------------------------
The.rf.min_samples_split: 15
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 10
The.rf.n_estimators: 122
The.rf.max_features: 0.24
The.option.threshold: 0.95
evaluation: 60
Tuned_RF Running Time: 18.068
------------------------------
Grid_RF Running Time: 87.288
------------------------------
Naive_RF Running Time: 0.545
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 50 , 0 (* | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Naive_CART: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Grid_RF: Y-Def , 95 , 0 ( | * ), 0.95, 0.95, 0.95, 0.95, 0.95
1 , Grid_CART: Y-Def , 97 , 0 ( | *), 0.97, 0.97, 0.97, 0.97, 0.97
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 7 , 0 (* | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Tuned_RF: Y-Def , 10 , 0 ( * | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 22 , 0 ( * | ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Grid_CART: Y-Def , 80 , 0 ( | *), 0.80, 0.80, 0.80, 0.80, 0.80
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Grid_CART: Y-Def , 90 , 0 (* | ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Naive_CART: Y-Def , 91 , 0 ( * | ), 0.91, 0.91, 0.91, 0.91, 0.91
1 , Naive_RF: Y-Def , 96 , 0 ( | * ), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Tuned_RF: Y-Def , 97 , 0 ( | * ), 0.97, 0.97, 0.97, 0.97, 0.97
1 , Tuned_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 66 , 0 (* | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_CART: Y-Def , 67 , 0 ( * | ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Naive_RF: Y-Def , 81 , 0 ( |* ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Naive_CART: Y-Def , 84 , 0 ( | * ), 0.84, 0.84, 0.84, 0.84, 0.84
1 , Grid_RF: Y-Def , 92 , 0 ( | * ), 0.92, 0.92, 0.92, 0.92, 0.92
1 , Grid_CART: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 33 , 0 (* | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_RF: Y-Def , 39 , 0 ( * | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_CART: Y-Def , 53 , 0 ( *| ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_RF: Y-Def , 64 , 0 ( | * ), 0.64, 0.64, 0.64, 0.64, 0.64
1 , Tuned_CART: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_RF: Y-Def , 73 , 0 ( | *), 0.73, 0.73, 0.73, 0.73, 0.73
End time :2016-02-10 04:53:29
Tuning objective: f
Begin time: 2016-02-10 04:53:29
Dataset: jeditV0
------------------------------
The.cart.max_features: 0.64
The.cart.max_depth: 32
The.cart.min_samples_split: 10
The.cart.min_samples_leaf: 7
The.option.threshold: 0.9
evaluation: 70
Tuned_CART Running Time: 8.083
------------------------------
Grid_CART Running Time: 1.664
------------------------------
Naive_CART Running Time: 0.164
------------------------------
The.rf.min_samples_split: 9
The.rf.min_samples_leaf : 4
The.rf.max_leaf_nodes: 22
The.rf.n_estimators: 123
The.rf.max_features: 1
The.option.threshold: 0.89
evaluation: 60
Tuned_RF Running Time: 24.528
------------------------------
Grid_RF Running Time: 92.149
------------------------------
Naive_RF Running Time: 0.68
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 48 , 0 (* | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Tuned_CART: Y-Def , 69 , 0 ( | * ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_RF: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Naive_RF: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 7 , 0 (* | ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Naive_CART: Y-Def , 14 , 0 ( * | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Tuned_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Tuned_RF: Y-Def , 30 , 0 ( | *), 0.30, 0.30, 0.30, 0.30, 0.30
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 46 , 0 (* | ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Tuned_CART: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_RF: Y-Def , 52 , 0 ( * | ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Grid_CART: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Grid_RF: Y-Def , 70 , 0 ( | *), 0.70, 0.70, 0.70, 0.70, 0.70
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_CART: Y-Def , 56 , 0 ( * | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Tuned_RF: Y-Def , 57 , 0 ( | * ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Tuned_CART: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Naive_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Grid_RF: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Naive_CART: Y-Def , 67 , 0 ( * | ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Tuned_CART: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Tuned_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
1 , Naive_RF: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
End time :2016-02-10 04:55:36
Tuning objective: f
Begin time: 2016-02-10 04:55:36
Dataset: jeditV1
------------------------------
The.cart.max_features: 0.43
The.cart.max_depth: 17
The.cart.min_samples_split: 5
The.cart.min_samples_leaf: 9
The.option.threshold: 0.5
evaluation: 60
Tuned_CART Running Time: 6.668
------------------------------
Grid_CART Running Time: 1.513
------------------------------
Naive_CART Running Time: 0.16
------------------------------
The.rf.min_samples_split: 12
The.rf.min_samples_leaf : 5
The.rf.max_leaf_nodes: 18
The.rf.n_estimators: 95
The.rf.max_features: 0.55
The.option.threshold: 0.9
evaluation: 60
Tuned_RF Running Time: 22.653
------------------------------
Grid_RF Running Time: 96.152
------------------------------
Naive_RF Running Time: 0.804
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Naive_CART: Y-Def , 66 , 0 ( * | ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Tuned_RF: Y-Def , 68 , 0 ( * | ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Naive_RF: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Tuned_CART: Y-Def , 81 , 0 ( | *), 0.81, 0.81, 0.81, 0.81, 0.81
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 10 , 0 (* | ), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Grid_CART: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Tuned_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_CART: Y-Def , 21 , 0 ( | * ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_RF: Y-Def , 24 , 0 ( | * ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Tuned_CART: Y-Def , 28 , 0 ( | *), 0.29, 0.29, 0.29, 0.29, 0.29
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 28 , 0 (* | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_CART: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Grid_CART: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Naive_RF: Y-Def , 32 , 0 ( * | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Tuned_RF: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Grid_RF: Y-Def , 45 , 0 ( | *), 0.45, 0.45, 0.45, 0.45, 0.45
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 42 , 0 (* | ), 0.42, 0.42, 0.42, 0.42, 0.42
1 , Naive_CART: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Tuned_CART: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Tuned_RF: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_RF: Y-Def , 46 , 0 ( *| ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Grid_RF: Y-Def , 50 , 0 ( | *), 0.50, 0.50, 0.50, 0.50, 0.50
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 68 , 0 (* | ), 0.68, 0.68, 0.68, 0.68, 0.68
1 , Grid_RF: Y-Def , 70 , 0 ( * | ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Naive_CART: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_RF: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
1 , Tuned_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
End time :2016-02-10 04:57:44
Tuning objective: f
Begin time: 2016-02-10 04:57:44
Dataset: jeditV2
------------------------------
The.cart.max_features: 0.99
The.cart.max_depth: 43
The.cart.min_samples_split: 10
The.cart.min_samples_leaf: 20
The.option.threshold: 0.81
evaluation: 60
Tuned_CART Running Time: 7.54
------------------------------
Grid_CART Running Time: 1.603
------------------------------
Naive_CART Running Time: 0.224
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 7
The.rf.max_leaf_nodes: 10
The.rf.n_estimators: 114
The.rf.max_features: 0.94
The.option.threshold: 1
evaluation: 70
Tuned_RF Running Time: 28.075
------------------------------
Grid_RF Running Time: 97.216
------------------------------
Naive_RF Running Time: 0.845
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_RF: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Grid_CART: Y-Def , 45 , 0 (* | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Naive_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Tuned_CART: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Naive_RF: Y-Def , 54 , 0 ( | *), 0.54, 0.54, 0.54, 0.54, 0.54
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 9 , 0 (* | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 13 , 0 ( * | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Naive_CART: Y-Def , 15 , 0 ( * | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Tuned_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Tuned_CART: Y-Def , 33 , 0 ( | *), 0.33, 0.33, 0.33, 0.33, 0.33
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Naive_RF: Y-Def , 4 , 0 ( * | ), 0.04, 0.04, 0.04, 0.04, 0.04
1 , Tuned_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Naive_CART: Y-Def , 7 , 0 ( | * ), 0.07, 0.07, 0.07, 0.07, 0.07
1 , Grid_RF: Y-Def , 10 , 0 ( | *), 0.10, 0.10, 0.10, 0.10, 0.10
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 6 , 0 (* | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Naive_RF: Y-Def , 8 , 0 ( * | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Tuned_RF: Y-Def , 9 , 0 ( * | ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Grid_CART: Y-Def , 12 , 0 ( | * ), 0.12, 0.12, 0.12, 0.12, 0.12
1 , Naive_CART: Y-Def , 13 , 0 ( | * ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Grid_RF: Y-Def , 16 , 0 ( | *), 0.16, 0.16, 0.16, 0.16, 0.16
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 57 , 0 (* | ), 0.58, 0.58, 0.58, 0.58, 0.58
1 , Grid_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_CART: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 60 , 0 ( * | ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 62 , 0 ( *| ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Naive_CART: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
End time :2016-02-10 05:00:00
Tuning objective: f
Begin time: 2016-02-10 05:00:00
Dataset: log4jV0
------------------------------
The.cart.max_features: 0.71
The.cart.max_depth: 46
The.cart.min_samples_split: 9
The.cart.min_samples_leaf: 16
The.option.threshold: 0.67
evaluation: 50
Tuned_CART Running Time: 2.376
------------------------------
Grid_CART Running Time: 1.014
------------------------------
Naive_CART Running Time: 0.073
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 5
The.rf.max_leaf_nodes: 10
The.rf.n_estimators: 121
The.rf.max_features: 0.13
The.option.threshold: 0.64
evaluation: 60
Tuned_RF Running Time: 17.02
------------------------------
Grid_RF Running Time: 79.515
------------------------------
Naive_RF Running Time: 0.375
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 75 , 0 (* | ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_CART: Y-Def , 81 , 0 ( * | ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_RF: Y-Def , 81 , 0 ( * | ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_CART: Y-Def , 81 , 0 ( * | ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Tuned_CART: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Tuned_RF: Y-Def , 93 , 0 ( | *), 0.93, 0.93, 0.93, 0.93, 0.93
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 55 , 0 (* | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Naive_CART: Y-Def , 62 , 0 ( * | ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Tuned_RF: Y-Def , 67 , 0 ( |* ), 0.67, 0.67, 0.67, 0.67, 0.67
1 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 74 , 0 ( | * ), 0.74, 0.74, 0.74, 0.74, 0.74
1 , Tuned_CART: Y-Def , 77 , 0 ( | *), 0.77, 0.77, 0.77, 0.77, 0.77
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Grid_CART: Y-Def , 8 , 0 (* | ), 0.08, 0.08, 0.08, 0.08, 0.08
1 , Naive_CART: Y-Def , 9 , 0 ( *| ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Tuned_CART: Y-Def , 9 , 0 ( *| ), 0.09, 0.09, 0.09, 0.09, 0.09
1 , Tuned_RF: Y-Def , 10 , 0 ( | *), 0.10, 0.10, 0.10, 0.10, 0.10
1 , Naive_RF: Y-Def , 10 , 0 ( | *), 0.10, 0.10, 0.10, 0.10, 0.10
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 15 , 0 (* | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Grid_CART: Y-Def , 15 , 0 (* | ), 0.15, 0.15, 0.15, 0.15, 0.15
1 , Tuned_CART: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 17 , 0 ( | * ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Tuned_RF: Y-Def , 18 , 0 ( | *), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Naive_RF: Y-Def , 18 , 0 ( | *), 0.18, 0.18, 0.18, 0.18, 0.18
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 36 , 0 (* | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Grid_CART: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Grid_RF: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Tuned_RF: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Naive_CART: Y-Def , 51 , 0 ( | * ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Naive_RF: Y-Def , 55 , 0 ( | *), 0.55, 0.55, 0.55, 0.55, 0.55
End time :2016-02-10 05:01:40
Tuning objective: f
Begin time: 2016-02-10 05:01:40
Dataset: luceneV0
------------------------------
The.cart.max_features: 0.32
The.cart.max_depth: 1
The.cart.min_samples_split: 12
The.cart.min_samples_leaf: 2
The.option.threshold: 1
evaluation: 70
Tuned_CART Running Time: 5.468
------------------------------
Grid_CART Running Time: 1.243
------------------------------
Naive_CART Running Time: 0.124
------------------------------
The.rf.min_samples_split: 16
The.rf.min_samples_leaf : 12
The.rf.max_leaf_nodes: 35
The.rf.n_estimators: 68
The.rf.max_features: 0.99
The.option.threshold: 0.86
evaluation: 50
Tuned_RF Running Time: 16.978
------------------------------
Grid_RF Running Time: 87.704
------------------------------
Naive_RF Running Time: 0.721
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 32 , 0 (* | ), 0.32, 0.32, 0.32, 0.32, 0.32
1 , Naive_CART: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Grid_CART: Y-Def , 59 , 0 ( * | ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Grid_RF: Y-Def , 69 , 0 ( |* ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_RF: Y-Def , 70 , 0 ( | * ), 0.70, 0.70, 0.70, 0.70, 0.70
1 , Tuned_CART: Y-Def , 98 , 0 ( | *), 0.98, 0.98, 0.98, 0.98, 0.98
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 21 , 0 (* | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Naive_CART: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_RF: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_RF: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Grid_CART: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Tuned_CART: Y-Def , 86 , 0 ( | *), 0.86, 0.86, 0.86, 0.86, 0.86
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 43 , 0 (* | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Grid_CART: Y-Def , 47 , 0 ( * | ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_CART: Y-Def , 50 , 0 ( *| ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naive_RF: Y-Def , 50 , 0 ( *| ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_RF: Y-Def , 52 , 0 ( | * ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Grid_RF: Y-Def , 56 , 0 ( | *), 0.57, 0.57, 0.57, 0.57, 0.57
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 39 , 0 (* | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Naive_CART: Y-Def , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Grid_CART: Y-Def , 52 , 0 ( |* ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Tuned_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Tuned_RF: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Grid_RF: Y-Def , 63 , 0 ( | *), 0.63, 0.63, 0.63, 0.63, 0.63
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 23 , 0 (* | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Naive_RF: Y-Def , 46 , 0 ( * ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Tuned_RF: Y-Def , 62 , 0 ( | * ), 0.62, 0.62, 0.62, 0.62, 0.62
1 , Grid_RF: Y-Def , 67 , 0 ( | *), 0.67, 0.67, 0.67, 0.67, 0.67
End time :2016-02-10 05:03:32
Tuning objective: f
Begin time: 2016-02-10 05:03:32
Dataset: poiV0
------------------------------
The.cart.max_features: 0.84
The.cart.max_depth: 22
The.cart.min_samples_split: 16
The.cart.min_samples_leaf: 9
The.option.threshold: 1
evaluation: 80
Tuned_CART Running Time: 8.77
------------------------------
Grid_CART Running Time: 1.602
------------------------------
Naive_CART Running Time: 0.16
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 7
The.rf.max_leaf_nodes: 40
The.rf.n_estimators: 105
The.rf.max_features: 0.84
The.option.threshold: 1
evaluation: 60
Tuned_RF Running Time: 25.429
------------------------------
Grid_RF Running Time: 94.603
------------------------------
Naive_RF Running Time: 0.649
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 61 , 0 (* | ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Naive_RF: Y-Def , 69 , 0 ( * | ), 0.69, 0.69, 0.69, 0.69, 0.69
1 , Tuned_CART: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Naive_CART: Y-Def , 78 , 0 ( | * ), 0.78, 0.78, 0.78, 0.78, 0.78
1 , Grid_CART: Y-Def , 87 , 0 ( | * ), 0.87, 0.87, 0.87, 0.87, 0.87
1 , Grid_RF: Y-Def , 89 , 0 ( | *), 0.89, 0.89, 0.89, 0.89, 0.89
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 28 , 0 (* | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Tuned_CART: Y-Def , 46 , 0 ( * | ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Naive_RF: Y-Def , 66 , 0 ( | * ), 0.66, 0.66, 0.66, 0.66, 0.66
1 , Grid_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_CART: Y-Def , 79 , 0 ( | * ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Grid_RF: Y-Def , 88 , 0 ( | *), 0.88, 0.88, 0.88, 0.88, 0.88
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Grid_RF: Y-Def , 35 , 0 (* | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_RF: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Grid_CART: Y-Def , 39 , 0 ( * | ), 0.39, 0.39, 0.39, 0.39, 0.39
1 , Tuned_CART: Y-Def , 46 , 0 ( | * ), 0.46, 0.46, 0.46, 0.46, 0.46
1 , Tuned_RF: Y-Def , 53 , 0 ( | *), 0.53, 0.53, 0.53, 0.53, 0.53
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 47 , 0 (* | ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_CART: Y-Def , 48 , 0 ( * | ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Grid_RF: Y-Def , 51 , 0 ( * | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Grid_CART: Y-Def , 54 , 0 ( | * ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Tuned_CART: Y-Def , 56 , 0 ( | * ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Tuned_RF: Y-Def , 56 , 0 ( | *), 0.57, 0.57, 0.57, 0.57, 0.57
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 20 , 0 (* | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Naive_CART: Y-Def , 33 , 0 ( * | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Grid_CART: Y-Def , 38 , 0 ( * | ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Naive_RF: Y-Def , 45 , 0 ( |* ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 61 , 0 ( | * ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Tuned_RF: Y-Def , 65 , 0 ( | *), 0.65, 0.65, 0.65, 0.65, 0.65
End time :2016-02-10 05:05:43
Tuning objective: f
Begin time: 2016-02-10 05:05:43
Dataset: poiV1
------------------------------
The.cart.max_features: 0.01
The.cart.max_depth: 19
The.cart.min_samples_split: 15
The.cart.min_samples_leaf: 7
The.option.threshold: 0.84
evaluation: 60
Tuned_CART Running Time: 7.831
------------------------------
Grid_CART Running Time: 1.572
------------------------------
Naive_CART Running Time: 0.193
------------------------------
The.rf.min_samples_split: 5
The.rf.min_samples_leaf : 9
The.rf.max_leaf_nodes: 11
The.rf.n_estimators: 72
The.rf.max_features: 0.44
The.option.threshold: 0.5
evaluation: 50
Tuned_RF Running Time: 20.262
------------------------------
Grid_RF Running Time: 95.31
------------------------------
Naive_RF Running Time: 0.784
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 56 , 0 (* | ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Naive_RF: Y-Def , 63 , 0 ( * | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Grid_CART: Y-Def , 88 , 0 ( | * ), 0.88, 0.88, 0.88, 0.88, 0.88
1 , Grid_RF: Y-Def , 90 , 0 ( | * ), 0.90, 0.90, 0.90, 0.90, 0.90
1 , Tuned_CART: Y-Def , 99 , 0 ( | *), 0.99, 0.99, 0.99, 0.99, 0.99
1 , Tuned_RF: Y-Def , 99 , 0 ( | *), 0.99, 0.99, 0.99, 0.99, 0.99
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_RF: Y-Def , 24 , 0 (* | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Naive_CART: Y-Def , 35 , 0 ( * | ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Grid_RF: Y-Def , 72 , 0 ( | * ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Grid_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Tuned_RF: Y-Def , 93 , 0 ( | * ), 0.93, 0.93, 0.93, 0.93, 0.93
1 , Tuned_CART: Y-Def , 97 , 0 ( | *), 0.97, 0.97, 0.97, 0.97, 0.97
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 36 , 0 (* | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Tuned_RF: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Grid_CART: Y-Def , 40 , 0 ( * | ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Naive_CART: Y-Def , 47 , 0 ( *| ), 0.47, 0.47, 0.47, 0.47, 0.47
1 , Naive_RF: Y-Def , 59 , 0 ( | *), 0.59, 0.59, 0.59, 0.59, 0.59
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Naive_CART: Y-Def , 51 , 0 (* | ), 0.51, 0.51, 0.51, 0.51, 0.51
1 , Tuned_CART: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Tuned_RF: Y-Def , 54 , 0 ( * | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Grid_CART: Y-Def , 55 , 0 ( * | ), 0.55, 0.55, 0.55, 0.55, 0.55
1 , Grid_RF: Y-Def , 56 , 0 ( *| ), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Naive_RF: Y-Def , 61 , 0 ( | *), 0.61, 0.61, 0.61, 0.61, 0.61
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 5 , 0 (* | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Tuned_RF: Y-Def , 11 , 0 ( * | ), 0.11, 0.11, 0.11, 0.11, 0.11
1 , Grid_CART: Y-Def , 38 , 0 ( * ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Grid_RF: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Naive_CART: Y-Def , 60 , 0 ( | * ), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 68 , 0 ( | *), 0.68, 0.68, 0.68, 0.68, 0.68
End time :2016-02-10 05:07:49
Tuning objective: f
Begin time: 2016-02-10 05:07:49
Dataset: synapseV0
------------------------------
The.cart.max_features: 0.24
The.cart.max_depth: 12
The.cart.min_samples_split: 5
The.cart.min_samples_leaf: 14
The.option.threshold: 0.01
evaluation: 60
Tuned_CART Running Time: 4.001
------------------------------
Grid_CART Running Time: 1.154
------------------------------
Naive_CART Running Time: 0.104
------------------------------
The.rf.min_samples_split: 1
The.rf.min_samples_leaf : 12
The.rf.max_leaf_nodes: 40
The.rf.n_estimators: 75
The.rf.max_features: 1
The.option.threshold: 0.11
evaluation: 70
Tuned_RF Running Time: 21.354
------------------------------
Grid_RF Running Time: 84.163
------------------------------
Naive_RF Running Time: 0.466
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 54 , 0 (* | ), 0.54, 0.54, 0.54, 0.54, 0.54
1 , Tuned_CART: Y-Def , 56 , 0 ( * | ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Naive_CART: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Naive_RF: Y-Def , 85 , 0 ( | * ), 0.85, 0.85, 0.85, 0.85, 0.85
1 , Grid_RF: Y-Def , 95 , 0 ( | *), 0.95, 0.95, 0.95, 0.95, 0.95
1 , Grid_CART: Y-Def , 95 , 0 ( | *), 0.95, 0.95, 0.95, 0.95, 0.95
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 33 , 0 (* | ), 0.33, 0.33, 0.33, 0.33, 0.33
1 , Tuned_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Naive_RF: Y-Def , 53 , 0 ( * | ), 0.53, 0.53, 0.53, 0.53, 0.53
1 , Naive_CART: Y-Def , 61 , 0 ( | * ), 0.61, 0.61, 0.61, 0.61, 0.61
1 , Grid_RF: Y-Def , 73 , 0 ( | * ), 0.73, 0.73, 0.73, 0.73, 0.73
1 , Grid_CART: Y-Def , 76 , 0 ( | *), 0.76, 0.76, 0.76, 0.76, 0.76
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 71 , 0 (* | ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Naive_CART: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Grid_RF: Y-Def , 72 , 0 ( * | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Tuned_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Tuned_RF: Y-Def , 76 , 0 ( | *), 0.76, 0.76, 0.76, 0.76, 0.76
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 63 , 0 (* | ), 0.63, 0.63, 0.63, 0.63, 0.63
1 , Tuned_CART: Y-Def , 65 , 0 ( * | ), 0.65, 0.65, 0.65, 0.65, 0.65
1 , Naive_CART: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Naive_RF: Y-Def , 80 , 0 ( | * ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Grid_CART: Y-Def , 81 , 0 ( | * ), 0.81, 0.81, 0.81, 0.81, 0.81
1 , Grid_RF: Y-Def , 82 , 0 ( | *), 0.82, 0.82, 0.82, 0.82, 0.82
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_CART: Y-Def , 37 , 0 (* | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Grid_RF: Y-Def , 41 , 0 ( * | ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Naive_CART: Y-Def , 52 , 0 ( | * ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Tuned_RF: Y-Def , 59 , 0 ( | * ), 0.59, 0.59, 0.59, 0.59, 0.59
1 , Tuned_CART: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
1 , Naive_RF: Y-Def , 60 , 0 ( | *), 0.60, 0.60, 0.60, 0.60, 0.60
End time :2016-02-10 05:09:41
Tuning objective: f
Begin time: 2016-02-10 05:09:41
Dataset: velocityV0
------------------------------
The.cart.max_features: 1
The.cart.max_depth: 2
The.cart.min_samples_split: 16
The.cart.min_samples_leaf: 2
The.option.threshold: 0.95
evaluation: 70
Tuned_CART Running Time: 5.087
------------------------------
Grid_CART Running Time: 1.215
------------------------------
Naive_CART Running Time: 0.118
------------------------------
The.rf.min_samples_split: 3
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 30
The.rf.n_estimators: 71
The.rf.max_features: 0.08
The.option.threshold: 1
evaluation: 80
Tuned_RF Running Time: 25.198
------------------------------
Grid_RF Running Time: 85.703
------------------------------
Naive_RF Running Time: 0.5
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 13 , 0 (* | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Naive_RF: Y-Def , 28 , 0 ( * | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Tuned_RF: Y-Def , 44 , 0 ( * | ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Grid_CART: Y-Def , 45 , 0 ( * | ), 0.45, 0.45, 0.45, 0.45, 0.45
1 , Tuned_CART: Y-Def , 90 , 0 ( | *), 0.90, 0.90, 0.90, 0.90, 0.90
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Naive_RF: Y-Def , 6 , 0 ( * | ), 0.06, 0.06, 0.06, 0.06, 0.06
1 , Naive_CART: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Tuned_RF: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Grid_CART: Y-Def , 24 , 0 ( * | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Tuned_CART: Y-Def , 66 , 0 ( | *), 0.66, 0.66, 0.66, 0.66, 0.66
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_CART: Y-Def , 72 , 0 (* | ), 0.72, 0.72, 0.72, 0.72, 0.72
1 , Grid_CART: Y-Def , 78 , 0 ( * | ), 0.78, 0.78, 0.78, 0.78, 0.78
1 , Naive_CART: Y-Def , 79 , 0 ( * | ), 0.79, 0.79, 0.79, 0.79, 0.79
1 , Tuned_RF: Y-Def , 80 , 0 ( * | ), 0.80, 0.80, 0.80, 0.80, 0.80
1 , Naive_RF: Y-Def , 89 , 0 ( | * ), 0.89, 0.89, 0.89, 0.89, 0.89
1 , Grid_RF: Y-Def , 95 , 0 ( | *), 0.95, 0.95, 0.95, 0.95, 0.95
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 23 , 0 (* | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Naive_RF: Y-Def , 43 , 0 ( * | ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Naive_CART: Y-Def , 50 , 0 ( *| ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_RF: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Grid_CART: Y-Def , 56 , 0 ( | * ), 0.57, 0.57, 0.57, 0.57, 0.57
1 , Tuned_CART: Y-Def , 80 , 0 ( | *), 0.80, 0.80, 0.80, 0.80, 0.80
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 23 , 0 (* | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Naive_RF: Y-Def , 44 , 0 ( | * ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Tuned_CART: Y-Def , 48 , 0 ( | * ), 0.48, 0.48, 0.48, 0.48, 0.48
1 , Naive_CART: Y-Def , 50 , 0 ( | * ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuned_RF: Y-Def , 56 , 0 ( | *), 0.56, 0.56, 0.56, 0.56, 0.56
1 , Grid_CART: Y-Def , 56 , 0 ( | *), 0.56, 0.56, 0.56, 0.56, 0.56
End time :2016-02-10 05:11:38
Tuning objective: f
Begin time: 2016-02-10 05:11:38
Dataset: xercesV0
------------------------------
The.cart.max_features: 0.71
The.cart.max_depth: 46
The.cart.min_samples_split: 9
The.cart.min_samples_leaf: 5
The.option.threshold: 0.67
evaluation: 60
Tuned_CART Running Time: 6.667
------------------------------
Grid_CART Running Time: 1.44
------------------------------
Naive_CART Running Time: 0.183
------------------------------
The.rf.min_samples_split: 1
The.rf.min_samples_leaf : 2
The.rf.max_leaf_nodes: 27
The.rf.n_estimators: 122
The.rf.max_features: 0.51
The.option.threshold: 0.95
evaluation: 70
Tuned_RF Running Time: 25.266
------------------------------
Grid_RF Running Time: 89.279
------------------------------
Naive_RF Running Time: 0.664
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 18 , 0 (* | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Grid_CART: Y-Def , 23 , 0 ( * | ), 0.23, 0.23, 0.23, 0.23, 0.23
1 , Naive_CART: Y-Def , 24 , 0 ( * | ), 0.24, 0.24, 0.24, 0.24, 0.24
1 , Tuned_RF: Y-Def , 36 , 0 ( | * ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Naive_RF: Y-Def , 43 , 0 ( | * ), 0.43, 0.43, 0.43, 0.43, 0.43
1 , Tuned_CART: Y-Def , 47 , 0 ( | *), 0.47, 0.47, 0.47, 0.47, 0.47
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 14 , 0 (* | ), 0.14, 0.14, 0.14, 0.14, 0.14
1 , Grid_CART: Y-Def , 16 , 0 ( * | ), 0.16, 0.16, 0.16, 0.16, 0.16
1 , Naive_CART: Y-Def , 19 , 0 ( * | ), 0.19, 0.19, 0.19, 0.19, 0.19
1 , Naive_RF: Y-Def , 19 , 0 ( * | ), 0.19, 0.19, 0.19, 0.19, 0.19
1 , Tuned_CART: Y-Def , 41 , 0 ( | * ), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Tuned_RF: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 13 , 0 (* | ), 0.13, 0.13, 0.13, 0.13, 0.13
1 , Tuned_CART: Y-Def , 17 , 0 ( * | ), 0.17, 0.17, 0.17, 0.17, 0.17
1 , Naive_CART: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Grid_RF: Y-Def , 18 , 0 ( * | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Grid_CART: Y-Def , 20 , 0 ( * | ), 0.20, 0.20, 0.20, 0.20, 0.20
1 , Naive_RF: Y-Def , 28 , 0 ( | *), 0.29, 0.29, 0.29, 0.29, 0.29
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 18 , 0 (* | ), 0.18, 0.18, 0.18, 0.18, 0.18
1 , Tuned_RF: Y-Def , 19 , 0 ( * | ), 0.19, 0.19, 0.19, 0.19, 0.19
1 , Naive_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Grid_CART: Y-Def , 21 , 0 ( * | ), 0.21, 0.21, 0.21, 0.21, 0.21
1 , Tuned_CART: Y-Def , 25 , 0 ( * | ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Naive_RF: Y-Def , 34 , 0 ( | *), 0.34, 0.34, 0.34, 0.34, 0.34
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Grid_RF: Y-Def , 30 , 0 (* | ), 0.30, 0.30, 0.30, 0.30, 0.30
1 , Grid_CART: Y-Def , 36 , 0 ( * | ), 0.36, 0.36, 0.36, 0.36, 0.36
1 , Naive_CART: Y-Def , 37 , 0 ( * | ), 0.37, 0.37, 0.37, 0.37, 0.37
1 , Tuned_RF: Y-Def , 44 , 0 ( |* ), 0.44, 0.44, 0.44, 0.44, 0.44
1 , Tuned_CART: Y-Def , 52 , 0 ( | * ), 0.52, 0.52, 0.52, 0.52, 0.52
1 , Naive_RF: Y-Def , 56 , 0 ( | *), 0.56, 0.56, 0.56, 0.56, 0.56
End time :2016-02-10 05:13:42
Tuning objective: f
Begin time: 2016-02-10 05:13:42
Dataset: xercesV1
------------------------------
The.cart.max_features: 0.43
The.cart.max_depth: 2
The.cart.min_samples_split: 5
The.cart.min_samples_leaf: 9
The.option.threshold: 0.5
evaluation: 50
Tuned_CART Running Time: 8.283
------------------------------
Grid_CART Running Time: 1.815
------------------------------
Naive_CART Running Time: 0.276
------------------------------
The.rf.min_samples_split: 5
The.rf.min_samples_leaf : 6
The.rf.max_leaf_nodes: 18
The.rf.n_estimators: 95
The.rf.max_features: 0.3
The.option.threshold: 0.03
evaluation: 50
Tuned_RF Running Time: 22.733
------------------------------
Grid_RF Running Time: 97.899
------------------------------
Naive_RF Running Time: 0.853
********** pd **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 1 , 0 (* | ), 0.01, 0.01, 0.01, 0.01, 0.01
1 , Naive_CART: Y-Def , 75 , 0 ( | * ), 0.75, 0.75, 0.75, 0.75, 0.75
1 , Naive_RF: Y-Def , 77 , 0 ( | * ), 0.77, 0.77, 0.77, 0.77, 0.77
1 , Tuned_CART: Y-Def , 87 , 0 ( | * ), 0.87, 0.87, 0.87, 0.87, 0.87
1 , Grid_CART: Y-Def , 96 , 0 ( | * ), 0.96, 0.96, 0.96, 0.96, 0.96
1 , Grid_RF: Y-Def , 100 , 0 ( | *), 1.00, 1.00, 1.00, 1.00, 1.00
********** pf **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 28 , 0 (* | ), 0.29, 0.29, 0.29, 0.29, 0.29
1 , Naive_RF: Y-Def , 71 , 0 ( | * ), 0.71, 0.71, 0.71, 0.71, 0.71
1 , Naive_CART: Y-Def , 76 , 0 ( | * ), 0.76, 0.76, 0.76, 0.76, 0.76
1 , Tuned_CART: Y-Def , 83 , 0 ( | * ), 0.83, 0.83, 0.83, 0.83, 0.83
1 , Grid_CART: Y-Def , 87 , 0 ( | * ), 0.87, 0.87, 0.87, 0.87, 0.87
1 , Grid_RF: Y-Def , 97 , 0 ( | *), 0.97, 0.97, 0.97, 0.97, 0.97
********** prec **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 2 , 0 (* | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Naive_CART: Y-Def , 25 , 0 ( | * ), 0.25, 0.25, 0.25, 0.25, 0.25
1 , Tuned_CART: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_RF: Y-Def , 26 , 0 ( | * ), 0.26, 0.26, 0.26, 0.26, 0.26
1 , Grid_CART: Y-Def , 27 , 0 ( | *), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_RF: Y-Def , 27 , 0 ( | *), 0.27, 0.27, 0.27, 0.27, 0.27
********** f **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 2 , 0 (* | ), 0.02, 0.02, 0.02, 0.02, 0.02
1 , Naive_CART: Y-Def , 38 , 0 ( | * ), 0.38, 0.38, 0.38, 0.38, 0.38
1 , Tuned_CART: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Naive_RF: Y-Def , 40 , 0 ( | * ), 0.40, 0.40, 0.40, 0.40, 0.40
1 , Grid_RF: Y-Def , 41 , 0 ( | *), 0.41, 0.41, 0.41, 0.41, 0.41
1 , Grid_CART: Y-Def , 42 , 0 ( | *), 0.42, 0.42, 0.42, 0.42, 0.42
********** g **********
rank , name , med , iqr
----------------------------------------------------
1 , Tuned_RF: Y-Def , 3 , 0 (* | ), 0.03, 0.03, 0.03, 0.03, 0.03
1 , Grid_RF: Y-Def , 5 , 0 ( * | ), 0.05, 0.05, 0.05, 0.05, 0.05
1 , Grid_CART: Y-Def , 22 , 0 ( *| ), 0.22, 0.22, 0.22, 0.22, 0.22
1 , Tuned_CART: Y-Def , 27 , 0 ( | * ), 0.27, 0.27, 0.27, 0.27, 0.27
1 , Naive_CART: Y-Def , 35 , 0 ( | * ), 0.35, 0.35, 0.35, 0.35, 0.35
1 , Naive_RF: Y-Def , 41 , 0 ( | *), 0.41, 0.41, 0.41, 0.41, 0.41
End time :2016-02-10 05:15:54
comment on complexity of method
number of evaluations of caret ..
reproduce Canadian results---test on tuning data
Compare my results with theirs
I used 20 iterations instead of 100 to get a quick result, the seed is different ........(I forgot to set the same seed as theirs)
Their C5.0 raw results with 100 iterations
## optimize default system improvement
## 1 0.6812443 0.5276690 JM1 0.15357536
## 2 0.7718680 0.4831502 PC5 0.28871785
## 3 0.6817029 0.4994888 camel-1.2 0.18221415
## 4 0.8179451 0.4536583 prop-1 0.36428682
## 5 0.8545482 0.4823125 prop-2 0.37223573
## 6 0.7467892 0.4786966 prop-3 0.26809259
## 7 0.7624442 0.4425753 prop-4 0.31986892
## 8 0.7533058 0.4630926 prop-5 0.29021322
## 9 0.7626922 0.6653037 xalan-2.5 0.09738852
## 10 0.8443650 0.7655026 xalan-2.6 0.07886231
## 11 0.8401523 0.4243956 eclipse-2.0 0.41575663
## 12 0.7895530 0.4386999 eclipse-2.1 0.35085306
## 13 0.8010375 0.5310208 eclipse-3.0 0.27001672
## 14 0.8002733 0.5397900 eclipse34_debug 0.26048335
## 15 0.9685388 0.9149021 eclipse34_swt 0.05363675
## 16 0.8139885 0.5447301 jdt 0.26925838
## 17 0.7917020 0.4136083 mylyn 0.37809369
## 18 0.7260917 0.4600913 pde 0.26600047
My C5.0 raw results with 20 iterations(!!! the position of Camel is different)
tuned default data_set improvement
1 0.6808698 0.4719743 jm1 0.20889548
2 0.7836656 0.5204229 pc5 0.26324270
3 0.8196309 0.4762283 prop1 0.34340262
4 0.8582901 0.5075686 prop2 0.35072151
5 0.7490999 0.4790891 prop3 0.27001083
6 0.7612573 0.4313464 prop4 0.32991097
7 0.7497757 0.4708872 prop5 0.27888844
8 0.6750136 0.5221968 camel 0.15281680
9 0.7741023 0.6605863 xalan25 0.11351602
10 0.8485274 0.7654055 xalan26 0.08312183
11 0.8130751 0.5425995 platform2 0.27047558
12 0.7465420 0.4759050 platform21 0.27063708
13 0.7643491 0.5623480 platfrom3 0.20200103
14 0.8043490 0.5504841 debug34 0.25386495
15 0.9672185 0.9151623 swt34 0.05205627
16 0.8057795 0.5890076 jdt 0.21677182
17 0.7861859 0.4349807 mylyn 0.35120518
18 0.7288896 0.4620439 pde 0.26684567
Their boxplots
My box plots
DE tune R learner Results
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 155.232
------------------------------
NaiveCART Running Time: 2.368
------------------------------
evaluation: 50
bestconf: [36, True, 'rules']
TuneC50 Running Time: 147.869
------------------------------
NaiveC50 Running Time: 2.456
------------------------------
evaluation: 70
bestconf: [9, 0.05014, False]
Tuneavnnet Running Time: 212.261
------------------------------
Naiveavnnet Running Time: 2.36
++++++++++++++++++++
DataSet: camel-1.2
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveC50 , 45 , 17 ( -- | * ------ ), 0.41, 0.42, 0.58, 0.61, 0.68
1 , Naiveavnnet , 53 , 3 ( - | *-------- ), 0.50, 0.52, 0.54, 0.55, 0.64
1 , Tuneavnnet , 53 , 3 ( ---| *-- ), 0.49, 0.53, 0.55, 0.55, 0.57
1 , NaiveCART , 56 , 13 ( -------| * ------- ), 0.45, 0.54, 0.57, 0.60, 0.68
1 , TuneC50 , 57 , 8 ( -------|--- *- ), 0.45, 0.57, 0.61, 0.62, 0.64
1 , TuneCART , 60 , 4 ( | -- *------ ), 0.56, 0.58, 0.60, 0.61, 0.68
End time :2016-03-05 00:44:01
------------------------------
evaluation: 60
bestconf: [0.01]
TuneCART Running Time: 155.393
------------------------------
NaiveCART Running Time: 2.4
------------------------------
evaluation: 50
bestconf: [36, True, 'rules']
TuneC50 Running Time: 156.056
------------------------------
NaiveC50 Running Time: 2.636
------------------------------
evaluation: 70
bestconf: [8, 0.08, False]
Tuneavnnet Running Time: 232.296
------------------------------
Naiveavnnet Running Time: 2.46
++++++++++++++++++++
DataSet: xalan-2.5
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naiveavnnet , 62 , 0 ( | -- *---- ), 0.60, 0.62, 0.62, 0.63, 0.66
1 , Tuneavnnet , 62 , 3 ( | ---* ----- ), 0.60, 0.62, 0.63, 0.64, 0.68
1 , NaiveCART , 62 , 2 ( | -- * ----- ), 0.61, 0.62, 0.63, 0.65, 0.68
1 , TuneCART , 62 , 2 ( | -- * ----- ), 0.61, 0.62, 0.63, 0.65, 0.68
1 , NaiveC50 , 63 , 3 ( | ---- *----- ), 0.60, 0.63, 0.64, 0.65, 0.68
1 , TuneC50 , 64 , 2 ( | - *- ), 0.62, 0.63, 0.64, 0.65, 0.66
End time :2016-03-05 00:53:13
------------------------------
evaluation: 50
bestconf: [0.01637]
TuneCART Running Time: 133.817
------------------------------
NaiveCART Running Time: 2.409
------------------------------
evaluation: 50
bestconf: [7, False, 'rules']
TuneC50 Running Time: 159.229
------------------------------
NaiveC50 Running Time: 2.639
------------------------------
evaluation: 70
bestconf: [6, 0.04, True]
Tuneavnnet Running Time: 240.722
------------------------------
Naiveavnnet Running Time: 2.553
++++++++++++++++++++
DataSet: xalan-2.6
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , TuneC50 , 68 , 3 ( --------* ---|----------- ), 0.64, 0.68, 0.68, 0.69, 0.76
1 , NaiveC50 , 68 , 3 ( --------* ---|----------- ), 0.64, 0.68, 0.68, 0.69, 0.76
1 , Naiveavnnet , 67 , 4 ( --- *---|- ), 0.64, 0.66, 0.69, 0.69, 0.72
1 , NaiveCART , 68 , 4 ( ----- * | - ), 0.65, 0.67, 0.68, 0.74, 0.74
1 , Tuneavnnet , 69 , 2 ( ---- *-|------------- ), 0.66, 0.68, 0.69, 0.70, 0.78
1 , TuneCART , 69 , 4 ( -- |* ---- ), 0.67, 0.68, 0.71, 0.72, 0.74
End time :2016-03-05 01:02:14
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 156.207
------------------------------
NaiveCART Running Time: 2.374
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 153.898
------------------------------
NaiveC50 Running Time: 2.618
------------------------------
evaluation: 50
bestconf: [2, 0.06474, False]
Tuneavnnet Running Time: 166.713
------------------------------
Naiveavnnet Running Time: 2.462
++++++++++++++++++++
DataSet: Debug3.4
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naiveavnnet , 67 , 4 ( | - *- ), 0.65, 0.66, 0.68, 0.70, 0.72
1 , TuneC50 , 68 , 4 ( | -- *- ), 0.64, 0.68, 0.70, 0.70, 0.72
1 , TuneCART , 69 , 3 ( | - *--- ), 0.67, 0.68, 0.70, 0.71, 0.77
1 , Tuneavnnet , 70 , 2 ( | - *- ), 0.65, 0.69, 0.70, 0.72, 0.74
1 , NaiveC50 , 70 , 33 ( --------|-------- *- ), 0.38, 0.69, 0.71, 0.72, 0.74
1 , NaiveCART , 72 , 4 ( ------------|----------*-- ), 0.30, 0.71, 0.72, 0.74, 0.78
End time :2016-03-05 01:10:19
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 158.23
------------------------------
NaiveCART Running Time: 2.429
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 155.393
------------------------------
NaiveC50 Running Time: 2.672
------------------------------
evaluation: 80
bestconf: [4, 0.08, True]
Tuneavnnet Running Time: 246.987
------------------------------
Naiveavnnet Running Time: 2.416
++++++++++++++++++++
DataSet: JDT
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveCART , 71 , 3 ( | - * ), 0.69, 0.70, 0.72, 0.75, 0.76
1 , NaiveC50 , 71 , 5 ( --------------|------- * ), 0.35, 0.70, 0.73, 0.74, 0.75
1 , Naiveavnnet , 72 , 23 ( ----|------- * --- ), 0.51, 0.70, 0.73, 0.75, 0.80
1 , TuneCART , 72 , 1 ( | --*-- ), 0.68, 0.72, 0.72, 0.73, 0.77
1 , TuneC50 , 73 , 2 ( | - * ), 0.71, 0.73, 0.74, 0.74, 0.76
1 , Tuneavnnet , 75 , 2 ( | --*-- ), 0.72, 0.75, 0.76, 0.78, 0.82
End time :2016-03-05 01:19:47
------------------------------
evaluation: 50
bestconf: [0.42119]
TuneCART Running Time: 137.345
------------------------------
NaiveCART Running Time: 2.739
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 180.776
------------------------------
NaiveC50 Running Time: 3.099
------------------------------
evaluation: 60
bestconf: [8, 0.01641, True]
Tuneavnnet Running Time: 221.48
------------------------------
Naiveavnnet Running Time: 2.803
++++++++++++++++++++
DataSet: mylyn
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveC50 , 40 , 3 ( -- * --------|-------- ), 0.37, 0.40, 0.41, 0.44, 0.68
1 , TuneCART , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Naiveavnnet , 52 , 17 (------------ * | --- ), 0.35, 0.51, 0.52, 0.64, 0.69
2 , Tuneavnnet , 62 , 9 ( -| * ---- ), 0.54, 0.57, 0.63, 0.67, 0.72
2 , NaiveCART , 66 , 7 ( --------------|------ * -- ), 0.36, 0.65, 0.67, 0.71, 0.76
2 , TuneC50 , 66 , 7 ( | --- *- ), 0.60, 0.65, 0.69, 0.69, 0.71
End time :2016-03-05 01:28:55
------------------------------
evaluation: 50
bestconf: [0.34007]
TuneCART Running Time: 132.774
------------------------------
NaiveCART Running Time: 2.695
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 173.124
------------------------------
NaiveC50 Running Time: 2.918
------------------------------
evaluation: 70
bestconf: [6, 0.04, False]
Tuneavnnet Running Time: 246.323
------------------------------
Naiveavnnet Running Time: 2.677
++++++++++++++++++++
DataSet: PDE
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveC50 , 40 , 3 ( - * -- | ), 0.37, 0.39, 0.40, 0.41, 0.44
2 , TuneC50 , 48 , 11 ( -------- * | ------- ), 0.39, 0.48, 0.50, 0.60, 0.68
2 , TuneCART , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
2 , Naiveavnnet , 50 , 13 ( ----- * ----- ), 0.44, 0.50, 0.52, 0.61, 0.66
2 , Tuneavnnet , 59 , 8 ( |---- * --- ), 0.52, 0.57, 0.60, 0.64, 0.68
2 , NaiveCART , 60 , 25 ( -------------|-- * -- ), 0.38, 0.55, 0.63, 0.66, 0.68
End time :2016-03-05 01:38:16
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 331.249
------------------------------
NaiveCART Running Time: 8.725
------------------------------
evaluation: 50
bestconf: [36, True, 'rules']
TuneC50 Running Time: 601.96
------------------------------
NaiveC50 Running Time: 10.704
------------------------------
evaluation: 80
bestconf: [7, 0.09, False]
Tuneavnnet Running Time: 940.884
------------------------------
Naiveavnnet Running Time: 6.826
++++++++++++++++++++
DataSet: platform2.0
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveCART , 35 , 1 ( -* ----------|-------- ), 0.34, 0.35, 0.36, 0.39, 0.65
1 , TuneC50 , 37 , 1 ( -- * ---------|---------- ), 0.34, 0.37, 0.38, 0.40, 0.69
1 , NaiveC50 , 38 , 3 ( -- * | --- ), 0.35, 0.38, 0.39, 0.68, 0.73
2 , Naiveavnnet , 56 , 21 ( ----- | * - ), 0.41, 0.47, 0.65, 0.67, 0.68
2 , Tuneavnnet , 67 , 4 ( | ------- *--- ), 0.56, 0.66, 0.67, 0.68, 0.73
2 , TuneCART , 68 , 1 ( | -*- ), 0.67, 0.68, 0.68, 0.70, 0.71
End time :2016-03-05 02:09:57
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 465.467
------------------------------
NaiveCART Running Time: 10.462
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 695.286
------------------------------
NaiveC50 Running Time: 11.845
------------------------------
evaluation: 50
bestconf: [7, 0.04361, True]
Tuneavnnet Running Time: 654.296
------------------------------
Naiveavnnet Running Time: 7.474
++++++++++++++++++++
DataSet: platform2.1
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveCART , 40 , 4 (-- * -------|------------- ), 0.36, 0.39, 0.40, 0.45, 0.69
1 , NaiveC50 , 42 , 3 ( - *- | ), 0.40, 0.41, 0.43, 0.44, 0.45
1 , Naiveavnnet , 45 , 2 ( * ----|---------- ), 0.44, 0.45, 0.46, 0.49, 0.65
2 , Tuneavnnet , 57 , 12 ( ---- | *----- ), 0.48, 0.52, 0.60, 0.62, 0.67
2 , TuneC50 , 61 , 19 ( ------------|----- *--- ), 0.41, 0.60, 0.63, 0.64, 0.67
3 , TuneCART , 64 , 3 ( | - *- ), 0.61, 0.62, 0.64, 0.65, 0.66
End time :2016-03-05 02:40:42
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 577.648
------------------------------
NaiveCART Running Time: 12.916
------------------------------
evaluation: 50
bestconf: [7, False, 'rules']
TuneC50 Running Time: 925.814
------------------------------
NaiveC50 Running Time: 16.915
------------------------------
evaluation: 60
bestconf: [9, 0.09475, True]
Tuneavnnet Running Time: 1065.376
------------------------------
Naiveavnnet Running Time: 9.662
++++++++++++++++++++
DataSet: platform3.0
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , TuneC50 , 42 , 32 (--- * | - ), 0.33, 0.37, 0.42, 0.67, 0.69
1 , NaiveC50 , 42 , 32 (--- * | - ), 0.33, 0.37, 0.42, 0.67, 0.69
2 , Naiveavnnet , 59 , 11 ( -| *---- ), 0.50, 0.52, 0.62, 0.62, 0.68
2 , Tuneavnnet , 59 , 12 ( |-- * - ), 0.51, 0.56, 0.63, 0.67, 0.68
2 , TuneCART , 63 , 2 ( | * - ), 0.63, 0.63, 0.64, 0.66, 0.67
2 , NaiveCART , 67 , 2 ( | * ), 0.66, 0.67, 0.67, 0.68, 0.69
End time :2016-03-05 03:24:10
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 162.653
------------------------------
NaiveCART Running Time: 2.427
------------------------------
evaluation: 50
bestconf: [27, False, 'tree']
TuneC50 Running Time: 162.66
------------------------------
NaiveC50 Running Time: 2.786
------------------------------
evaluation: 80
bestconf: [7, 0.09, True]
Tuneavnnet Running Time: 314.136
------------------------------
Naiveavnnet Running Time: 2.749
++++++++++++++++++++
DataSet: SWT3.4
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , Naiveavnnet , 85 , 2 ( --- |* -- ), 0.83, 0.85, 0.86, 0.87, 0.88
1 , Tuneavnnet , 86 , 2 ( --|* --- ), 0.84, 0.86, 0.86, 0.87, 0.89
2 , NaiveCART , 91 , 2 ( | ---- *- ), 0.88, 0.90, 0.91, 0.92, 0.93
2 , NaiveC50 , 91 , 0 ( | ---*--- ), 0.89, 0.91, 0.91, 0.92, 0.94
2 , TuneCART , 91 , 2 ( | ---* - ), 0.89, 0.91, 0.91, 0.93, 0.93
3 , TuneC50 , 94 , 2 ( | -- * ), 0.92, 0.93, 0.94, 0.94, 0.95
End time :2016-03-05 03:34:58
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 389.096
------------------------------
NaiveCART Running Time: 8.645
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 598.578
------------------------------
NaiveC50 Running Time: 10.692
------------------------------
evaluation: 70
bestconf: [8, 0.08, False]
Tuneavnnet Running Time: 727.765
------------------------------
Naiveavnnet Running Time: 6.498
++++++++++++++++++++
DataSet: JM1
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveCART , 40 , 1 ( -*-----------|------------ ), 0.39, 0.39, 0.40, 0.41, 0.65
1 , Tuneavnnet , 43 , 5 ( -- * --|---------- ), 0.40, 0.42, 0.44, 0.50, 0.63
1 , Naiveavnnet , 50 , 2 ( - *-|----- ), 0.48, 0.49, 0.50, 0.50, 0.59
2 , TuneC50 , 61 , 2 ( | -- *-- ), 0.58, 0.60, 0.61, 0.62, 0.64
2 , TuneCART , 61 , 2 ( | --*- ), 0.60, 0.61, 0.62, 0.62, 0.63
2 , NaiveC50 , 63 , 24 ( --------------|--------- *- ), 0.37, 0.63, 0.64, 0.66, 0.67
End time :2016-03-05 04:04:00
------------------------------
evaluation: 70
bestconf: [0.04]
TuneCART Running Time: 249.983
------------------------------
NaiveCART Running Time: 3.886
------------------------------
evaluation: 50
bestconf: [27, False, 'tree']
TuneC50 Running Time: 264.781
------------------------------
NaiveC50 Running Time: 4.516
------------------------------
evaluation: 60
bestconf: [9, 0.08236, True]
Tuneavnnet Running Time: 357.409
------------------------------
Naiveavnnet Running Time: 3.598
++++++++++++++++++++
DataSet: PC5
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveC50 , 34 , 4 (-- *-----------|------------ ), 0.30, 0.32, 0.34, 0.36, 0.71
1 , Naiveavnnet , 40 , 30 ( -- | *--- ), 0.36, 0.38, 0.66, 0.67, 0.72
1 , TuneCART , 66 , 27 ( | *- ), 0.41, 0.41, 0.67, 0.68, 0.69
2 , TuneC50 , 68 , 1 ( | -- * ), 0.65, 0.68, 0.69, 0.70, 0.70
2 , NaiveCART , 69 , 3 ( | -- *- ), 0.66, 0.67, 0.69, 0.70, 0.72
2 , Tuneavnnet , 70 , 2 ( | -*- ), 0.68, 0.69, 0.70, 0.71, 0.73
End time :2016-03-05 04:18:44
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 558.587
------------------------------
NaiveCART Running Time: 15.165
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 1099.496
------------------------------
NaiveC50 Running Time: 20.2
------------------------------
evaluation: 50
bestconf: [7, 0.04313, True]
Tuneavnnet Running Time: 993.428
------------------------------
Naiveavnnet Running Time: 10.33
++++++++++++++++++++
DataSet: Prop-1
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveCART , 40 , 1 (--*- | ), 0.39, 0.40, 0.40, 0.41, 0.42
1 , NaiveC50 , 41 , 3 (- *-----------|---------- ), 0.38, 0.39, 0.41, 0.43, 0.63
2 , Tuneavnnet , 50 , 2 ( -- * |-- ), 0.47, 0.49, 0.50, 0.52, 0.56
2 , Naiveavnnet , 50 , 2 ( - * |- ), 0.49, 0.50, 0.51, 0.53, 0.55
3 , TuneCART , 63 , 1 ( | -*-- ), 0.62, 0.63, 0.63, 0.64, 0.66
3 , TuneC50 , 64 , 1 ( | - * ), 0.62, 0.63, 0.64, 0.65, 0.66
End time :2016-03-05 05:03:42
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 774.669
------------------------------
NaiveCART Running Time: 9.447
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 1321.466
------------------------------
NaiveC50 Running Time: 25.291
------------------------------
evaluation: 50
bestconf: [8, 0.05534, True]
Tuneavnnet Running Time: 1132.499
------------------------------
Naiveavnnet Running Time: 12.672
++++++++++++++++++++
DataSet: Prop-2
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveC50 , 40 , 4 ( --* --------|---------- ), 0.37, 0.40, 0.40, 0.45, 0.68
1 , Naiveavnnet , 50 , 1 ( ---* | ), 0.46, 0.49, 0.50, 0.51, 0.51
1 , NaiveCART , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuneavnnet , 53 , 6 ( ----- *| ), 0.47, 0.52, 0.54, 0.55, 0.55
2 , TuneCART , 70 , 0 ( | -* ), 0.69, 0.70, 0.70, 0.71, 0.71
2 , TuneC50 , 70 , 1 ( | * ), 0.70, 0.70, 0.71, 0.72, 0.73
End time :2016-03-05 05:58:18
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 353.485
------------------------------
NaiveCART Running Time: 5.123
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 609.655
------------------------------
NaiveC50 Running Time: 9.597
------------------------------
evaluation: 60
bestconf: [8, 0.06, True]
Tuneavnnet Running Time: 682.712
------------------------------
Naiveavnnet Running Time: 6.729
++++++++++++++++++++
DataSet: Prop-3
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , TuneC50 , 46 , 2 ( --- * ------|------------- ), 0.45, 0.46, 0.47, 0.49, 0.60
1 , NaiveC50 , 50 , 1 ( - * | ), 0.49, 0.49, 0.50, 0.50, 0.50
1 , NaiveCART , 50 , 0 ( * | ), 0.50, 0.50, 0.50, 0.50, 0.50
1 , Tuneavnnet , 50 , 3 ( -------- * | ---------- ), 0.46, 0.50, 0.51, 0.53, 0.59
1 , Naiveavnnet , 50 , 2 ( --- * |----- ), 0.48, 0.50, 0.50, 0.53, 0.56
2 , TuneCART , 56 , 0 ( | --- *----- ), 0.54, 0.56, 0.56, 0.57, 0.60
End time :2016-03-05 06:26:05
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 314.127
------------------------------
NaiveCART Running Time: 7.508
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 514.68
------------------------------
NaiveC50 Running Time: 7.993
------------------------------
evaluation: 60
bestconf: [8, 0.05257, False]
Tuneavnnet Running Time: 621.268
------------------------------
Naiveavnnet Running Time: 6.038
++++++++++++++++++++
DataSet: Prop-4
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveCART , 44 , 2 (--*------- | ), 0.42, 0.43, 0.44, 0.45, 0.50
1 , NaiveC50 , 44 , 3 ( - *- | ), 0.43, 0.43, 0.45, 0.47, 0.47
2 , Naiveavnnet , 50 , 2 ( ---- *-- | ), 0.46, 0.50, 0.50, 0.51, 0.52
2 , Tuneavnnet , 49 , 6 ( - * |---- ), 0.48, 0.49, 0.51, 0.55, 0.58
3 , TuneC50 , 60 , 4 ( -----------|---- * --- ), 0.46, 0.58, 0.60, 0.62, 0.64
3 , TuneCART , 62 , 1 ( | - * -- ), 0.61, 0.61, 0.62, 0.64, 0.66
End time :2016-03-05 06:50:37
------------------------------
evaluation: 60
bestconf: [0.0001]
TuneCART Running Time: 321.977
------------------------------
NaiveCART Running Time: 4.723
------------------------------
evaluation: 50
bestconf: [11, True, 'tree']
TuneC50 Running Time: 513.227
------------------------------
NaiveC50 Running Time: 8.017
------------------------------
evaluation: 50
bestconf: [7, 0.07826, True]
Tuneavnnet Running Time: 541.967
------------------------------
Naiveavnnet Running Time: 6.086
++++++++++++++++++++
DataSet: Prop-5
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , NaiveC50 , 48 , 0 ( -*- | ), 0.48, 0.48, 0.48, 0.49, 0.49
1 , Naiveavnnet , 49 , 1 ( - *|- ), 0.48, 0.49, 0.50, 0.51, 0.52
1 , TuneC50 , 46 , 13 (--- | * -- ), 0.41, 0.43, 0.54, 0.57, 0.59
1 , NaiveCART , 50 , 0 ( ----* ), 0.48, 0.50, 0.50, 0.50, 0.50
2 , TuneCART , 52 , 2 ( |- *-- ), 0.50, 0.52, 0.53, 0.53, 0.55
2 , Tuneavnnet , 52 , 2 ( |-- * -- ), 0.51, 0.52, 0.53, 0.54, 0.55
End time :2016-03-05 07:13:53
++++++++++++++++++++
DataSet: Final
++++++++++++++++++++
********** auc **********
rank , name , med , iqr
----------------------------------------------------
1 , avnnet , 1 , 4 ( - *---|- ),-0.01, 0.01, 0.02, 0.04, 0.14
1 , C50 , 2 , 15 ( - * | --------- ),-0.03, 0.00, 0.03, 0.15, 0.30
1 , CART , 2 , 21 ( ------- * | --- ),-0.12, 0.00, 0.02, 0.18, 0.24
End time :2016-03-05 07:13:53
DE tune R learner
Experiment Setting
- Data set : totally 18 data sets, the same data as in Canada Paper.
- Learners：（Call the following learners directly from R）
- CART:
- complexity: A value that is used to penalize the error rate of terminal nodes of the tree.
- default: 0.01
- search space:[0.0001~0.5]*
- complexity: A value that is used to penalize the error rate of terminal nodes of the tree.
- C5.0:
- trails: an integer specifying the number of boosting iterations, A value of one indicates that a single model is used.
- default : 1
- search space: [1~50]*
- rules ： A logical: should the tree be decomposed into a rule-based model?
- default: TRUE
- search space: [FALSE, TRUE](equivalent:[tree, rule])
- winnow: A logical: should predictor winnowing(i.e, feature selection) be used?
- default: FALSE
- search space:[TRUE, FALSE]
- trails: an integer specifying the number of boosting iterations, A value of one indicates that a single model is used.
- Model Averaged NNet：
- bag: a logical for bagging for each repeat
- default: FALSE
- search space: [TRUE, FALSE]
- weight decay: used to prevent the weights from going too large (?????)
- default: 0.1(this is canada default, but, in caret, it is 0 )
- search space: [0~0.1]*
- size: number of units in the hidden layer. Can be zero if there are skip-layer units.
- default: 1
- search space: [1~9]*
- bag: a logical for bagging for each repeat
- CART:
- Training, Tuning, Testing Data: Bootstrap Sample (this is to be equivalent to canada strategy )
- Training data(1111111): A boot strap sample of size N is randomly drawn with replacemeant from an original dataset, which is also of size N.
- New_training(222222): repeat the above step, generate a new data set of size N, with replacement
- New_tuning: the data rows in 1111111 but not in 222222 will be the new_tuning data.
- Testing data: the rows that don't appear in bootstrap sample will go to testing data
- Training data(1111111): A boot strap sample of size N is randomly drawn with replacemeant from an original dataset, which is also of size N.
- Details:
- Each evaluation in tuning will do generate training, tuning and then evaluate. repeat this step 10 times and return the median value to reduce the randomness.
- Testing(with default parameters or tuning parameters): as evaluation in tuning, evaluate the same parameters 10 times, and return the median value as the final results for that parameter over that data set.
*Note:
- searching space is generated strictly according to the grid from their gridserach. Extremely small space.__.
- no reflection on those learners. just used as it is in the paper.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.