next up previous contents
Next: 5.2.1.13 Stability Test: cgwindow Up: 5.2.1 Indirect (IRLS) Stability Previous: 5.2.1.11 Stability Test: wmargin   Contents


5.2.1.12 Stability Test: binitmean


Table 5.13: IRLS stability experiments for ds1 with binitmean enabled. wmargin is 0.
        Moderate Epsilon
mm mar rrl cgw AUC NaN DEV Time
- - - - 0.896 x 822 523
x - - - 0.896 x 822 536
- x - - 0.895 x 758 546
x x - - 0.895 x 758 567
- - x - 0.948 - 2087 118
x - x - 0.948 - 2087 118
- x x - 0.948 - 1990 118
x x x - 0.948 - 1990 117
- - - x 0.930 x 1327 83
x - - x 0.930 x 1327 84
- x - x 0.928 x 1323 90
x x - x 0.928 x 1323 90
- - x x 0.948 - 2087 86
x - x x 0.948 - 2087 86
- x x x 0.948 - 1990 83
x x x x 0.948 - 1990 83

Our final stability parameter is binitmean. This parameter was inspired by McIntosh [26] where it was used for direct LR CG-MLE. In Table 5.13 we test the effect of enabling binitmean on moderate epsilon experiments using dataset ds1. The Moderate Epsilon group of Table 5.5 can be used to identify the effects of binitmean. It is easy to see that binitmean does not eliminate the occurrence of NaN values, nor does it affect the scores significantly. It does appear to hurt the speed slightly.


Table 5.14: IRLS stability experiments for ds1.100pca with binitmean enabled. wmargin is 0.
        Moderate Epsilon
mm mar rrl cgw AUC NaN DEV Time
- - - - 0.916 - 3356 68
x - - - 0.916 - 3356 69
- x - - 0.914 - 3246 62
x x - - 0.914 - 3246 61
- - x - 0.915 - 3402 63
x - x - 0.915 - 3402 63
- x x - 0.914 - 3259 60
x x x - 0.914 - 3259 62
- - - x 0.919 - 3295 62
x - - x 0.919 - 3295 62
- x - x 0.916 - 3213 55
x x - x 0.916 - 3213 54
- - x x 0.916 - 3342 56
x - x x 0.916 - 3342 56
- x x x 0.914 - 3259 47
x x x x 0.914 - 3259 45

Table 5.14 summarizes binitmean experiments on dataset ds1.100pca using moderate epsilons. The results can be compared to Table 5.9. These two tables are nearly identical. Our conclusion from Table 5.13 and Table 5.14 is that binitmean is not useful for our version of IRLS.


next up previous contents
Next: 5.2.1.13 Stability Test: cgwindow Up: 5.2.1 Indirect (IRLS) Stability Previous: 5.2.1.11 Stability Test: wmargin   Contents
Copyright 2004 Paul Komarek, komarek@cmu.edu