[+] General Parameters: Training data: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold7/train.txt Test data: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold7/test.txt Feature vector representation: Dense. Ranking method: Coordinate Ascent Feature description file: Unspecified. All features will be used. Train metric: map Test metric: NDCG@20 Feature normalization: No Model file: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/cv_dir/Fold7/predict.model [+] Coordinate Ascent's Parameters: No. of random restarts: 5 No. of iterations to search in each direction: 25 Tolerance: 0.001 Regularization: No Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold7/train.txt]: 0... Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold7/train.txt]... [Done.] (90 ranked lists, 8151 entries read) Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold7/test.txt]: 0... Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold7/test.txt]... [Done.] (10 ranked lists, 910 entries read) Initializing... [Done] --------------------------- Training starts... --------------------------- [+] Random restart #1/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 14 | +0.0676 | 0.2743 | 5 | +0.0669 | 0.2744 | 5 | +0.0829 | 0.2744 | 7 | +0.0473 | 0.2744 | 7 | +0.0433 | 0.2744 | 7 | +0.0353 | 0.2744 | 7 | +0.0193 | 0.2745 | 7 | -0.0127 | 0.2745 | 7 | -0.0767 | 0.2747 | 7 | -0.2047 | 0.275 | 7 | -0.4607 | 0.2755 | 7 | -0.9727 | 0.2757 | 8 | +0.0272 | 0.2758 | 8 | +0.0412 | 0.2766 | 8 | +0.0572 | 0.2789 | 8 | +0.0892 | 0.2811 | 8 | +0.1532 | 0.284 | 8 | +0.2812 | 0.2916 | 8 | +0.5372 | 0.2921 | 8 | +1.0492 | 0.2953 | 8 | +2.0732 | 0.2964 | 19 | +0.0096 | 0.2968 | 19 | +0.0116 | 0.2981 | 19 | +0.0156 | 0.3003 | 19 | +0.0236 | 0.3049 | 19 | +0.0396 | 0.3114 | 19 | +0.0716 | 0.3125 | 17 | +0.0071 | 0.3125 | 12 | +0.0391 | 0.3134 | 3 | +0.0108 | 0.3136 | 3 | +0.0148 | 0.3137 | 10 | +0.0088 | 0.3143 | 2 | +0.0148 | 0.3143 | 2 | +0.0228 | 0.3143 | 18 | +0.0087 | 0.3144 | 1 | +0.0087 | 0.3147 | 1 | +0.0107 | 0.3147 | 1 | +0.0387 | 0.3167 | 1 | +0.0707 | 0.3192 | 1 | +0.1347 | 0.3238 | 1 | +0.2627 | 0.3311 | 1 | +0.5187 | 0.3382 | 1 | +1.0307 | 0.3401 | 9 | +0.0048 | 0.3404 | 9 | +0.0068 | 0.3406 | 9 | +0.0108 | 0.3422 | 9 | +0.0188 | 0.3438 | 15 | +0.0067 | 0.3453 | 13 | +0.0047 | 0.3453 | 16 | +0.0027 | 0.3455 | 16 | +7.0E-4 | 0.3456 | 16 | -0.0033 | 0.3472 | 16 | -0.0113 | 0.3473 | 16 | -0.0273 | 0.3496 | 16 | -0.0593 | 0.3512 | 4 | +0.0045 | 0.3512 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 12 | +0.02 | 0.3512 | 12 | +0.024 | 0.3515 | 12 | +0.032 | 0.3527 | 12 | +0.08 | 0.3528 | 10 | -0.0033 | 0.3535 | 19 | +0.0286 | 0.3537 | 17 | +0.0099 | 0.3538 | 8 | +0.2751 | 0.3538 | 8 | +0.2911 | 0.354 | 8 | +0.5151 | 0.3546 | 18 | 0.0 | 0.3553 | 18 | -0.012 | 0.356 | 18 | -0.06 | 0.3565 | 18 | -0.124 | 0.3607 | 15 | +0.0032 | 0.3612 | 4 | 0.0 | 0.3612 | 4 | -0.004 | 0.3612 | 4 | -0.06 | 0.3613 | 4 | -0.124 | 0.3617 | 4 | -0.252 | 0.3647 | 2 | +0.0065 | 0.3648 | 5 | +0.006 | 0.3653 | 5 | +0.01 | 0.3654 | 5 | +0.514 | 0.3693 | 9 | +0.0071 | 0.3698 | 16 | -0.0187 | 0.3698 | 1 | +0.1674 | 0.3698 | 11 | +0.0013 | 0.3698 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.2768 | 0.3699 | 5 | +0.2128 | 0.3701 | 9 | +0.0092 | 0.3702 | 2 | +0.0039 | 0.3702 | 8 | +0.225 | 0.3703 | 4 | -0.1512 | 0.3703 | 7 | -0.0123 | 0.3706 | 18 | -0.069 | 0.3707 | 18 | -0.071 | 0.3707 | 18 | -0.099 | 0.3707 | 16 | -0.0201 | 0.3707 | 16 | -0.0141 | 0.3721 | 13 | +0.002 | 0.3721 | 13 | +0.0024 | 0.3721 | 13 | +0.0031 | 0.3721 | 14 | +0.0019 | 0.3722 | 14 | +0.0021 | 0.3722 | 12 | +0.0308 | 0.3722 | 17 | -0.0028 | 0.3733 | 17 | -0.0108 | 0.3753 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.1872 | 0.3754 | 3 | -4.0E-4 | 0.3774 | 14 | +0.0091 | 0.3786 | 9 | +0.01 | 0.3797 | 8 | +0.219 | 0.3797 | 8 | +0.217 | 0.38 | 8 | +0.157 | 0.3819 | 15 | +0.001 | 0.3828 | 19 | +0.0098 | 0.3842 | 11 | +0.0016 | 0.3843 | 11 | +0.0018 | 0.3844 | 11 | +0.0021 | 0.3848 | 11 | +0.0027 | 0.386 | 4 | -0.1577 | 0.3861 | 13 | +0.0043 | 0.3861 | 10 | -0.0012 | 0.3862 | 16 | -0.018 | 0.3867 | 12 | +0.0335 | 0.3868 | 5 | +0.2392 | 0.3868 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.1585 | 0.387 | 10 | -0.0012 | 0.387 | 10 | -8.0E-4 | 0.3871 | 13 | +0.0053 | 0.3872 | 1 | +0.2028 | 0.3873 | 2 | +0.0111 | 0.3873 | 5 | +0.226 | 0.3874 | 5 | +0.21 | 0.3876 | 7 | -0.0124 | 0.388 | 15 | +0.0014 | 0.3883 | 9 | +0.0121 | 0.3885 | 17 | -0.0128 | 0.3885 | 17 | -0.0148 | 0.3906 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.213 | 0.3906 | 5 | +0.209 | 0.3906 | 5 | +0.201 | 0.3907 | 3 | -3.0E-4 | 0.3907 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 3 | -3.0E-4 | 0.3907 | 10 | -8.0E-4 | 0.3907 | 10 | +0.0018 | 0.3909 | 1 | +0.2069 | 0.3909 | 1 | +0.2029 | 0.3922 | 8 | +0.1622 | 0.3922 | 12 | +0.035 | 0.3923 | 13 | +0.0067 | 0.3923 | 18 | -0.1085 | 0.3924 | 5 | +0.2056 | 0.3924 | 5 | +0.2016 | 0.3925 | 5 | +0.1936 | 0.3926 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 18 | -0.1132 | 0.3928 | 18 | -0.1412 | 0.3936 | 7 | -0.0116 | 0.3938 | 5 | +0.1899 | 0.3939 | 5 | +0.1879 | 0.3939 | 5 | +0.1839 | 0.394 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.1607 | 0.3948 | 16 | -0.0122 | 0.3949 | 14 | +0.0093 | 0.3954 | 2 | +0.0128 | 0.3955 | 1 | +0.2092 | 0.3955 | 5 | +0.1838 | 0.3956 | 4 | -0.1678 | 0.3956 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 15 | +0.0016 | 0.3957 | 18 | -0.1409 | 0.3958 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #2/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | +0.0536 | 0.2742 | 13 | +0.1156 | 0.2749 | 18 | +0.0465 | 0.2749 | 18 | +0.0425 | 0.275 | 18 | +0.0345 | 0.2751 | 18 | +0.0185 | 0.2764 | 18 | -0.0135 | 0.2772 | 18 | -0.0775 | 0.2864 | 18 | -0.2055 | 0.2912 | 18 | -0.4615 | 0.2968 | 1 | +0.0361 | 0.2968 | 1 | +0.0381 | 0.2969 | 1 | +0.0421 | 0.2973 | 1 | +0.0501 | 0.3011 | 1 | +0.0981 | 0.3025 | 1 | +0.1621 | 0.3059 | 1 | +0.2901 | 0.3235 | 1 | +2.0821 | 0.3287 | 1 | +4.1301 | 0.3288 | 4 | +0.0079 | 0.3288 | 4 | +0.0099 | 0.3288 | 4 | +0.0139 | 0.3289 | 4 | +0.0219 | 0.3307 | 4 | +0.0379 | 0.3312 | 4 | +0.0699 | 0.3313 | 11 | +0.0075 | 0.3314 | 11 | +0.0135 | 0.3371 | 12 | +0.0094 | 0.3373 | 3 | +0.0054 | 0.3381 | 3 | +0.0034 | 0.339 | 16 | +0.0054 | 0.3393 | 16 | +0.0034 | 0.3393 | 16 | -6.0E-4 | 0.3398 | 16 | -0.0086 | 0.3404 | 16 | -0.0246 | 0.3415 | 16 | -0.0566 | 0.3428 | 17 | +0.0091 | 0.3429 | 2 | +0.0071 | 0.3429 | 2 | +0.0091 | 0.3433 | 2 | +0.0211 | 0.3451 | 2 | +0.0371 | 0.3453 | 2 | +0.0691 | 0.3479 | 2 | +0.1331 | 0.3481 | 10 | +0.0044 | 0.3481 | 10 | +0.0024 | 0.3488 | 14 | +0.0044 | 0.3489 | 15 | +0.0204 | 0.3495 | 7 | +0.0044 | 0.3495 | 7 | -0.0096 | 0.3496 | 7 | -0.0256 | 0.3501 | 7 | -0.0576 | 0.3506 | 7 | -0.1216 | 0.3543 | 7 | -0.2496 | 0.3549 | 9 | +0.0053 | 0.3552 | 5 | +0.0073 | 0.3552 | 5 | +0.0193 | 0.3553 | 5 | +0.0353 | 0.3561 | 8 | +0.0052 | 0.3563 | 8 | +0.0072 | 0.3565 | 8 | +0.0672 | 0.3567 | 8 | +0.1312 | 0.3575 | 8 | +0.2592 | 0.3613 | 8 | +0.5152 | 0.3628 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | +0.0071 | 0.3629 | 14 | -7.0E-4 | 0.363 | 4 | +0.0211 | 0.363 | 4 | +0.0131 | 0.3631 | 18 | -0.0411 | 0.3631 | 18 | -0.0571 | 0.3633 | 18 | -0.0891 | 0.3644 | 7 | -0.1079 | 0.3646 | 7 | -0.0919 | 0.3662 | 1 | +0.3217 | 0.3665 | 1 | +0.3277 | 0.3676 | 1 | +0.3517 | 0.368 | 12 | +0.0029 | 0.3682 | 12 | +9.0E-4 | 0.3692 | 8 | +0.3281 | 0.3692 | 5 | +1.0447 | 0.3704 | 3 | +7.0E-4 | 0.3705 | 2 | +0.0295 | 0.3705 | 2 | +0.0315 | 0.3706 | 9 | +0.0017 | 0.3706 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.0304 | 0.3707 | 8 | +0.1467 | 0.3707 | 18 | -0.0431 | 0.3708 | 13 | -0.0116 | 0.3722 | 19 | +0.0015 | 0.3724 | 19 | +0.0018 | 0.3725 | 3 | +8.0E-4 | 0.3727 | 3 | +0.001 | 0.3737 | 3 | +0.0013 | 0.3741 | 3 | +0.0019 | 0.3741 | 5 | +0.0066 | 0.3742 | 4 | +0.0117 | 0.3742 | 4 | +0.0097 | 0.3743 | 4 | +0.0057 | 0.3743 | 4 | -0.0023 | 0.3743 | 4 | -0.2423 | 0.3767 | 17 | +0.0022 | 0.3772 | 17 | +2.0E-4 | 0.3781 | 17 | -0.0038 | 0.3783 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 18 | -0.0679 | 0.3785 | 8 | +0.2466 | 0.3785 | 5 | +0.0119 | 0.3787 | 5 | +0.0179 | 0.3792 | 5 | +0.0259 | 0.3794 | 2 | +0.0512 | 0.3795 | 2 | +0.0572 | 0.3801 | 19 | +0.0019 | 0.3802 | 12 | +8.0E-4 | 0.3802 | 12 | +0.0029 | 0.3803 | 12 | +0.0052 | 0.3804 | 7 | -0.0732 | 0.3805 | 4 | -0.1916 | 0.3805 | 14 | -6.0E-4 | 0.3805 | 13 | -0.0217 | 0.3805 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 18 | -0.0673 | 0.3807 | 4 | -0.1901 | 0.3807 | 4 | -0.1841 | 0.3807 | 19 | +0.002 | 0.3807 | 2 | +0.0579 | 0.3808 | 7 | -0.0725 | 0.3808 | 13 | -0.0228 | 0.3809 | 9 | +0.0058 | 0.381 | 8 | +0.2414 | 0.381 | 5 | +0.0283 | 0.3811 | 1 | +0.2752 | 0.3811 | 12 | +0.0042 | 0.3812 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.1809 | 0.3812 | 8 | +0.2262 | 0.3815 | 8 | +0.2102 | 0.3816 | 8 | +0.1782 | 0.3822 | 18 | -0.0729 | 0.3823 | 7 | -0.078 | 0.3824 | 7 | -0.08 | 0.3824 | 5 | +0.0231 | 0.3824 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | -0.0233 | 0.3824 | 8 | +0.1919 | 0.3825 | 8 | +0.1939 | 0.3826 | 8 | +0.1979 | 0.3828 | 8 | +0.2059 | 0.3847 | 5 | +0.0259 | 0.3848 | 4 | -0.1899 | 0.3848 | 4 | -0.1839 | 0.3849 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.029 | 0.3849 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #3/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.0556 | 0.2742 | 2 | +0.0676 | 0.2743 | 2 | +0.0836 | 0.2747 | 2 | +0.1156 | 0.2756 | 2 | +0.1796 | 0.2761 | 2 | +0.3076 | 0.2767 | 2 | +0.5636 | 0.2794 | 2 | +1.0756 | 0.2818 | 8 | +0.027 | 0.2818 | 8 | +0.029 | 0.2818 | 8 | +0.033 | 0.2822 | 8 | +0.041 | 0.2824 | 8 | +0.057 | 0.2831 | 8 | +0.089 | 0.2841 | 8 | +0.153 | 0.2854 | 8 | +0.281 | 0.2902 | 8 | +0.537 | 0.2955 | 8 | +1.049 | 0.2987 | 8 | +2.073 | 0.3025 | 3 | +0.0115 | 0.3052 | 3 | +0.0155 | 0.3053 | 3 | +0.0235 | 0.3059 | 13 | +0.0114 | 0.3065 | 18 | +0.0014 | 0.3068 | 18 | -0.0066 | 0.3074 | 18 | -0.0226 | 0.3175 | 18 | -0.0546 | 0.3231 | 19 | -0.007 | 0.3243 | 17 | +0.009 | 0.3251 | 17 | +0.011 | 0.3257 | 1 | +0.009 | 0.326 | 1 | +0.071 | 0.3268 | 1 | +0.135 | 0.3344 | 1 | +0.263 | 0.3386 | 12 | +0.0074 | 0.3386 | 4 | +0.0094 | 0.3387 | 4 | +0.0214 | 0.3387 | 10 | +0.0073 | 0.3395 | 11 | +0.0213 | 0.3428 | 14 | -8.0E-4 | 0.3432 | 14 | -0.0088 | 0.3434 | 14 | -0.0248 | 0.3456 | 5 | +0.0211 | 0.3461 | 5 | +0.0691 | 0.347 | 5 | +0.5171 | 0.35 | 5 | +1.0291 | 0.3556 | 7 | +0.002 | 0.3556 | 7 | -0.004 | 0.3557 | 7 | -0.012 | 0.3558 | 9 | 0.0 | 0.3563 | 9 | -0.004 | 0.3572 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 19 | -0.0036 | 0.3574 | 18 | -0.0203 | 0.3577 | 18 | -0.0263 | 0.3581 | 18 | -0.0343 | 0.3593 | 18 | -0.0503 | 0.3606 | 4 | +0.0066 | 0.3606 | 4 | -0.1174 | 0.3616 | 4 | -0.2454 | 0.3634 | 11 | +0.0069 | 0.3644 | 13 | +0.0042 | 0.3646 | 12 | +0.0017 | 0.3646 | 10 | +0.0037 | 0.365 | 8 | +0.1864 | 0.3651 | 8 | +0.1884 | 0.3652 | 8 | +0.1924 | 0.3656 | 2 | +0.0462 | 0.3658 | 2 | +0.0402 | 0.366 | 17 | +0.0022 | 0.3668 | 17 | +2.0E-4 | 0.3673 | 17 | -0.0038 | 0.3673 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.1953 | 0.3673 | 8 | +0.1993 | 0.3675 | 13 | +0.0011 | 0.3678 | 13 | -0.0269 | 0.3706 | 7 | +0.006 | 0.3706 | 4 | -0.1903 | 0.3715 | 9 | -0.0021 | 0.3717 | 9 | -1.0E-4 | 0.3724 | 5 | +0.1317 | 0.3725 | 1 | +0.1635 | 0.373 | 12 | -0.0049 | 0.3741 | 3 | +0.0049 | 0.3826 | 2 | +0.0491 | 0.3826 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.153 | 0.3828 | 1 | +0.151 | 0.3828 | 1 | +0.147 | 0.3837 | 4 | -0.2447 | 0.3838 | 18 | -0.0502 | 0.3839 | 3 | +0.004 | 0.385 | 13 | -0.0487 | 0.3859 | 13 | -0.0647 | 0.386 | 14 | -0.0103 | 0.387 | 11 | +0.0073 | 0.3876 | 7 | +4.0E-4 | 0.3878 | 17 | -0.0036 | 0.3882 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.1419 | 0.3882 | 2 | +0.0516 | 0.3883 | 13 | -0.0564 | 0.3884 | 4 | -0.2402 | 0.3885 | 5 | +0.1585 | 0.3885 | 18 | -0.0509 | 0.3886 | 8 | +0.2477 | 0.3889 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.2405 | 0.3894 | 12 | -0.0039 | 0.3895 | 1 | +0.1459 | 0.3895 | 13 | -0.0546 | 0.3896 | 2 | +0.0536 | 0.39 | 5 | +0.1597 | 0.39 | 5 | +0.1577 | 0.3901 | 7 | +5.0E-4 | 0.3901 | 7 | +6.0E-4 | 0.3901 | 7 | +8.0E-4 | 0.3901 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 11 | +0.0066 | 0.3908 | 13 | -0.0539 | 0.3908 | 8 | +0.2448 | 0.3909 | 18 | -0.0525 | 0.3909 | 12 | -0.003 | 0.391 | 1 | +0.1456 | 0.3911 | 1 | +0.1396 | 0.3911 | 9 | +1.0E-4 | 0.3912 | 9 | +6.0E-4 | 0.3913 | 5 | +0.1523 | 0.3913 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.2469 | 0.3916 | 8 | +0.2449 | 0.3918 | 9 | +6.0E-4 | 0.3919 | 17 | -0.0048 | 0.3919 | 7 | +9.0E-4 | 0.3922 | 7 | +0.0014 | 0.3922 | 7 | +0.0033 | 0.3924 | 4 | -0.247 | 0.3926 | 5 | +0.1545 | 0.3926 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.1513 | 0.3926 | 9 | +6.0E-4 | 0.3926 | 13 | -0.0537 | 0.3927 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #4/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.0596 | 0.275 | 1 | +0.0676 | 0.2752 | 1 | +0.0836 | 0.2814 | 1 | +0.1156 | 0.2834 | 1 | +0.1796 | 0.2857 | 1 | +0.3076 | 0.298 | 1 | +0.5636 | 0.3031 | 1 | +2.0996 | 0.3073 | 1 | +4.1476 | 0.3272 | 2 | +0.0113 | 0.3272 | 13 | +0.0073 | 0.3273 | 13 | +0.0033 | 0.3273 | 13 | -0.0047 | 0.3276 | 13 | -0.0207 | 0.3289 | 13 | -0.0527 | 0.3292 | 13 | -0.1167 | 0.3311 | 13 | -0.2447 | 0.3316 | 18 | +0.0074 | 0.3316 | 18 | +0.0054 | 0.3317 | 18 | +0.0014 | 0.3329 | 18 | -0.0066 | 0.3346 | 18 | -0.0226 | 0.3356 | 18 | -0.0546 | 0.3378 | 18 | -0.1186 | 0.3494 | 18 | -0.5026 | 0.3573 | 9 | +0.0086 | 0.3577 | 9 | +0.0126 | 0.3582 | 9 | +0.0366 | 0.3589 | 6 | +0.0684 | 0.3589 | 6 | +0.1324 | 0.3589 | 15 | +0.0058 | 0.3589 | 10 | +0.0058 | 0.3592 | 10 | +0.0198 | 0.365 | 11 | +0.0057 | 0.3677 | 4 | +0.0077 | 0.3678 | 5 | +0.0057 | 0.3679 | 5 | +0.1317 | 0.3682 | 5 | +0.5157 | 0.3698 | 17 | +1.0E-4 | 0.3717 | 17 | -0.0039 | 0.373 | 17 | -0.0119 | 0.375 | 3 | +0.0021 | 0.3751 | 3 | +1.0E-4 | 0.3765 | 12 | +0.0041 | 0.3765 | 12 | +0.0061 | 0.3779 | 8 | +0.0041 | 0.3781 | 8 | +0.0061 | 0.3782 | 8 | +0.0181 | 0.3787 | 8 | +0.0341 | 0.3825 | 8 | +0.0661 | 0.384 | 7 | +0.0179 | 0.3844 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.0041 | 0.3844 | 2 | +0.0061 | 0.3845 | 17 | -0.0119 | 0.3847 | 13 | -0.0688 | 0.3847 | 3 | +1.0E-4 | 0.3847 | 18 | -0.1747 | 0.3849 | 5 | +0.3081 | 0.3849 | 4 | +0.0037 | 0.3849 | 4 | +0.0017 | 0.3852 | 4 | -0.0023 | 0.3853 | 4 | -0.0103 | 0.3854 | 4 | -0.0583 | 0.3864 | 1 | +0.2126 | 0.3866 | 1 | +0.2106 | 0.3869 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 19 | +0.0057 | 0.3871 | 8 | +0.0589 | 0.3873 | 8 | +0.0609 | 0.3875 | 8 | +0.0649 | 0.3877 | 8 | +0.1209 | 0.3894 | 4 | -0.0531 | 0.39 | 4 | -0.0551 | 0.39 | 4 | -0.0591 | 0.3902 | 4 | -0.0671 | 0.3904 | 4 | -0.1151 | 0.3912 | 5 | +0.2606 | 0.3913 | 2 | +0.0061 | 0.3914 | 7 | +0.0297 | 0.3917 | 13 | -0.0557 | 0.3917 | 13 | -0.0497 | 0.392 | 13 | -0.0417 | 0.3923 | 9 | +0.0147 | 0.3925 | 9 | +0.0127 | 0.3926 | 17 | -0.011 | 0.3927 | 1 | +0.1794 | 0.3929 | 1 | +0.1714 | 0.3936 | 3 | +1.0E-4 | 0.3936 | 3 | +1.0E-4 | 0.3937 | 3 | +2.0E-4 | 0.3938 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | -0.0581 | 0.3939 | 14 | +0.0014 | 0.3939 | 14 | -6.0E-4 | 0.3943 | 3 | +3.0E-4 | 0.3943 | 3 | +4.0E-4 | 0.3944 | 7 | +0.0328 | 0.3945 | 2 | +0.0071 | 0.3946 | 18 | -0.1434 | 0.3947 | 16 | +0.0034 | 0.3948 | 4 | -0.1073 | 0.3948 | 5 | +0.2598 | 0.3948 | 5 | +0.2298 | 0.395 | 5 | +0.1978 | 0.395 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 12 | +0.004 | 0.3951 | 1 | +0.1863 | 0.3951 | 4 | -0.1134 | 0.3951 | 11 | +0.0041 | 0.3953 | 18 | -0.1542 | 0.3955 | 5 | +0.2255 | 0.3956 | 8 | +0.1092 | 0.3957 | 7 | +0.0275 | 0.396 | 7 | +0.0035 | 0.396 | 14 | -6.0E-4 | 0.396 | 9 | +0.0108 | 0.3961 | 16 | +7.0E-4 | 0.3962 | 13 | -0.0615 | 0.3965 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 17 | -0.013 | 0.3966 | 4 | -0.1152 | 0.3966 | 4 | -0.1132 | 0.3967 | 7 | +0.0026 | 0.3982 | 7 | +6.0E-4 | 0.3984 | 18 | -0.156 | 0.3986 | 14 | -6.0E-4 | 0.3986 | 14 | -5.0E-4 | 0.3986 | 2 | +0.0049 | 0.3987 | 2 | +9.0E-4 | 0.3987 | 5 | +0.2381 | 0.3988 | 1 | +0.1959 | 0.3988 | 16 | +7.0E-4 | 0.3989 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 18 | -0.1557 | 0.3989 | 8 | +0.118 | 0.399 | 4 | -0.1151 | 0.399 | 2 | +0.001 | 0.399 | 7 | +7.0E-4 | 0.399 | 5 | +0.2209 | 0.3993 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #5/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 19 | +0.0536 | 0.2743 | 19 | +0.0556 | 0.2745 | 19 | +0.0596 | 0.2753 | 19 | +0.0676 | 0.2754 | 19 | +0.1156 | 0.2775 | 7 | +0.1125 | 0.2776 | 2 | +0.0616 | 0.2776 | 2 | +0.0776 | 0.2777 | 2 | +0.1096 | 0.2779 | 2 | +0.1736 | 0.2794 | 2 | +0.3016 | 0.2805 | 2 | +0.5576 | 0.2828 | 2 | +1.0696 | 0.2839 | 5 | +0.024 | 0.2839 | 5 | +0.03 | 0.284 | 5 | +0.038 | 0.284 | 5 | +0.054 | 0.2843 | 5 | +0.086 | 0.2846 | 5 | +0.15 | 0.2848 | 5 | +0.278 | 0.2849 | 17 | +0.0193 | 0.285 | 17 | +0.0213 | 0.2859 | 16 | +0.0173 | 0.2859 | 16 | -0.0127 | 0.2861 | 16 | -0.0447 | 0.2889 | 16 | -0.1087 | 0.2889 | 4 | +0.0198 | 0.289 | 4 | +0.0238 | 0.289 | 4 | +0.0318 | 0.2892 | 4 | +0.0798 | 0.2893 | 18 | +0.0148 | 0.2894 | 18 | +0.0128 | 0.2895 | 18 | +0.0088 | 0.2901 | 18 | -0.0152 | 0.2918 | 18 | -0.0472 | 0.2936 | 18 | -0.1112 | 0.2939 | 18 | -0.2392 | 0.2961 | 14 | +0.0439 | 0.2982 | 10 | +0.0135 | 0.2986 | 8 | +0.0135 | 0.2986 | 8 | +0.0155 | 0.2989 | 8 | +0.0755 | 0.3008 | 8 | +0.1395 | 0.3055 | 8 | +0.2675 | 0.3108 | 8 | +0.5235 | 0.3129 | 12 | +0.0093 | 0.313 | 12 | +0.0153 | 0.3148 | 12 | +0.0713 | 0.3165 | 11 | +0.0088 | 0.3172 | 11 | +0.0108 | 0.3175 | 13 | +0.0108 | 0.3175 | 1 | +0.0087 | 0.323 | 1 | +0.0107 | 0.3234 | 1 | +0.0147 | 0.3241 | 1 | +0.0227 | 0.3255 | 1 | +0.0387 | 0.3277 | 1 | +0.0707 | 0.3278 | 1 | +0.1347 | 0.343 | 1 | +0.5187 | 0.3475 | 9 | +0.0061 | 0.3475 | 9 | +0.0081 | 0.3478 | 9 | +0.0361 | 0.348 | 9 | +0.0681 | 0.3494 | 15 | +0.0018 | 0.3532 | 15 | -0.0102 | 0.3587 | 3 | +0.0038 | 0.3605 | 3 | +0.0018 | 0.3611 | 3 | -0.0022 | 0.3641 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.569 | 0.3649 | 10 | +4.0E-4 | 0.367 | 10 | -0.0036 | 0.3707 | 2 | +0.072 | 0.3709 | 2 | +0.07 | 0.3709 | 2 | +0.066 | 0.3711 | 2 | +0.058 | 0.3714 | 14 | +0.01 | 0.3714 | 14 | +0.008 | 0.3721 | 14 | +0.004 | 0.3725 | 18 | -0.0503 | 0.3731 | 18 | -0.0523 | 0.3732 | 18 | -0.0803 | 0.3738 | 9 | +0.0429 | 0.3749 | 9 | +0.0489 | 0.3752 | 12 | +0.028 | 0.3752 | 11 | +0.0073 | 0.3772 | 4 | +0.0138 | 0.3772 | 4 | -0.0482 | 0.3778 | 1 | +0.2033 | 0.3778 | 16 | -0.0169 | 0.3778 | 16 | -0.0149 | 0.3785 | 8 | +0.1256 | 0.3786 | 8 | +0.1236 | 0.3786 | 8 | +0.1116 | 0.3793 | 13 | +0.0033 | 0.3794 | 7 | +0.008 | 0.3794 | 7 | +0.01 | 0.3794 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.3478 | 0.3795 | 5 | +0.3318 | 0.3795 | 5 | +0.2998 | 0.3796 | 5 | +0.2358 | 0.3798 | 17 | +0.0011 | 0.3799 | 8 | +0.1149 | 0.38 | 14 | +0.0114 | 0.3802 | 18 | -0.0846 | 0.3803 | 19 | +0.0088 | 0.3814 | 4 | -0.0539 | 0.3815 | 4 | -0.0519 | 0.3816 | 4 | -0.0399 | 0.3819 | 16 | -0.0189 | 0.382 | 2 | +0.0508 | 0.382 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.2456 | 0.3823 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ --------------------------------- Finished sucessfully. MAP on training data: 0.3993 --------------------------------- NDCG@20 on test data: 0.3282 Model saved to: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/cv_dir/Fold7/predict.model