[+] General Parameters: Training data: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold3/train.txt Test data: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold3/test.txt Feature vector representation: Dense. Ranking method: Coordinate Ascent Feature description file: Unspecified. All features will be used. Train metric: map Test metric: NDCG@20 Feature normalization: No Model file: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/cv_dir/Fold3/predict.model [+] Coordinate Ascent's Parameters: No. of random restarts: 5 No. of iterations to search in each direction: 25 Tolerance: 0.001 Regularization: No Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold3/train.txt]: 0... Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold3/train.txt]... [Done.] (90 ranked lists, 8128 entries read) Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold3/test.txt]: 0... Reading feature file [/bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/kfolds/Fold3/test.txt]... [Done.] (10 ranked lists, 933 entries read) Initializing... [Done] --------------------------- Training starts... --------------------------- [+] Random restart #1/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 14 | +0.0516 | 0.2795 | 14 | +0.0496 | 0.2796 | 14 | +0.0456 | 0.2804 | 14 | +0.0376 | 0.2813 | 14 | +0.0216 | 0.2874 | 14 | -0.0104 | 0.2885 | 14 | -0.0744 | 0.2924 | 10 | +0.0825 | 0.2926 | 7 | +0.113 | 0.2927 | 17 | +0.078 | 0.2928 | 18 | +0.0446 | 0.293 | 18 | +0.0426 | 0.2931 | 18 | +0.0306 | 0.2931 | 18 | +0.0146 | 0.2936 | 18 | -0.0174 | 0.2946 | 18 | -0.2094 | 0.2951 | 18 | -0.4654 | 0.2965 | 11 | +0.0331 | 0.2967 | 11 | +0.0351 | 0.2969 | 11 | +0.0391 | 0.2971 | 11 | +0.0471 | 0.2981 | 11 | +0.0631 | 0.302 | 8 | +0.0321 | 0.302 | 8 | +0.0341 | 0.3021 | 8 | +0.0381 | 0.3021 | 8 | +0.0461 | 0.3027 | 8 | +0.0621 | 0.3033 | 8 | +0.0941 | 0.3046 | 8 | +0.1581 | 0.3068 | 8 | +0.2861 | 0.3104 | 8 | +0.5421 | 0.3122 | 8 | +1.0541 | 0.3164 | 8 | +2.0781 | 0.3183 | 8 | +4.1261 | 0.3184 | 16 | +0.0091 | 0.3185 | 16 | +0.0371 | 0.3318 | 16 | +0.0691 | 0.3367 | 15 | +0.0068 | 0.3378 | 15 | +0.0208 | 0.3384 | 12 | +0.0027 | 0.3387 | 12 | -0.0093 | 0.3392 | 13 | +0.0066 | 0.3392 | 2 | +0.0066 | 0.3393 | 2 | +0.1326 | 0.3393 | 9 | +0.006 | 0.3394 | 5 | +0.516 | 0.3493 | 1 | +0.0063 | 0.3495 | 1 | +0.0183 | 0.3518 | 19 | +0.0043 | 0.3521 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 3 | -0.0117 | 0.3522 | 9 | +0.0049 | 0.3524 | 9 | +0.0349 | 0.354 | 16 | +0.0364 | 0.3544 | 10 | +0.002 | 0.3576 | 1 | +0.0204 | 0.3581 | 1 | +0.0244 | 0.359 | 1 | +0.0324 | 0.3591 | 19 | +0.005 | 0.3596 | 19 | +0.007 | 0.36 | 18 | -0.0325 | 0.3601 | 18 | -0.0345 | 0.3612 | 18 | -0.0625 | 0.3613 | 11 | +0.0049 | 0.3618 | 11 | +0.0029 | 0.3625 | 11 | -0.0011 | 0.3656 | 12 | -0.0039 | 0.3658 | 17 | -0.002 | 0.3667 | 17 | -0.01 | 0.3703 | 13 | -0.0115 | 0.3725 | 2 | +0.0848 | 0.3733 | 2 | +0.1008 | 0.3746 | 8 | +0.3744 | 0.3746 | 8 | +0.3184 | 0.3748 | 8 | +0.2544 | 0.3749 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 14 | -0.0037 | 0.375 | 1 | +0.035 | 0.3752 | 13 | -0.0137 | 0.3754 | 13 | -0.0157 | 0.3755 | 19 | +0.0065 | 0.3755 | 12 | -0.0053 | 0.3756 | 2 | +0.1127 | 0.3756 | 7 | +0.0084 | 0.3757 | 7 | +0.0104 | 0.3766 | 17 | -0.0119 | 0.3772 | 8 | +0.2741 | 0.3772 | 8 | +0.2581 | 0.3773 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 7 | +0.0117 | 0.3773 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #2/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 19 | +0.0536 | 0.2794 | 19 | +0.0556 | 0.2796 | 19 | +0.0596 | 0.2804 | 19 | +0.0676 | 0.2804 | 19 | +0.1156 | 0.2814 | 3 | +0.0345 | 0.2814 | 3 | +0.0185 | 0.2816 | 3 | -0.0775 | 0.2818 | 2 | +0.0492 | 0.2818 | 2 | +0.0512 | 0.282 | 2 | +0.0552 | 0.282 | 2 | +0.0632 | 0.2822 | 2 | +0.0792 | 0.2827 | 2 | +0.1112 | 0.2837 | 2 | +0.1752 | 0.2852 | 2 | +0.3032 | 0.2858 | 2 | +0.5592 | 0.2865 | 2 | +1.0712 | 0.2874 | 1 | +0.0248 | 0.2874 | 1 | +0.0268 | 0.2878 | 1 | +0.0308 | 0.2889 | 1 | +0.0388 | 0.2897 | 1 | +0.0548 | 0.291 | 1 | +0.0868 | 0.2946 | 1 | +0.1508 | 0.3004 | 1 | +0.2788 | 0.319 | 1 | +1.0468 | 0.3247 | 1 | +2.0708 | 0.3333 | 7 | +0.0088 | 0.3333 | 7 | +0.0228 | 0.334 | 7 | +0.0708 | 0.3344 | 13 | +4.0E-4 | 0.3344 | 13 | -0.0076 | 0.3345 | 13 | -0.0236 | 0.335 | 14 | +0.0062 | 0.3351 | 14 | +0.0042 | 0.3357 | 14 | +2.0E-4 | 0.3364 | 14 | -0.0078 | 0.3365 | 14 | -0.0238 | 0.3413 | 14 | -0.0558 | 0.345 | 5 | +0.0139 | 0.345 | 5 | +0.0219 | 0.3454 | 5 | +0.0379 | 0.3461 | 5 | +0.0699 | 0.3469 | 5 | +0.1339 | 0.3483 | 5 | +1.0299 | 0.3512 | 8 | +0.0044 | 0.3513 | 8 | +0.0064 | 0.3525 | 8 | +0.0344 | 0.3563 | 8 | +0.0664 | 0.3586 | 18 | +0.0042 | 0.3592 | 9 | +0.0042 | 0.3597 | 9 | +0.0062 | 0.3597 | 9 | +0.0182 | 0.3611 | 12 | +0.0042 | 0.3612 | 11 | +0.0062 | 0.3618 | 11 | +0.0102 | 0.3621 | 4 | +0.0041 | 0.3622 | 4 | +0.0061 | 0.3622 | 4 | +0.0181 | 0.3623 | 17 | +0.0041 | 0.363 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 12 | -0.0109 | 0.3631 | 5 | +0.4501 | 0.3632 | 5 | +0.3941 | 0.3632 | 5 | +0.3301 | 0.3633 | 1 | +0.306 | 0.3635 | 11 | +0.0103 | 0.364 | 3 | -0.0045 | 0.3648 | 7 | +0.0308 | 0.3648 | 10 | +0.0045 | 0.3651 | 17 | +0.0036 | 0.3654 | 17 | +0.0016 | 0.366 | 17 | -0.0104 | 0.3695 | 18 | +0.0056 | 0.3695 | 4 | +0.0192 | 0.3696 | 4 | +0.0172 | 0.3696 | 4 | +0.0132 | 0.3696 | 13 | -0.0263 | 0.3697 | 8 | +0.0704 | 0.3705 | 8 | +0.0984 | 0.3707 | 9 | +0.0201 | 0.371 | 9 | +0.0221 | 0.3716 | 9 | +0.0261 | 0.372 | 16 | +0.0023 | 0.372 | 16 | +3.0E-4 | 0.3734 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | -0.026 | 0.3735 | 16 | +4.0E-4 | 0.3735 | 18 | -0.0017 | 0.3737 | 18 | -0.0097 | 0.3737 | 14 | -0.0266 | 0.3738 | 11 | +0.0087 | 0.3739 | 8 | +0.0975 | 0.3739 | 1 | +0.2902 | 0.374 | 1 | +0.2922 | 0.3744 | 7 | +0.028 | 0.3747 | 17 | -0.0068 | 0.3748 | 4 | +0.0115 | 0.3748 | 4 | +0.0095 | 0.3749 | 4 | +0.0055 | 0.375 | 4 | -0.0025 | 0.3752 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.0993 | 0.3752 | 1 | +0.2962 | 0.3753 | 1 | +0.2982 | 0.3754 | 17 | -0.0078 | 0.3754 | 13 | -0.025 | 0.3755 | 13 | -0.023 | 0.3756 | 5 | +0.3457 | 0.3756 | 2 | +0.0765 | 0.3756 | 4 | +5.0E-4 | 0.3756 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.3018 | 0.3757 | 13 | -0.0204 | 0.3757 | 7 | +0.0279 | 0.3758 | 18 | -0.0109 | 0.3758 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #3/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 12 | +0.1796 | 0.2798 | 12 | +0.3076 | 0.2845 | 19 | +0.0429 | 0.2846 | 7 | +0.0269 | 0.2846 | 7 | +0.0109 | 0.2846 | 7 | -0.0211 | 0.2846 | 7 | -0.0851 | 0.2847 | 7 | -0.2131 | 0.2848 | 7 | -0.4691 | 0.2854 | 8 | +0.0324 | 0.2855 | 8 | +0.0364 | 0.2858 | 8 | +0.0444 | 0.2859 | 8 | +0.0604 | 0.2877 | 8 | +0.0924 | 0.2899 | 8 | +0.1564 | 0.2923 | 8 | +0.2844 | 0.3021 | 8 | +0.5404 | 0.3026 | 8 | +2.0764 | 0.3074 | 5 | +0.0106 | 0.3075 | 5 | +0.0126 | 0.3075 | 5 | +0.0166 | 0.3076 | 5 | +0.0246 | 0.3077 | 5 | +0.0406 | 0.3078 | 5 | +0.5206 | 0.3182 | 18 | +0.0214 | 0.3221 | 9 | +0.0073 | 0.3221 | 9 | +0.0693 | 0.3231 | 2 | +0.0069 | 0.3231 | 2 | +0.0089 | 0.3237 | 2 | +0.0369 | 0.3284 | 15 | +0.0067 | 0.3295 | 1 | +0.0067 | 0.3295 | 1 | +0.0087 | 0.33 | 1 | +0.0127 | 0.3312 | 1 | +0.0207 | 0.3313 | 1 | +0.0367 | 0.3322 | 1 | +0.0687 | 0.3322 | 1 | +0.5167 | 0.3329 | 10 | +0.0068 | 0.3373 | 17 | +0.0048 | 0.3374 | 3 | +0.0028 | 0.3378 | 14 | +0.0108 | 0.3396 | 14 | +0.0188 | 0.3401 | 16 | +0.0047 | 0.3402 | 16 | +0.0067 | 0.3403 | 16 | +0.0107 | 0.341 | 16 | +0.0187 | 0.3417 | 11 | +0.0047 | 0.3425 | 11 | +0.0067 | 0.3432 | 13 | -0.0033 | 0.3437 | 13 | -0.0273 | 0.3452 | 13 | -0.0593 | 0.3496 | 13 | -0.1233 | 0.3525 | 4 | +0.1303 | 0.3525 | 4 | +0.2583 | 0.3525 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.1416 | 0.3527 | 5 | +0.1436 | 0.3529 | 5 | +0.6516 | 0.354 | 10 | +0.0021 | 0.3551 | 10 | -0.0039 | 0.3571 | 1 | +0.1563 | 0.3571 | 12 | +0.025 | 0.3587 | 8 | +0.1188 | 0.3587 | 8 | +0.1128 | 0.3588 | 8 | +0.1048 | 0.3589 | 17 | +0.0012 | 0.3594 | 19 | +0.0019 | 0.3595 | 19 | +0.002 | 0.3596 | 19 | +0.0024 | 0.3596 | 13 | -0.061 | 0.3596 | 2 | +0.0117 | 0.3597 | 2 | +0.0137 | 0.3597 | 2 | +0.0177 | 0.3603 | 2 | +0.0257 | 0.3605 | 2 | +0.1377 | 0.3626 | 7 | -0.01 | 0.3626 | 7 | -0.002 | 0.3629 | 7 | +0.014 | 0.364 | 18 | +0.0041 | 0.3649 | 18 | +0.0021 | 0.3651 | 18 | -0.0019 | 0.3668 | 18 | -0.0099 | 0.367 | 18 | -0.0259 | 0.3712 | 18 | -0.0579 | 0.3748 | 18 | -0.1219 | 0.3769 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 7 | +0.0115 | 0.377 | 7 | +0.0095 | 0.3771 | 7 | +0.0055 | 0.3775 | 18 | -0.1089 | 0.3776 | 18 | -0.1029 | 0.3781 | 18 | -0.0949 | 0.3783 | 15 | +0.0017 | 0.3787 | 4 | +0.1035 | 0.3788 | 4 | +0.0955 | 0.3788 | 4 | +0.0795 | 0.3789 | 4 | +0.0475 | 0.3789 | 4 | -0.0165 | 0.379 | 5 | +0.2592 | 0.3791 | 13 | -0.0617 | 0.3792 | 9 | +0.0205 | 0.3792 | 16 | +0.0019 | 0.3794 | 1 | +0.1626 | 0.3795 | 1 | +0.1646 | 0.3796 | 1 | +0.1686 | 0.3796 | 17 | +0.0031 | 0.3797 | 3 | +0.0014 | 0.3797 | 12 | +0.0267 | 0.3798 | 8 | +0.172 | 0.3799 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.1608 | 0.3799 | 8 | +0.1588 | 0.38 | 1 | +0.1565 | 0.38 | 7 | +0.0057 | 0.3801 | 7 | +0.0037 | 0.3801 | 7 | -3.0E-4 | 0.3803 | 13 | -0.0595 | 0.3804 | 13 | -0.0735 | 0.3807 | 9 | +0.0201 | 0.3809 | 4 | -0.0205 | 0.3809 | 4 | -0.0225 | 0.3809 | 4 | -0.0265 | 0.381 | 4 | -0.0825 | 0.3817 | 11 | +0.0038 | 0.3824 | 14 | +0.0087 | 0.3824 | 16 | +0.0121 | 0.3825 | 5 | +0.2644 | 0.3826 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | -0.0677 | 0.3827 | 13 | -0.0697 | 0.383 | 13 | -0.0817 | 0.3837 | 7 | +0.0012 | 0.3838 | 15 | +0.0019 | 0.3839 | 5 | +0.1954 | 0.3842 | 14 | +0.01 | 0.3842 | 2 | +0.1251 | 0.3842 | 2 | +0.1211 | 0.3844 | 2 | +0.0971 | 0.3852 | 16 | +0.0139 | 0.3853 | 4 | -0.0793 | 0.3853 | 1 | +0.1544 | 0.3853 | 1 | +0.1524 | 0.3858 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 9 | +0.0212 | 0.3861 | 1 | +0.1497 | 0.3862 | 4 | -0.0809 | 0.3862 | 4 | -0.0829 | 0.3862 | 8 | +0.1594 | 0.3862 | 5 | +0.2126 | 0.3862 | 7 | +0.0016 | 0.3862 | 18 | -0.1152 | 0.3862 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 12 | +0.024 | 0.3862 | 8 | +0.1607 | 0.3862 | 4 | -0.0858 | 0.3863 | 4 | -0.1458 | 0.3863 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.1441 | 0.3864 | 8 | +0.151 | 0.3864 | 5 | +0.1838 | 0.3866 | 5 | +0.1358 | 0.3869 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 13 | -0.0856 | 0.3871 | 5 | +0.1523 | 0.3872 | 1 | +0.1476 | 0.3874 | 8 | +0.1595 | 0.3874 | 7 | +0.0018 | 0.3874 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.1506 | 0.3874 | 12 | +0.0249 | 0.3876 | 1 | +0.1468 | 0.3876 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.1497 | 0.3876 | 5 | +0.1357 | 0.3877 | 7 | +0.0032 | 0.3878 | 4 | -0.1535 | 0.3878 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.1347 | 0.388 | 7 | -0.0038 | 0.3883 | 7 | -0.0118 | 0.3904 | 9 | +0.0203 | 0.3919 | 8 | +0.1604 | 0.392 | 8 | +0.1584 | 0.392 | 1 | +0.1499 | 0.3923 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.1597 | 0.3924 | 2 | +0.1023 | 0.3926 | 2 | +0.1043 | 0.3926 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.103 | 0.3926 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #4/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 12 | +0.1796 | 0.2798 | 12 | +0.3076 | 0.2845 | 4 | +0.0449 | 0.2845 | 4 | +0.0489 | 0.2846 | 4 | +0.0569 | 0.2846 | 4 | +0.0729 | 0.2847 | 4 | +0.1049 | 0.2851 | 4 | +0.1689 | 0.2854 | 4 | +0.5529 | 0.2856 | 9 | +0.0288 | 0.2857 | 3 | +0.0287 | 0.2858 | 3 | +0.0427 | 0.2859 | 19 | +0.0263 | 0.2907 | 10 | +0.0283 | 0.2911 | 13 | +0.0283 | 0.2911 | 13 | +0.0303 | 0.2912 | 16 | +0.0282 | 0.2913 | 17 | -0.0358 | 0.2913 | 17 | -0.0998 | 0.2982 | 5 | +0.0324 | 0.2983 | 5 | +0.0404 | 0.2985 | 7 | -0.102 | 0.3005 | 7 | -0.23 | 0.301 | 7 | -0.486 | 0.3039 | 8 | +0.0181 | 0.3041 | 8 | +0.0201 | 0.3045 | 8 | +0.0241 | 0.3048 | 8 | +0.1441 | 0.3106 | 8 | +0.2721 | 0.3156 | 8 | +0.5281 | 0.3215 | 14 | +0.0103 | 0.3218 | 14 | +0.0083 | 0.3232 | 18 | +0.0104 | 0.3233 | 18 | +0.0084 | 0.3233 | 18 | -0.0516 | 0.3274 | 18 | -0.1156 | 0.3324 | 2 | +0.0113 | 0.3324 | 2 | +0.0173 | 0.3326 | 2 | +0.0253 | 0.3328 | 2 | +0.0413 | 0.3331 | 2 | +0.0733 | 0.3332 | 2 | +0.2653 | 0.3347 | 1 | +0.0092 | 0.3352 | 1 | +0.0112 | 0.3371 | 1 | +0.0152 | 0.338 | 1 | +0.0232 | 0.341 | 1 | +0.0392 | 0.3444 | 1 | +0.0712 | 0.3474 | 1 | +0.1352 | 0.3481 | 1 | +0.2632 | 0.3573 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 10 | +0.0078 | 0.3576 | 5 | +0.0114 | 0.3577 | 5 | +0.0734 | 0.3588 | 5 | +0.5214 | 0.361 | 3 | +0.0057 | 0.3621 | 15 | +0.0033 | 0.3623 | 18 | -0.045 | 0.3625 | 18 | -0.047 | 0.3627 | 18 | -0.051 | 0.3632 | 18 | -0.059 | 0.3642 | 18 | -0.075 | 0.3646 | 18 | -0.107 | 0.368 | 18 | -0.171 | 0.3693 | 13 | +0.0053 | 0.3702 | 17 | -0.0171 | 0.3708 | 17 | -0.0211 | 0.3709 | 8 | +0.1245 | 0.3714 | 9 | +0.0049 | 0.3716 | 9 | +0.0069 | 0.372 | 9 | +0.0109 | 0.3735 | 12 | +0.0249 | 0.3741 | 12 | +0.0289 | 0.375 | 4 | +0.0462 | 0.3751 | 4 | +0.0422 | 0.3751 | 4 | +0.0342 | 0.3752 | 4 | +0.0182 | 0.3753 | 7 | -0.0718 | 0.3755 | 1 | +0.127 | 0.3758 | 1 | +0.131 | 0.3762 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.1244 | 0.3762 | 2 | +0.098 | 0.3762 | 17 | -0.0201 | 0.3764 | 4 | +0.0177 | 0.3764 | 4 | +0.0037 | 0.3764 | 4 | -0.1083 | 0.3787 | 12 | +0.0282 | 0.3787 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.1023 | 0.379 | 5 | +0.2179 | 0.379 | 5 | +0.1539 | 0.3792 | 2 | +0.1018 | 0.3793 | 2 | +0.0958 | 0.3795 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.1625 | 0.3795 | 5 | +0.1465 | 0.3797 | 19 | +0.003 | 0.3799 | 7 | -0.0772 | 0.38 | 7 | -0.0752 | 0.3802 | 13 | -0.0092 | 0.3802 | 14 | +0.0101 | 0.3817 | 18 | -0.1674 | 0.3817 | 10 | +0.0059 | 0.3823 | 8 | +0.1353 | 0.3823 | 8 | +0.1373 | 0.3823 | 8 | +0.1413 | 0.3824 | 12 | +0.0259 | 0.3825 | 2 | +0.0975 | 0.3825 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.1233 | 0.3825 | 8 | +0.1421 | 0.3826 | 18 | -0.1652 | 0.3826 | 18 | -0.1632 | 0.3827 | 13 | -0.0101 | 0.3828 | 13 | -0.0121 | 0.3828 | 1 | +0.1391 | 0.3829 | 12 | +0.025 | 0.3829 | 7 | -0.0732 | 0.3831 | 7 | -0.0712 | 0.3834 | 5 | +0.147 | 0.3834 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 17 | -0.0208 | 0.3836 | 1 | +0.1413 | 0.3837 | 5 | +0.1484 | 0.3837 | 8 | +0.1459 | 0.3842 | 4 | -0.1243 | 0.3843 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.1271 | 0.3843 | 5 | +0.1442 | 0.3843 | 8 | +0.1443 | 0.3843 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 5 | +0.0818 | 0.3846 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.1511 | 0.3846 | 13 | -0.0139 | 0.3847 | 13 | -0.0159 | 0.3848 | 5 | +0.0859 | 0.3848 | 5 | +0.0839 | 0.3849 | 5 | +0.0559 | 0.3849 | 11 | +0.0035 | 0.3851 | 18 | -0.1789 | 0.3853 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.1043 | 0.3856 | 12 | +0.0286 | 0.3857 | 1 | +0.1549 | 0.3858 | 8 | +0.1603 | 0.3858 | 8 | +0.1623 | 0.3858 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.1053 | 0.3858 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 1 | +0.1555 | 0.3858 | 2 | +0.1021 | 0.3859 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 16 | +0.0057 | 0.3859 | 12 | +0.0275 | 0.3859 | 8 | +0.163 | 0.3859 | 8 | +0.165 | 0.3859 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ [+] Random restart #5/5... Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 19 | +0.0536 | 0.2794 | 19 | +0.0556 | 0.2796 | 19 | +0.0596 | 0.2804 | 19 | +0.0676 | 0.2804 | 19 | +0.1156 | 0.2814 | 1 | +0.0645 | 0.2816 | 1 | +0.0805 | 0.2875 | 1 | +0.1125 | 0.29 | 1 | +0.1765 | 0.2921 | 1 | +0.5605 | 0.3016 | 1 | +2.0965 | 0.3044 | 1 | +4.1445 | 0.3222 | 6 | +0.0247 | 0.3223 | 6 | +0.1367 | 0.3223 | 16 | +0.0076 | 0.3226 | 16 | +0.0056 | 0.3228 | 16 | +0.0016 | 0.3233 | 16 | -0.0064 | 0.3238 | 16 | -0.0224 | 0.3241 | 16 | -0.1184 | 0.3272 | 15 | +0.0068 | 0.3273 | 14 | +0.0068 | 0.3275 | 13 | +0.0228 | 0.3275 | 3 | +0.0067 | 0.3275 | 3 | +0.0047 | 0.3294 | 7 | +0.0087 | 0.3295 | 2 | +0.0087 | 0.3295 | 2 | +0.0107 | 0.3297 | 2 | +0.0707 | 0.3314 | 2 | +0.1347 | 0.3354 | 4 | +0.0378 | 0.3376 | 4 | +0.1338 | 0.3418 | 5 | +0.0071 | 0.3418 | 5 | +0.0091 | 0.3419 | 5 | +0.0131 | 0.3422 | 5 | +1.0291 | 0.3462 | 8 | +0.004 | 0.3466 | 8 | +0.006 | 0.3468 | 8 | +0.01 | 0.348 | 8 | +0.018 | 0.3505 | 8 | +0.034 | 0.3524 | 17 | +0.0019 | 0.3525 | 17 | -1.0E-4 | 0.3534 | 17 | -0.0041 | 0.3557 | 17 | -0.0121 | 0.3573 | 17 | -0.0281 | 0.3585 | 18 | +0.0038 | 0.3585 | 9 | +0.0038 | 0.359 | 9 | +0.0058 | 0.359 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 16 | -0.0357 | 0.3595 | 7 | -0.0038 | 0.3598 | 13 | +0.0093 | 0.3598 | 14 | +0.0035 | 0.3601 | 11 | +0.0038 | 0.3624 | 11 | +0.0058 | 0.3637 | 2 | +0.0503 | 0.3637 | 2 | +0.0523 | 0.3637 | 2 | +0.0563 | 0.364 | 2 | +0.0803 | 0.3643 | 12 | +0.0017 | 0.3643 | 12 | -0.0123 | 0.3666 | 9 | +0.0206 | 0.3666 | 18 | +0.0026 | 0.3667 | 18 | -0.0034 | 0.3681 | 1 | +0.2238 | 0.3683 | 1 | +0.2258 | 0.3683 | 1 | +0.2538 | 0.3685 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 8 | +0.0323 | 0.3685 | 3 | +0.0016 | 0.3687 | 18 | -0.0043 | 0.3688 | 18 | -0.0063 | 0.3689 | 2 | +0.1043 | 0.3697 | 5 | +0.2962 | 0.37 | 13 | +0.0104 | 0.3701 | 7 | -0.0048 | 0.3702 | 7 | -0.0108 | 0.3705 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 4 | -0.0075 | 0.3715 | 5 | +0.3226 | 0.3715 | 5 | +0.2906 | 0.373 | 2 | +0.1218 | 0.3731 | 8 | +0.043 | 0.3733 | 18 | -0.0388 | 0.3736 | 19 | +0.0078 | 0.3738 | 17 | -0.0289 | 0.3739 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 2 | +0.1216 | 0.374 | 9 | +0.0244 | 0.3741 | 18 | -0.0445 | 0.3743 | 4 | -0.0071 | 0.3743 | 5 | +0.2921 | 0.3743 | 10 | +0.0041 | 0.3747 | 12 | -0.0148 | 0.375 | 13 | +0.0122 | 0.375 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 7 | -0.0127 | 0.3751 | 8 | +0.0443 | 0.3752 | 4 | -0.0081 | 0.3753 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ 7 | -0.0056 | 0.3753 | ------------------------------ Shuffling features' order... [Done.] Optimizing weight vector... ------------------------------ Feature | weight | MAP | ------------------------------ ------------------------------ --------------------------------- Finished sucessfully. MAP on training data: 0.3926 --------------------------------- NDCG@20 on test data: 0.4722 Model saved to: /bos/usr0/cx/tmp/knowledge4ir/cv/coorascent/cw12_lm_ir_everything.coorascent/cv_dir/Fold3/predict.model