Homework 2 Testing

Search Engines:
11-442 / 11-642 / 11-742

HW2 Testing

Two web services are provided for testing your software. These services are only available to students registered for the course. Your Andrew email address is your username. Use the password service to obtain a password.

trec_eval Service:
trec_eval web service is a form-based interface to the widely-used trec_eval software for evaluating search engine accuracy.

Use the Browse button to select the results file on your machine.
Indicate whether you want summary or detailed output.
Use the Submit button to upload your results file.
Your results will be displayed a few moments later.

Curious how you compare? See the Leader Board.

Having trouble? See the Homework Testing FAQ

Software Test Service:
The software test web service uploads, compiles, and tests your software.

Use the Browse button to select the zip file on your machine.
Select the tests that you want to be performed.
Use the Submit button to upload your zip file.
Your results will be displayed a few moments later.

Zip File:

Type of Submission:
Interim:              Run the development tests selected below
Reproducibility: Check experiment reproducibility
Final:                  Submit now for a grade

Test (interim submissions only):
     Select up to 10 tests at a time

===> Click on this line to uncheck all tests <===

Train 0 (query, .param, trec_eval input, 13.1s)
Train 1 (query, .param, trec_eval input, 12.1s)
Train 2 (query, .param, trec_eval input, 8.0s)
Train 3 (query, .param, trec_eval input, 7.2s)
Train 4 (query, .param, trec_eval input, 16.9s)
Train 5 (query, .param, trec_eval input, 15.6s)
Train 6 (query, .param, trec_eval input, 17.8s)
Train 7 (query, .param, trec_eval input, 15.9s)
Train 8 (query, .param, trec_eval input, 19.3s)
Train 9 (query, .param, trec_eval input, 18.1s)
Train 10 (query, .param, trec_eval input, 6.2s)
Train 11 (query, .param, trec_eval input, 5.3s)
Train 12 (query, .param, trec_eval input, 19.3s)
Train 13 (query, .param, trec_eval input, 17.6s)
Train 14 (query, .param, trec_eval input, 12.5s)
Train 15 (query, .param, trec_eval input, 23.7s)
Train 16 (query, .param, trec_eval input, 9.2s)
Train 17 (query, .param, trec_eval input, 21.4s)
Train 18 (query, .param, trec_eval input, 8.2s)
Train 19 (query, .param, trec_eval input, 8.0s)
Train 20 (query, .param, trec_eval input, 13.5s)
Train 21 (query, .param, trec_eval input, 50.6s)
Train 22 (query, .param, trec_eval input, 40.8s)
Train 23 (query, .param, trec_eval input, 18.3s)
Train 24 (query, .param, trec_eval input, 39.4s)
Train 25 (query, .param, trec_eval input, 16.1s)
Train 26 (query, .param, trec_eval input, 15.5s)
Train 27 (query, .param, trec_eval input, 36.3s)
Train 28 (query, .param, trec_eval input, 16.3s)
Train 29 (query, .param, trec_eval input, 13.0s)
Train 30 (query, .param, trec_eval input, 12.6s)
Train 31 (query, .param, trec_eval input, 8.4s)
Train 32 (query, .param, trec_eval input, 7.7s)
Train 33 (query, .param, trec_eval input, 18.4s)
Train 34 (query, .param, trec_eval input, 16.1s)
Train 35 (query, .param, trec_eval input, 17.1s)
Train 36 (query, .param, trec_eval input, 16.1s)
Train 37 (query, .param, trec_eval input, 18.8s)
Train 38 (query, .param, trec_eval input, 16.4s)
Train 39 (query, .param, trec_eval input, 5.5s)
Train 40 (query, .param, trec_eval input, 5.7s)
Train 41 (query, .param, trec_eval input, 5.6s)
Train 42 (query, .param, trec_eval input, 5.6s)
Train 43 (query, .param, trec_eval input, 13.4s)
Train 44 (query, .param, trec_eval input, 12.0s)
Train 45 (query, .param, trec_eval input, 8.1s)
Train 46 (query, .param, trec_eval input, 7.6s)
Train 47 (query, .param, trec_eval input, 18.1s)
Train 48 (query, .param, trec_eval input, 17.0s)
Train 49 (query, .param, trec_eval input, 17.5s)
Train 50 (query, .param, trec_eval input, 16.5s)

Hidden Tests:
Test 0 (query, .param, .teIn, .teOut, 11.2s)
Test 1 (query, .param, .teIn, .teOut, 5.0s)
Test 2 (query, .param, .teIn, .teOut, 9.0s)
Test 3 (query, .param, .teIn, .teOut, 6.2s)
Test 4 (query, .param, .teIn, .teOut, 8.3s)
Test 5 (query, .param, .teIn, .teOut, 2.9s)
Test 6 (query, .param, .teIn, .teOut, 4.0s)
Test 7 (query, .param, .teIn, .teOut, 6.6s)
Test 8 (query, .param, .teIn, .teOut, 2.5s)
Test 9 (query, .param, .teIn, .teOut, 3.3s)
Test 10 (query, .param, .teIn, .teOut, 4.9s)
Test 11 (query, .param, .teIn, .teOut, 4.3s)
Test 12 (query, .param, .teIn, .teOut, 4.2s)
Test 13 (query, .param, .teIn, .teOut, 2.4s)
Test 14 (query, .param, .teIn, .teOut, 5.1s)
Test 15 (query, .param, .teIn, .teOut, 6.1s)
Test 16 (query, .param, .teIn, .teOut, 5.6s)
Test 17 (query, .param, .teIn, .teOut, 5.5s)
Test 18 (query, .param, .teIn, .teOut, 5.6s)
Test 19 (query, .param, .teIn, .teOut, 74.4s)
Test 20 (query, .param, .teIn, .teOut, 6.5s)
Test 21 (query, .param, .teIn, .teOut, 20.6s)
Test 22 (query, .param, .teIn, .teOut, 4.6s)
Test 23 (query, .param, .teIn, .teOut, 18.3s)
Test 24 (query, .param, .teIn, .teOut, 3.5s)

===> Click on this line to uncheck all tests <===

Having trouble? See the Homework Testing FAQ.

Jamie Callan