Homework 1 Testing

Search Engines:
11-442 / 11-642

HW1 Testing

Two web services are provided for testing your software. These services are only available to students registered for the course. Your Andrew id is your username. Use the password service to obtain a password.

trec_eval Service:
The trec_eval web service is a form-based interface to the widely-used trec_eval software for evaluating relevance-based search rankings.

Use the Browse button to select the results file on your machine.
Indicate whether you want summary or detailed output.
Use the Submit button to upload your results file.
Your results will be displayed a few moments later.

Curious how you compare? See the Leader Board.

Having trouble? See the Homework Testing FAQ

Software Test Service:
The software test web service uploads, compiles, and tests your software.

Use the Browse button to select the zip file on your machine.
Select the tests that you want to be performed.
Use the Submit button to upload your zip file.
Your results will be displayed a few moments later.

Zip File:

Type of Submission:
Interim:              Run the development tests selected below
Reproducibility: Check experiment reproducibility
Final:                  Submit now for a grade

Test (interim submissions only):
     Select up to 10 tests at a time

===> Click on this line to uncheck all tests <===

Train 0 (.qry, .param, .teIn, .teOut, 3.2s)
Train 1 (.qry, .param, .teIn, .teOut, 3.2s)
Train 2 (.qry, .param, .teIn, .teOut, 3.1s)
Train 3 (.qry, .param, .teIn, .teOut, 3.2s)
Train 4 (.qry, .param, .teIn, .teOut, 2.9s)
Train 5 (.qry, .param, .teIn, .teOut, 3.7s)
Train 6 (.qry, .param, .teIn, .teOut, 3.3s)
Train 7 (.qry, .param, .teIn, .teOut, 5.9s)
Train 8 (.qry, .param, .teIn, .teOut, 2.4s)
Train 9 (.qry, .param, .teIn, .teOut, 2.4s)
Train 10 (.qry, .param, .teIn, .teOut, 2.2s)
Train 11 (.qry, .param, .teIn, .teOut, 4.7s)
Train 12 (.qry, .param, .teIn, .teOut, 4.6s)
Train 13 (.qry, .param, .teIn, .teOut, 5.2s)
Train 14 (.qry, .param, .teIn, .teOut, 30.1s)
Train 15 (.qry, .param, .teIn, .teOut, 5.8s)
Train 16 (.qry, .param, .teIn, .teOut, 5.7s)
Train 17 (.qry, .param, .teIn, .teOut, 15.4s)
Train 18 (.qry, .param, .teIn, .teOut, 4.9s)
Train 19 (.qry, .param, .teIn, .teOut, 4.8s)
Train 20 (.qry, .param, .teIn, .teOut, 5.1s)
Train 21 (.qry, .param, .teIn, .teOut, 3.5s)
Train 22 (.qry, .param, .teIn, .teOut, 3.4s)
Train 23 (.qry, .param, .teIn, .teOut, 3.1s)
Train 24 (.qry, .param, .teIn, .teOut, 5.4s)
Train 25 (.qry, .param, .teIn, .teOut, 5.2s)
Train 26 (.qry, .param, .teIn, .teOut, 5.1s)
Train 27 (.qry, .param, .teIn, .teOut, 13.4s)
Train 28 (.qry, .param, .teIn, .teOut, 8.6s)
Train 29 (.qry, .param, .teIn, .teOut, 39.5s)
Train 30 (.qry, .param, .teIn, .teOut, 2.8s)
Train 31 (.qry, .param, .teIn, .teOut, 2.9s)
Train 32 (.qry, .param, .teIn, .teOut, 4.7s)
Train 33 (.qry, .param, .teIn, .teOut, 4.7s)
Train 34 (.qry, .param, .teIn, .teOut, 4.5s)
Train 35 (.qry, .param, .teIn, .teOut, 10.1s)
Train 36 (.qry, .param, .teIn, .teOut, 9.7s)
Train 37 (.qry, .param, .teIn, .teOut, 8.5s)
Train 38 (.qry, .param, .teIn, .teOut, 9.5s)
Train 39 (.qry, .param, .teIn, .teOut, 19.3s)

Hidden Tests:
Test 0 (.qry, .param, .teIn, .teOut, 5.1s)
Test 1 (.qry, .param, .teIn, .teOut, 1.6s)
Test 2 (.qry, .param, .teIn, .teOut, 9.2s)
Test 3 (.qry, .param, .teIn, .teOut, 9.2s)
Test 4 (.qry, .param, .teIn, .teOut, 24.7s)
Test 5 (.qry, .param, .teIn, .teOut, 1.7s)
Test 6 (.qry, .param, .teIn, .teOut, 1.1s)
Test 7 (.qry, .param, .teIn, .teOut, 12.4s)
Test 8 (.qry, .param, .teIn, .teOut, 4.5s)
Test 9 (.qry, .param, .teIn, .teOut, 3.6s)
Test 10 (.qry, .param, .teIn, .teOut, 3.3s)
Test 11 (.qry, .param, .teIn, .teOut, 5.4s)
Test 12 (.qry, .param, .teIn, .teOut, 3.7s)
Test 13 (.qry, .param, .teIn, .teOut, 1.4s)
Test 14 (.qry, .param, .teIn, .teOut, 2.2s)
Test 15 (.qry, .param, .teIn, .teOut, 1.5s)
Test 16 (.qry, .param, .teIn, .teOut, 4.8s)
Test 17 (.qry, .param, .teIn, .teOut, 6.2s)
Test 18 (.qry, .param, .teIn, .teOut, 11.9s)
Test 19 (.qry, .param, .teIn, .teOut, 3.3s)
Test 20 (.qry, .param, .teIn, .teOut, 3.6s)
Test 21 (.qry, .param, .teIn, .teOut, 2.1s)
Test 22 (.qry, .param, .teIn, .teOut, 3.1s)
Test 23 (.qry, .param, .teIn, .teOut, 9.1s)
Test 24 (.qry, .param, .teIn, .teOut, 2.2s)

===> Click on this line to uncheck all tests <===

Having trouble? See the testing FAQ.

Jamie Callan