Search Engines:
11-442 / 11-642 / 11-742
 
CMU logo
 

HW5 Testing

Two web services are provided for testing your software. These services are only available to students registered for the course. Your Andrew email address is your username. Use the password service to obtain a password.

trec_eval Service:
trec_eval web service is a form-based interface to the widely-used trec_eval software for evaluating search engine accuracy.

  • Use the Browse button to select the results file on your machine.
  • Indicate whether you want summary or detailed output.
  • Use the Submit button to upload your results file.
  • Your results will be displayed a few moments later.

Your .teIn File
Type of trec_eval output Summary Detailed
Post scores to the leader board? No Yes



Curious how you compare? See the Leader Board.

Having trouble? See the Homework Testing FAQ 		  

Software Test Service:
The software test web service uploads, compiles, and tests your software.

  • Use the Browse button to select the zip file on your machine.
  • Select the tests that you want to be performed.
  • Use the Submit button to upload your zip file.
  • Your results will be displayed a few moments later.
Zip File:    

Type of Submission:
Interim:              Run the development tests selected below
Reproducibility: Check experiment reproducibility
Final:                  Submit now for a grade

Test (interim submissions only):
     Select up to 10 tests at a time
    
===> Click on this line to uncheck all tests <===

HW5-Train-0 (.param, .qry, .teIn, .teOut, .topPsg, 23.8 secs)
HW5-Train-1 (.param, .qry, .teIn, .teOut, .topPsg, 18.5 secs)
HW5-Train-2 (.param, .qry, .teIn, .teOut, .topPsg, 29.9 secs)
HW5-Train-3 (.param, .qry, .teIn, .teOut, .topPsg, 25.2 secs)
HW5-Train-4 (.param, .qry, .teIn, .teOut, .topPsg, 20.4 secs)
HW5-Train-5 (.param, .qry, .teIn, .teOut, .topPsg, 5.2 secs)
HW5-Train-6 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 15.2 secs)
HW5-Train-7 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 23.9 secs)
HW5-Train-8 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 105.4 secs)
HW5-Train-9 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 24.6 secs)
HW5-Train-10 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 28.3 secs)
HW5-Train-11 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 30.9 secs)
HW5-Train-12 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 27.8 secs)
HW5-Train-13 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 10.2 secs)
HW5-Train-14 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 24.7 secs)
HW5-Train-15 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 14.0 secs)
HW5-Train-16 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 26.1 secs)
HW5-Train-17 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 22.1 secs)
HW5-Train-18 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 47.5 secs)
HW5-Train-19 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 11.9 secs)
HW5-Train-20 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 133.5 secs)
HW5-Train-21 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 133.5 secs)
HW5-Train-22 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 133.5 secs)
HW5-Train-23 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 133.5 secs)
HW5-Train-24 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 133.5 secs)
HW5-Train-25 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 133.5 secs)

Hidden Tests:
HW5-Test-0 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 3.3 secs)
HW5-Test-1 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 4.4 secs)
HW5-Test-2 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 5.6 secs)
HW5-Test-3 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 3.3 secs)
HW5-Test-4 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 5.2 secs)
HW5-Test-5 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 6.2 secs)
HW5-Test-6 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, .inRank, 3.2 secs)
HW5-Test-7 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 4.2 secs)
HW5-Test-8 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 5.9 secs)
HW5-Test-9 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 3.4 secs)
HW5-Test-10 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 5.1 secs)
HW5-Test-11 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 6.4 secs)
HW5-Test-12 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 3.4 secs)
HW5-Test-13 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 3.7 secs)
HW5-Test-14 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 3.7 secs)
HW5-Test-15 (.param, .qry, .teIn, .teOut, .topPsg, 7.6 secs)
HW5-Test-16 (.param, .qry, .teIn, .teOut, .topPsg, 5.3 secs)
HW5-Test-17 (.param, .qry, .teIn, .teOut, .topPsg, 14.8 secs)
HW5-Test-18 (.param, .qry, .teIn, .teOut, .topPsg, 11.1 secs)
HW5-Test-19 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, .trainQry, .trainQrels, .LtrTrain, .Model, 64.4 secs)
HW5-Test-20 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, .trainQry, .trainQrels, .LtrTrain, .Model, 59.3 secs)
HW5-Test-21 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, .trainQry, .trainQrels, .LtrTrain, .Model, 60.6 secs)
HW5-Test-22 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, .trainQry, .trainQrels, .LtrTrain, .Model, 58.1 secs)
HW5-Test-23 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 4.6 secs)
HW5-Test-24 (.param, .qry, .teIn, .teOut, .topPsg, .inRank, 5.1 secs)
    
===> Click on this line to uncheck all tests <===





Having trouble? See the Homework Testing FAQ.

 

Copyright 2024, Carnegie Mellon University.
Updated on April 22, 2024

Jamie Callan