TREC 2010 Legal Track Learning Task Results and Toolkit

Name	Last Modified (UTC)	Size	Description
dolegal10eval	2011-01-19 16:51:49	1K	Bash shell script that calculates system effectiveness metrics for TREC 2010 and TREC 2011 Legal Learning systems
calc1.c	2011-01-19 16:50:31	2K	C program used in dolegal10eval
calc2.c	2011-01-19 16:50:31	2K	C program used in dolegal10eval
qrels.t10legallearn.gz	2011-01-19 16:50:00	97M	Official qrels for the TREC 2010 Legal Learning task
qrels.t11legallearn.gz	2011-10-16 13:16:23	36M	Official qrels for the TREC 2011 Legal Learning task
t10legallearn-results.zip	2011-01-19 17:22:40	62K	Official results for TREC 2010 Legal Learning participant systems

uncompress the qrels file:

       gunzip qrels.t10legallearn.gz

on a *nix system, type:
```
       ./dolegal10 qrels.t10legallearn RUNNAME
     
```
where qrels.t10legallearn is the uncompressed version of the relevance assessments and RUNNAME is a learning task run, in the format given in the guidelines
the result will be a RUNNAME.sum and RUNNAME.table files
You may use Linux or MacOS or Cygwin on Windows to run the toolkit. It has been tested on Fedora and Ubuntu Linux.