TREC 2009 Legal Track

The Legal Track will continue in 2009. There will be two principal tasks: (1) an interactive task, most likely using Enron emails, and (2) a batch task, in which participants may submit ad hoc or relevance feedback runs (almost certain to use the IIT CDIP collection, since that's what we have relevance judgments for). Initial guidelines are expected to be distributed for comment on the mailing list in April, 2009 and to be posted here in final form in May, 2009.

2009 Track Coordinators

TREC 2008 Legal Track

As in the second year of the track, there were be three tasks: (1) an automatic ad hoc task similar to last year, (2) an automatic "relevance feedback" task similar to last year in which some relevance judgments were available as an additional source of evidence, and (3) an interactive task.

2008 Schedule

   Jun 1	      Ad hoc and routing guidelines frozen
   Jul 1	      Ad Hoc Evaluation topic release
   Aug 5	      Ad hoc and routing runs submitted by sites
   Oct 1	      Ad hoc and routing results release
   mid-Oct	      Working notes papers due
   Nov 18-21	      TREC-2008 in Gaithersburg, MD

2008 Track Coordinators

TREC 2007 Legal Track

The legal track continued 2007. Unlike the first year, which focused on one core task, there were three tasks for the TREC-2007 Legal Track: (1) an automatic ah hoc task similar to 2006, (2) an automatic "routing" task in which 2006 relevance judgments are available as an additional source of evidence, and (3) an interactive task.

2007 Schedule

   Mar 18	      Interactive track materials ready
   May 1	      Ad hoc and routing guidelines frozen
   May 1	      Collection release with training topics
   Jul 1	      Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   early Nov	      TREC-2007, Gaithersburg, MD

2007 Track Coordinators

2006 Results

Materials from the TREC-2006 Legal Track

Track Resources

Test Collection

Over time, information about the document collection, topic development, relevance judgments, and evaluation measures will be assembled here

Background Reading

2006 Schedule

   Apr 17	      Guidelines frozen
   May 1	      Collection release with training topics
   Jul 1	      Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   Nov 14-17	      TREC-2006, Gaithersburg, MD

2006 Track Coordinators