THIS PAGE IS NO LONGER MAINTAINED. SEE THE NEW LEGAL TRACK WEB PAGE FOR CURRENT INFORMATION

TREC 2011 Legal Track

In 2011 there is a single task, the Learning Task.

2011 Track Coordinators

TREC 2010 Legal Track

The Legal Track will continue in 2010. There are two tasks: (1) an interactive task, and (2) a learning task which a somewhat more constrained experiment design is used to explore specific system design questions. Both tasks will use a new version of the Enron email collection.

2010 Track Coordinators

TREC 2009 Legal Track

The Legal Track continued in 2009. There were two principal tasks: (1) an interactive task, using Enron emails, and (2) a batch task, in which participants could submit ad hoc or relevance feedback runs (using the IIT CDIP collection, since that's what we had relevance judgments for).

2009 Track Coordinators

TREC 2008 Legal Track

As in the second year of the track, there were be three tasks: (1) an automatic ad hoc task similar to last year, (2) an automatic "relevance feedback" task similar to last year in which some relevance judgments were available as an additional source of evidence, and (3) an interactive task.

2008 Schedule

   Jun 1	      Ad hoc and routing guidelines frozen
   Jul 1	      Ad Hoc Evaluation topic release
   Aug 5	      Ad hoc and routing runs submitted by sites
   Oct 1	      Ad hoc and routing results release
   mid-Oct	      Working notes papers due
   Nov 18-21	      TREC-2008 in Gaithersburg, MD

2008 Track Coordinators

TREC 2007 Legal Track

The legal track continued 2007. Unlike the first year, which focused on one core task, there were three tasks for the TREC-2007 Legal Track: (1) an automatic ah hoc task similar to 2006, (2) an automatic "routing" task in which 2006 relevance judgments are available as an additional source of evidence, and (3) an interactive task.

2007 Schedule

   Mar 18	      Interactive track materials ready
   May 1	      Ad hoc and routing guidelines frozen
   May 1	      Collection release with training topics
   Jul 1	      Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   early Nov	      TREC-2007, Gaithersburg, MD

2007 Track Coordinators

2006 Results

Materials from the TREC-2006 Legal Track

Track Resources

Test Collection

Over time, information about the document collection, topic development, relevance judgments, and evaluation measures will be assembled here

Background Reading

2006 Schedule

   Apr 17	      Guidelines frozen
   May 1	      Collection release with training topics
   Jul 1	      Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   Nov 14-17	      TREC-2006, Gaithersburg, MD

2006 Track Coordinators