TREC 2008 Legal Track

The legal track will continue in 2008. As in the second year of the track, there will be three tasks: (1) an automatic ad hoc task similar to last year, (2) an automatic "relevance feedback" task similar to last year in which some relevance judgments are available as an additional source of evidence, and (3) an interactive task.

Tentative 2008 Schedule

   May 15	      Ad hoc and routing guidelines frozen
   Jul 1	      Ad Hoc Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   early Nov	      TREC-2007, Gaithersburg, MD

2008 Track Coordinators

TREC 2007 Legal Track

The legal track continued 2007. Unlike the first year, which focused on one core task, there were three tasks for the TREC-2007 Legal Track: (1) an automatic ah hoc task similar to 2006, (2) an automatic "routing" task in which 2006 relevance judgments are available as an additional source of evidence, and (3) an interactive task.

2007 Schedule

   Mar 18	      Interactive track materials ready
   May 1	      Ad hoc and routing guidelines frozen
   May 1	      Collection release with training topics
   Jul 1	      Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   early Nov	      TREC-2007, Gaithersburg, MD

2007 Track Coordinators

2006 Results

Materials from the TREC-2006 Legal Track

Track Resources

Test Collection

Over time, information about the document collection, topic development, relevance judgments, and evaluation measures will be assembled here

Background Reading

2006 Schedule

   Apr 17	      Guidelines frozen
   May 1	      Collection release with training topics
   Jul 1	      Evaluation topic release
   Aug 1	      Runs submitted by sites
   Oct 1	      Results release
   mid-Oct	      Working notes papers due
   Nov 14-17	      TREC-2006, Gaithersburg, MD

2006 Track Coordinators

Last update: May 17, 2007