TRECVID 2011 - An overview of the goals, tasks, data, evaluation mechanisms, and metrics

56 pages - TRECVID workshop notebook papers/slides available at http://www-nlpir.nist.gov/projects/tvpubs/tv.pubs.org.html; International audience; The main goal of the TREC Video Retrieval Evaluation (TRECVID) is to promote progress in content-based analysis of and retrieval from digital video via open, metrics-based evaluation. TRECVID is a laboratory-style evaluation that attempts to model real world situations or significant component tasks involved in such situations. Six tasks were proposed in 2011: Semantic indexing (SIN), Known-item search (KIS), Content-based copy detection (CCD), Surveillance event detection (SED), Instance search (pilot) (INS) and Multimedia event detection (MED). 60 teams from various research organizations -- 25 from Asia, 18 from Europe, 12 from North America, 2 from South America, and 3 from Australia -- completed one or more of six proposed tasks. Further details about each particular group's approach and performance for each task can be found in that group's paper in the TRECVID publications webpage: http://www-nlpir.nist.gov/projects/tv2011/tv2011.html.