TAC KBP Comprehensive English Source Corpora 2009-2014

Introduction

TAC KBP Comprehensive English Source Corpora 2009-2014 was developed by the Linguistic Data Consortium (LDC) and contains the 3,877,207 English source documents used in support of the TAC KBP tasks from 2009-2014.

Text Analysis Conference (TAC) is a series of workshops organized by the National Institute of Standards and Technology (NIST). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encourages the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base.

Data

The source data consists of newswire, broadcast material, and web text collected by LDC. Documents are released as a collection of zip files for overall compactness, and ease and efficiency of use. When unpacked the documents are all UTF-8 text files with a basic markup structure. Also provided are a series of lists and tables to aid in specific zip file to doc mappings and the recreation of specific test sets. See the included documentation for more information.

Acknowledgement

This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.

Samples

Please view this sample.

Updates

None at this time.

Copyright

Portions © 1994-1997, 2001-2010 Agence France Presse, © 2005 Aljazeera, © 1996-1997 American Broadcasting Company, © 1994-2010 The Associated Press, © 1994-1997 Cable News Network, LP, LLLP, © 1997-1999, 2001, 2003-2010 Central News Agency (Taiwan), © 2005 Dubai TV, © 2005-2006 National Broadcasting Company, Inc., © 1996-1997 National Cable Satellite Corporation, © 1994-1998, 2003-2009 Los Angeles Times - Washington Post News Service, Inc., © 1994-2010 New York Times, © 1996-1997 Public Radio Iternational,© 1994-1995 Reuters America, Inc., © 1996 The University of California, USC Radio and Marketplace, © 2010 The Washington Post Service with Bloomberg News, © 1995-2010 Xinhua News Agency, © 1996-1998, 2007, 2011, 2018 Trustees of the University of Pennsylvania