| Home | Syllabus | Web Tools | Corpora | | Indices | Software | Conferences | Standards |

Linguistics 290A/1: Corpora

This page contains links to lists of available corpora and descriptions of individual corpus projects. Because of the nature of WWW, there is considertable overlap between some of the lists. Some of the corpora linked to here are freely available, others only for a free. An asterisk next to a corpus name indicates that we have all or part of the corpus on corpus.linguistics.berkeley.edu.

Jump to:

• Corpora on corpus.linguistics.berkeley.edu
• Lists of corpora
• Electronic text databases
• Related projects at Berkeley
• Pages for specific corpora
• Other databases

Lists of corpora

• LDC catalogue
• W3C list of corpora
• ELRA catalogue, written
• ELRA catalogue, spoken
• Tractor collection of texts
• Linguistic exploration list of resources
• ICAME International Computer Archive of Modern and Medieval English
• Prof. Matsumoto's list of language resources (This page is in Japanese and is a good resource for information on Japanese corpora.)

Electronic text databases

• Project Gutenberg
• Oxford Text Archive
• University of Virginia's Electronic Text Center
• European Manuscript Server Initiative
• UConn's list of electronic text centers
• The Internet Archive (As of 5/2001, the Internet Archive has over 43 Terabytes of data, primarily web pages.)
• For Japanese texts:
  • Aozora Bunkou
  • Fukui Daigaku
  • Konan Women's University
  • University of Virgina -- Japanese texts
  • JALLC FTP Text Archives List
  • Soka Daigaku

Related projects at Berkeley

• FrameNet
• Turkish Electronic Living Lexicon (TELL)
• Comparative Bantu OnLine Dictionary (CBOLD)

Pages for specific corpora, by language:

Multilingual

• CHILDES: Child Language Data Exchange System
• Silfide wordlists Word frequency lists for English, French and German based on the Silfide corpora.
• Silfide Texts in French, English, German, Danish, Italian, Spanish and Portuguese. Some of these texts appear to be translations, and many appear in more than one language.
• UPF corpus Texts (law, environment, medicine, economy and IT) in Catalan, Spanish, French, English and German. (Online tools and demos) (Information in English)

Modern English

• ICAME International Computer Archive of Modern and Medieval English. (Includes the Brown and LOB corpora, as well as the Frown and FLOB corpora, and many others.)
• BNC-WORLD The British National Corpus is finally available outside the UK. ... and it is indexed.
• The COBUILD Bank of English
  
• American National Corpus (The ANC is in the process of being built. This link gives information on the project.)
• Information about the Santa Barbara Corpus of Spoken American English Part I is now available from the LDC
• *ACE: Australian Corpus of English
• *CSPAE: Corpus of Spoken Professional American English
• *The Bergen Corpus of London Teenage Language (COLT)
• *LLC: London-Lund Corpus of spoken British English
• *WSC: Wellington Corpus of Spoken New Zealand English
• *WC: Wellington Corpus of Written New Zealand English
• *Kolhapur Corpus of Indian English
• *The CMU Pronouncing Dictrionary
• The Michigan Corpus of Academic Spoken English
• International Corpus of English (ICE)
  • *ICE East Africa
  • ICE Great Britain
  • ICE Hong Kong
  • ICE New Zealand
• Computational Linguistics Group, University of Wolverhampton 30,000 word corpus of English technical manuals, annotated for coreference and anaphora.

Earlier English

• The Penn-Helsinki Parsed Corpus of Middle English
• The Brooklyn-Geneva-Amsterdam-Helsinki Parsed Corpus of Old English
• *Helsinki Corpus of English (Diachronic)
• *Lampeter Corpus of Early Modern English Tracts

Catalan

• CUB: El Corpus de Català Contemporani de la Universitat de Barcelona
• Institut d'Estudis Calatans (IEC) 52 million word corpus of contemporary Catalan. (IEC also has a 21 million word PAROLE corpus.)

Czech

• Czech National Corpus

French

• ARTFL: Project for American and French Research on the Treasury of the French Language
• Frida Corpus of learner French.

Galician

• Centro Ramón Piñeiro A corpus and other resources on Galician.
• CORPORA DE LÍNGUA GALEGO-PORTUGUESA (Information about Galician and Portuguese corpora)
• Corpus de referencia do galego actual
• Corpus documentale latinum Gallaeciae

German

• COSMAS (A large, searchable corpus of German, including some diachronic and spoken collections, as well as some matched East German/West German collections. It's possible to use part of this corpus for free, in sessions that are limited to 60 minutes.)
• COSMAS wordlist 30,000 most frequent forms in the COSMAS corpus.
• Project Gutenberg included 84 German texts as of 12/5/2000.
• LAPT & DA Word and morpheme frequency lists for German, based on 7 corpora.

Hebrew

• The Corpus of Spoken Israeli Hebrew

Japanese

• EDR Electronic Dictionary of Japanese, organized into 11 sub-dictionaries.
• IPAL Information-technology Promotion Agency Lexicon of the Japanese Language. (The link given here is for a page with Japanese on top and English further down.)

Norwegian

• The English-Norwegian Parallel Corpus

Portuguese

• European Portuguese news text
• CETEMPúblico a large corpus of Portuguese newspaper language
• COMPARA Portuguese-English Parallel Translation Corpus (approx 65,000 words, web-searchable)
• CORPORA DE LÍNGUA GALEGO-PORTUGUESA (Information about Galician and Portuguese corpora)

Slovene

• The Slovene/English parallel corpus 1 million words of parallel Slovene-English / English-Slovene texts.

Russian

• Tuebinger russische Korpora Russian Corpora, searchable via the web. Currently (5/2001) consists of the Uppsala corpus and a corpus of interviews from Russian online newspapers.
• Subscribe.Ru Links to a subscription list about a collection of various dictionaries. The subscription list is searchable.
• ssu.komi.com A collection of dictionaries on all sorts of subjects. Online search of a collection of science fiction stories.
• vault.agava.ru Another collection of dictionaries (work in progress).

Serbo-Croatian

• Yugoslav Corpus ~700,000 words of modern Yugoglav fiction, representing all of the Serbo-Croatian speaking areas of the former Yugoslavia. (Archived at CRL.)

Spanish

• Corpus of Historical Spanish Texts (1200s-1900s, web-searchable)
• Parallel Text in English and Spanish Texts from the Pan American Health Organization (Archived at CRL.)

Turkish

• *Turkish NLP Initiative
• Turkish Text News feed from the Anatolian News Agency from September of 1992 plus other texts from popular sources. (Archived at CRL.)

Other Databases

• US Census list of names with frequencies.