Multilingual News Corpus

Stats

• Language: English, German
• 420284 Articles
• 11 classes
• Rich meta information available for the articles

Download

1. Get Access to the Corpus

Since the news articles themselfes are copyrighted to the original publisher, access to this corpus can't be made public. If you want access, drop a short Email to griesshaber@hdm-stuttgart.de.

2. I already have access

Download the newest release here

Classes

The corpus is split into the following classes:

Label	Documents (EN)	Documents (DE)
Politik	9810	72843
Lifestyle	14906	19492
Sonstiges	26338	55243
Sport	3943	24861
Technologie	3576	28056
Kultur	1881	11891
Ignore	488	3650
Ausland	18078	27405
Lokal	2855	18947
Wirtschaft	3153	55481
Finanzen	182	13339
Aktuell	2506	1360
Total	87716	332568

Metainformation

The corpus was build by crawling german and english news sites. To extract the information unfluff was used. Therefore all metainformation is available as it is extracted by unfluff.

• rssTitle: String
• source: String
• title: String
• site: String
• softTitle: String
• date: Date
• copyright: String
• author: [String]
• publisher: String
• copyright: String
• favicon: String
• description: String
• lang: String
• canonicalLink: String
• tags: [String]
• isage: String
• videos: [[URL]]
• links: [[URL]]
• text: String

Citing

If you find this corpus helpful in your research, consider citing this work:

@misc{Griesshaber2017,
  author = {Grie{\ss}haber, Daniel},
  title = {Multilingual News Corpus},
  year = {2017},
  publisher = {GitLab HdM Stuttgart},
  journal = {Git repository},
  howpublished = {\url{https://gitlab.mi.hdm-stuttgart.de/griesshaber/german-news-corpus}}
}
      

Author

Daniel Grießhaber (Twitter/GitHub).

Template

Solo by chibicode