Multilingual News Corpus

Stats

• Language: English, German
• 394196 Articles
• 11 classes
• Rich meta information available for the articles

Download

1. Get Access to the Corpus

Since the news articles themselfes are copyrighted to the original publisher, access to this corpus can't be made public. If you want access, drop a short Email to griesshaber@hdm-stuttgart.de.

2. I already have access

Download the newest release here

Classes

The corpus is split into the following classes:

Label	Documents (EN)	Documents (DE)
Politik	8428	72165
Sport	3379	24653
Wirtschaft	2258	52975
Finanzen	133	13339
Aktuell	2234	1227
Ignore	365	3427
Lokal	2048	17644
Ausland	16516	24613
Technologie	3124	24904
Kultur	1452	11613
Sonstiges	23206	51916
Lifestyle	13119	19458
Total	76262	317934

Metainformation

The corpus was build by crawling german and english news sites. To extract the information unfluff was used. Therefore all metainformation is available as it is extracted by unfluff.

• rssTitle: String
• source: String
• title: String
• site: String
• softTitle: String
• date: Date
• copyright: String
• author: [String]
• publisher: String
• copyright: String
• favicon: String
• description: String
• lang: String
• canonicalLink: String
• tags: [String]
• isage: String
• videos: [[URL]]
• links: [[URL]]
• text: String

Citing

If you find this corpus helpful in your research, consider citing this work:

@misc{Griesshaber2017,
  author = {Grie{\ss}haber, Daniel},
  title = {Multilingual News Corpus},
  year = {2017},
  publisher = {GitLab HdM Stuttgart},
  journal = {Git repository},
  howpublished = {\url{https://gitlab.mi.hdm-stuttgart.de/griesshaber/german-news-corpus}}
}
      

Author

Daniel Grießhaber (Twitter/GitHub).

Template

Solo by chibicode