Multilingual News Corpus

Stats

• Language: English, German
• 375942 Articles
• 11 classes
• Rich meta information available for the articles

Download

1. Get Access to the Corpus

Since the news articles themselfes are copyrighted to the original publisher, access to this corpus can't be made public. If you want access, drop a short Email to griesshaber@hdm-stuttgart.de.

2. I already have access

Download the newest release here

Classes

The corpus is split into the following classes:

Label	Documents (EN)	Documents (DE)
Technologie	2881	22658
Lokal	1613	16891
Aktuell	1956	1134
Wirtschaft	1857	50904
Ausland	15604	23121
Finanzen	97	13339
Ignore	344	3258
Kultur	1214	11259
Sport	3062	24024
Politik	7725	70901
Sonstiges	21580	49229
Lifestyle	12155	19136
Total	70088	305854

Metainformation

The corpus was build by crawling german and english news sites. To extract the information unfluff was used. Therefore all metainformation is available as it is extracted by unfluff.

• rssTitle: String
• source: String
• title: String
• site: String
• softTitle: String
• date: Date
• copyright: String
• author: [String]
• publisher: String
• copyright: String
• favicon: String
• description: String
• lang: String
• canonicalLink: String
• tags: [String]
• isage: String
• videos: [[URL]]
• links: [[URL]]
• text: String

Citing

If you find this corpus helpful in your research, consider citing this work:

@misc{Griesshaber2017,
  author = {Grie{\ss}haber, Daniel},
  title = {Multilingual News Corpus},
  year = {2017},
  publisher = {GitLab HdM Stuttgart},
  journal = {Git repository},
  howpublished = {\url{https://gitlab.mi.hdm-stuttgart.de/griesshaber/german-news-corpus}}
}
      

Author

Daniel Grießhaber (Twitter/GitHub).

Template

Solo by chibicode