Multilingual News Corpus

Stats

• Language: English, German
• 413651 Articles
• 11 classes
• Rich meta information available for the articles

Download

1. Get Access to the Corpus

Since the news articles themselfes are copyrighted to the original publisher, access to this corpus can't be made public. If you want access, drop a short Email to griesshaber@hdm-stuttgart.de.

2. I already have access

Download the newest release here

Classes

The corpus is split into the following classes:

Label	Documents (EN)	Documents (DE)
Kultur	1766	11829
Ignore	454	3592
Lokal	2663	18561
Lifestyle	14431	19483
Sonstiges	25519	54460
Politik	9405	72712
Aktuell	2439	1319
Wirtschaft	2901	54881
Sport	3789	24800
Technologie	3463	27320
Ausland	17671	26686
Finanzen	168	13339
Total	84669	328982

Metainformation

The corpus was build by crawling german and english news sites. To extract the information unfluff was used. Therefore all metainformation is available as it is extracted by unfluff.

• rssTitle: String
• source: String
• title: String
• site: String
• softTitle: String
• date: Date
• copyright: String
• author: [String]
• publisher: String
• copyright: String
• favicon: String
• description: String
• lang: String
• canonicalLink: String
• tags: [String]
• isage: String
• videos: [[URL]]
• links: [[URL]]
• text: String

Citing

If you find this corpus helpful in your research, consider citing this work:

@misc{Griesshaber2017,
  author = {Grie{\ss}haber, Daniel},
  title = {Multilingual News Corpus},
  year = {2017},
  publisher = {GitLab HdM Stuttgart},
  journal = {Git repository},
  howpublished = {\url{https://gitlab.mi.hdm-stuttgart.de/griesshaber/german-news-corpus}}
}
      

Author

Daniel Grießhaber (Twitter/GitHub).

Template

Solo by chibicode