The news articles reporting on the 2021 Tokyo Olympics data set OG2021 (public)

  Authors

Novak, Erik ; Calcina, Erik ; Mladenić, Dunja and Grobelnik, Marko

  Item identifier

http://hdl.handle.net/11356/1922

 Project URL

https://www.humane-ai.eu/

 Demo URL

https://github.com/E3-JSI/dataset-OG2021

 Date issued

2024-02-27

 Type

corpus, text

 Size

10940 articles

 Language(s)

Arabic , Chinese , English , French , German , Portuguese , Russian , Slovenian , Spanish

 Description

The OG2021 corpus contains multilingual news articles that are reporting on the events happening during the 2021 Tokyo Olympics. The data set was created to evaluate the clustering algorithm. The articles were initially acquired via the EventRegistry service, clustered using an online news clustering algorithm, and finally manually inspected and annotated by a single evaluator using translation services to understand the meaning of the articles' content. The corpus consists of a single file called og2021.csv, which contains the data of 10.940 news articles grouped into 1.350 clusters. Each article has the following attributes: - id: The ID of the news article. - title: The title of the article. - lang: The language in which the article is written. Can be one of nine values. - source: The news publisher's name. - published_at: The date and time when the article was published. The published dates range between 2021-07-01 and 2021-08-14. - URL: The URL location of the news article. - cluster_id: The ID of the cluster the article is a member of. The dataset is also published with the body attribute but under a more restrictive licence. It can be found at http://hdl.handle.net/11356/1921.

 Publisher

Jožef Stefan Institute

 Acknowledgement

European Union EC/H2020/952026 "HumanE-AI-Net - HumanE AI Network"

 Subject(s)

news corpus clustering evaluation dataset

 Collection(s)

CLARIN.SI data & tools

Show full item record