HunNERwiki: Automatically generated NE tagged corpus for Hungarian

Instance of: Resource Info
Contributor Dávid Márk Nemeskey
Eszter Simon
Description The text of the corpus is automatically generated from Hungarian Wikipedia articles. It contains Named Entity (NE) tagging according to the CoNLL standard (Person, Organization, Location and Miscellaneous), and additional morphological annotation. The corpus is the largest ever NE tagged corpus for Hungarian, which can be used for training and testing NE recognizer applications. Thanks to the standard tagset, the performance of systems trained on the hunNERwiki corpus is comparable with the performance of other state-of-the-art systems. Besides the obvious advantages of fully automatic building and annotation procedure (reducing the annotation cost), the novelty of the corpus is the application of collaboratively constructed resources (Wikipedia, DBpedia).
Language hu
Rights CC-BY-SA
See Also http://metashare.elda.org/repository/browse/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779/
Source META-SHARE
Title HunNERwiki: Automatically generated NE tagged corpus for Hungarian
Type Dataset
Type Corpus

Contact Point

Affiliation
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution
Access URL http://www.nytud.hu/oszt/korpusz/Pinter_Tibor.html
http://www.sztaki.hu/
Type Distribution
URL
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Organization Name Computer and Automation Research Institute, Hungarian Academy of Sciences
Organization Short Name MTA SZTAKI
Type Organization Info Type
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution
Access URL http://www.nytud.hu/eng/index.html
http://www.sztaki.hu/munkatars/008007760/
Type Distribution
URL
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Given Name Dávid Márk
Position research associate
Surname Nemeskey
Type Contact Person
Person
Person Info Type
Affiliation
Communication Info
Address Benczur utca 33.
Lágymányosi u. 11.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL2
Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL3
Email nemeskey.david@sztaki.hu
linguinst@nytud.mta.hu
Fax Number +36 1 322 9297
+ 36 1 279 6108
Telephone Number + 36 1 321 4830
+ 36 1 279 6154
Type Communication Info
Zip Code 1111
1068
Department Name Department of Language Technology
Organization Name Research Institute for Linguistics, Hungarian academy of Sciences
Organization Short Name RIL HAS
Type Organization Info Type
Communication Info
Address Benczur utca 33.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL3
Email pinter.tibor@nytud.mta.hu
Fax Number +36 1 322 9297
Telephone Number + 36 1 321 4830 ext.119
Type Communication Info
Zip Code 1068
Given Name Tibor
Position research fellow
Surname Pinter
Type Contact Person
Person
Person Info Type

Corpus Info

Corpus Text Info
Annotation Info
Annotation Format text/csv
Annotation Mode Automatic
Annotation Tool in-house software, hunmorph, hundisambig
Annotation Type Semantic Annotation-named Entities
Annotator
Person Info
Affiliation
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL3
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Organization Name Computer and Automation Research Institute, Hungarian Academy of Sciences
Organization Short Name MTA SZTAKI
Type Organization Info Type
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL2
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Given Name Dávid Márk
Position research associate
Surname Nemeskey
Type Person
Person Info Type
Type Actor
Person Info
Affiliation
Communication Info
Address Benczúr utca 33.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL3
Email pinter.tibor@nytud.mta.hu
Fax Number +36 1 322 9297
Telephone Number + 36 1 321 4830 ext.119
Type Communication Info
Zip Code 1068
Department Name Department of Language Technology
Organization Name Research Institute for Linguistics, Hungarian Academy of Sciences
Organization Short Name RIL HAS
Type Organization Info Type
Communication Info
Address Benczúr utca 33.
City Budapest
Distribution
Access URL http://www.nytud.hu/oszt/korpusz/Simon_Eszter.html
Type Distribution
URL
Email eszter@nytud.mta.hu
Fax Number +36 1 322 9297
Telephone Number + 36 1 321 4830 ext.119
Type Communication Info
Zip Code 1068
Given Name Eszter
Position research fellow
Surname Simon
Type Person
Person Info Type
Type Actor
Conformance To Standards Best Practices Other
Segmentation Level Word
Size Per Annotation
Size 19108597
Size Unit Words
Type Size Info Type
Type Annotation Info
Character Encoding Info
Character Encoding UTF-8
Size Per Character Encoding
Size 19108597
Size Unit Words
Type Size Info Type
Type Character Encoding Info
Language Info
Language hu
Language Name Hungarian
Size Per Language
Size 19108597
Size Unit Words
Type Size Info Type
Type Language Info
Linguality Info
Linguality Type Monolingual
Type Linguality Info
Media Type Text
Modality Info
Modality Type Written Language
Type Modality Info
Size Info
Size 19108597
Size Unit Words
Type Size Info Type
Text Format Info
Mime Type text/xml
Size Per Text Format
Size 19108597
Size Unit Words
Type Size Info Type
Type Text Format Info
Type Corpus Text Info
Resource Type Corpus
Type Corpus Info

Distribution Info

Availability Available-unrestricted Use
Availability Start Date 2012-07-01 Date
Ipr Holder
Organization Info
Communication Info Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#communication Info4
Organization Name Computer and Automation Research Institute, Hungarian Academy of Sciences
Organization Short Name MTA SZTAKI
Type Organization Info Type
Type Actor
License
Delivery Channel Hard Disk
Distribution Rights Holder
Organization Info
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL3
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Organization Name Computer and Automation Research Institute, Hungarian Academy of Sciences
Organization Short Name MTA SZTAKI
Type Organization Info Type
Type Actor
Licensor
Person Info
Affiliation
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL3
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Organization Name Computer and Automation Research Institute, Hungarian Academy of Sciences
Organization Short Name MTA SZTAKI
Type Organization Info Type
Communication Info
Address Lágymányosi u. 11.
City Budapest
Distribution Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Dist URL2
Email nemeskey.david@sztaki.hu
Fax Number + 36 1 279 6108
Telephone Number + 36 1 279 6154
Type Communication Info
Zip Code 1111
Given Name Dávid Márk
Position research associate
Surname Nemeskey
Type Person
Person Info Type
Type Actor
Permission
Action http://creativecommons.org/ns/ShareALike
http://creativecommons.org/ns/Attribution
Duty Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#permission
Type Duty
Permission
Restrictions Of Use
Same As https://creativecommons.org/licenses/by-sa/4.0/
Type Licence Info
Type Distribution
Distribution Info

Identification Info

Description The text of the corpus is automatically generated from Hungarian Wikipedia articles. It contains Named Entity (NE) tagging according to the CoNLL standard (Person, Organization, Location and Miscellaneous), and additional morphological annotation. The corpus is the largest ever NE tagged corpus for Hungarian, which can be used for training and testing NE recognizer applications. Thanks to the standard tagset, the performance of systems trained on the hunNERwiki corpus is comparable with the performance of other state-of-the-art systems. Besides the obvious advantages of fully automatic building and annotation procedure (reducing the annotation cost), the novelty of the corpus is the application of collaboratively constructed resources (Wikipedia, DBpedia).
Distribution
Access URL http://hlt.sztaki.hu/resources/hunnerwiki.html
Type Distribution
URL
Identifier 112
Meta Share Id NOT_DEFINED_FOR_V2
Resource Short Name hunNERwiki
Title HunNERwiki: Automatically generated NE tagged corpus for Hungarian
Type Identification Info

Usage Info

Actual Use Info
Actual Use Nlp Applications
Type Actual Use Info
Usage Report
Document Unstructured Eszter Simon, Dávid M. Nemeskey. 2012. Automatically generated NE tagged corpora for English and Hungarian. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pages 38-46.
Type Documentation Info Type
Type Usage Info

Version Info

Has Version 1.0
Modified 2012-06-30 Date
Revision compilation of the corpus
Type Version Info

Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#Header

Instance of: Catalog Record
Issued 2014-09-23T00:19:15Z Date
Primary Topic HunNERwiki: Automatically generated NE tagged corpus for Hungarian
Set Spec corpus:text
corpus

Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#metadata Creator

Instance of: Actor
Is Creator of Metashare/61caeaae64e211e2aa7c68b599c26a06a02655c476264027b093b7ae4abc9779#metadata Info