Keyword extraction using co-occurrence.
| Authors | Christian Wartena, Rogier Brussee, Wout Slakhorst |
|---|---|
| Publication date | 3 september 2010 |
| Type | Lecture |
Summary
A common strategy to assign keywords to documents is to select the most appropriate words from the document text. One of the most important criteria for a word to be selected as keyword is its relevance for the text. The tf.idf score of a term is a widely used relevance measure. While easy to compute and giving quite satisfactory results, this measure does not take (semantic) relations between words into account. In this paper we study some alternative relevance measures that do use relations between words. They are computed by defining co-occurrence distributions for words and comparing these distributions with the document and the corpus distribution. We then evaluate keyword extraction algorithms defined by selecting different relevance measures. For two corpora of abstracts with manually assigned keywords, we compare manually extracted keywords with different automatically extracted ones. The results show that using word co-occurrence information can improve precision and recall over tf.idf.
| Language | Engels |
|---|---|
| Key words | Keywords, Information retrieval, Keyword extraction, Crossmedialab |
Neem contact met ons op
- Telefoon 088 481 81 81
- Email info@hu.nl
-
Stuur ons direct een bericht of voeg +97010241111 toe aan de contactlijst van je telefoon en stel je vraag via WhatsApp.
- Bereikbaar op ma t/m vrij 09.30 - 16.30 uur.