Automatic Entity Recognition and Typing for Domain-Specific Corpora (KDD'15)
Source code for SIGKDD'15 paper ClusType: Effective Entity Recognition and Typing by Relation Phrase-Based Clustering (Slides).
Given a text corpus (e.g., a collection of news articles), it performs automatically entity extraction and typing using distant supervision (i.e., examples from external knowledge bases like Freebase). For example, from the sentence "The best BBQ I’ve tasted in Phoenix
" the system will recognize BBQ
as food and phoenix
as location. More background can be found in our WWW'16 tutorial.
ClusType works on coarse-grained entity types (e.g., Person, Location, Organization); for more fine-grained entity typing, please use AFET (Ren et al., EMNLP'16).
The system output on NYT dataset can be downloaded from here. We evaluated the result over ~1k (20,874 annotated entity mentions) gold standard set. Sample output on 50k Yelp reviews can be download from here.
Evaluate the result:
python src/evaluation.py -ResultPath -GroundTruthPath
$ sudo pip install numpy scipy sklearn lxml textblob
$ sudo python -m textblob.download_corpora
$ ./run.sh
We take Yelp dataset as an example.
Input: text corpus path.
RawText='data/yelp/yelp_230k.txt'
Input: type mapping file path.
TypeFile='data/yelp/type_tid.txt'
Input: mapping between Freebase and DBpedia entities.
FreebaseMap='data/freebase_links.nt'
Output: output file from candidate generation (format: "docId \TAB segmented sentence \n").
SegmentOutFile='result/segment.txt'
Output: entity linking result (please download the corresponding seed entity files).
SeedFile='data/yelp/seed_yelp.txt'
Output: entity mentions found in each document.
ResultFile='result/yelp/results.txt'
Output: In-text annotation of entity mentions.
ResultFileInText='result/yelp/resultsInText.txt'
Threshold on significance score for candidate generation.
significance="2"
Switch on capitalization feature for candidate generation.
capitalize="1"
Maximal phrase length for candidate generation.
maxLength='4'
Minimal support of phrases for candidate generation.
minSup='30'
Number of relation phrase clusters.
NumRelationPhraseClusters='500'
@inproceedings{ren2015clustype,
title={Clustype: Effective entity recognition and typing by relation phrase-based clustering},
author={Ren, Xiang and El-Kishky, Ahmed and Wang, Chi and Tao, Fangbo and Voss, Clare R and Han, Jiawei},
booktitle={Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining},
pages={995--1004},
year={2015},
organization={ACM}
}