Timeline for Named entity recognition and class imbalance
Current License: CC BY-SA 3.0
5 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jul 17, 2013 at 16:47 | comment | added | David Marx |
@Howie the bulk of a single sentence may be tagged other, but do all of the sentences in your training set include a named entity? If not, I'd recommend creating a binary flag associated with each sentence in your training data to indicate whether or not it includes a names entity and apply the over/under sampling to whole sentences to amplify the proportion of sentences containing named entities in your training data.
|
|
| Jul 17, 2013 at 12:33 | comment | added | Kaushik Ghose | I imagine each word (or phrase) is a sample. The re-sampling should be done based on the samples (tagged words/phrases). It sounds to me like the sentence is just a container for a variable number of samples. | |
| Jul 17, 2013 at 6:42 | comment | added | Howie |
I use whole tagged sentences as data samples, where most of the sentence is tagged as other. Will resampling work here as well?
|
|
| Jul 16, 2013 at 11:19 | review | First posts | |||
| Jul 16, 2013 at 11:31 | |||||
| Jul 16, 2013 at 11:04 | history | answered | Kaushik Ghose | CC BY-SA 3.0 |