Questions tagged [memm]

A maximum-entropy Markov model (MEMM) is a discriminative model that extends a standard maximum entropy classifier by assuming that the unknown values to be learnt are connected in a Markov chain rather than being conditionally independent of each other.

Filter by
Sorted by
Tagged with
3
votes
1answer
528 views

HMM and CRF: the label bias problem and I-equivalence

I have a question about the label bias problem in HMM and CRF. I understand that HMM and MEMM suffer from the label bias problem, which is a preference for states with fewer transitions. The problem ...
2
votes
1answer
302 views

Is there any advantage of using MEMM instead of CRF for named-entity recognition?

I wonder whether there is any advantage of using maximum-entropy Markov model (MEMM), a.k.a. conditional Markov model (CMM) instead of using conditional random fields (CRF) for named-entity ...
0
votes
0answers
705 views

Maximum Entropy Markov Model Calculations

I am new to ML and I'm having trouble figuring out how to implement a Maximum Entropy Markov Model for a sequence labeling task. Given this MEMM equation $$ P_{s'}(s|,o)=\frac{1}{Z(o,s')}\exp\left(\...
9
votes
2answers
3k views

Named entity recognition and class imbalance [duplicate]

I have implemented Maximum-entropy Markov model (MEMM) for the Named entity recognition (NER) problem. I have four classes: geographical, people, material (book titles etc) and other. Class ...
9
votes
1answer
690 views

Creating a maximum entropy Markov model from an existing multi-input maximum entropy classifier

I am intrigued by the concept of a Maximum Entropy Markov Model (MEMM), and I am thinking of using it for a Part of Speech (POS) tagger. At the moment, I am using a conventional Maximum Entropy (ME) ...