What will be the best way to estimate the entropy/surprise of a word in a specific context? Let's say to compare the surprise of: context:
"I watched the movie in my"
I thought about:
entropy(word | context) = entropy(I watched the movie in my computer) - entropy( I watched the movie in my)
What do you think? is this a good method? Are there better ones?