Lecture 3: language models and smoothing

Hy Smart People.. This article title is Lecture 3: language models and smoothing, I hope Useful For you

The third lecture was about language models. You discovered how important language models are and how we can approximate real language with them. N-gram models (unigrams, bigrams, trigrams) were discussed, together with their probability modeling and issues. We discussed perplexity and its close relationship with entropy, we introduced smoothing and interpolation techniques to deal with the issue of data sparsity.

Thanks For reading Lecture 3: language models and smoothing url link https://nlpapplicative.blogspot.com/2013/04/lecture-3-language-models-and-smoothing.html