Language modeling (LM)
Section outline
-
Language modeling (LM) is the use of various statistical and probabilistic techniques to determine the probability of a given sequence of words occurring in a sentence. Language models analyze bodies of text data to provide a basis for their word predictions.
Learning Outcomes:
- Explain the concept of Language modeling (LM).
- Demonstrate Language modeling (LM) using NLTK.