Entropy Classifiers
Section outline
-
Maximum entropy (maxent) classifier has been a popular text classifier, by parameterizing the model to achieve maximum categorical entropy, with the constraint that the resulting probability on the training data with the model being equal to the real distribution.Learning Outcomes:
- Explain the concepts of
Maximum entropy (maxent) classifier. - Explain different types of entropy classifiers.
- Explain the concepts of