Machine Learing

This post aims to share a list of notes (compiled by myself) on some important machine learning topics. Most of the concepts are mathematical, but after all, math is the most precise language!

Math

• Gamma Function
• Conjugate Prior
• Beta Distribution
• Multinomial Distribution
• Dirichlet Distribution
• Dirichlet-multinomial Distribution
• Dirichlet Process
• Mutual Information
• KL Divergence
• Entropy
• Cross Entropy
• Probabilistic Modeling

Optimization

• Stochastic Gradient Descent
• Expectation-Maximization Algorithm
• Metropolis-Hastings Algorithm
• Variational Bayes
• Natural gradient

Clustering

• K-means
• Gaussian Mixture Model
• Dirichlet Process Mixture Model

Classification

• Logistic Regression
• Softmax regression

Text Mining

• Text Similarity
• Word Association Mining
• Topic Model
• Probabilisitc Latent Semantic Analysis
• Latent Dirichlet Allocation