Understand how to use PPMI score to find word similarity . Check on other possible measures to check word similarity such as cosine similarity ,Dot product .
What is Back Propagation through time (BPTT) in Recurrent Neural Network, Vanishing Gradient , Exploding Gradient ,Gradient Clipping ,Long Term Dependencies
Understand what is Positive Point-wise mutual information (PPMI ) ,Computing PPMI on a term-context matrix , Weighting PMIK-Smoothing in PMI computation
Understand what is Vectorization ,Vector space models ,Term-document matrix , Word-context matrix and problems with raw counts in co-occurrence matrices