July - Foundational

• Convolutional Neural Nets for text
  • CNN for Modeling Sentences - https://www.aclweb.org/anthology/P14-1062.pdf
  • Dilated CNNs for Language Modeling - https://arxiv.org/pdf/1610.10099.pdf
  • Graph Convolution for text - https://www.aclweb.org/anthology/D17-1159.pdf
  • Convolutional Neural Networks for Sentence Classification - https://arxiv.org/pdf/1408.5882.pdf
  • Dependency Sensitive Convolutional Neural Networks for Modeling Sentences and Documents - https://www.aclweb.org/anthology/N16-1177.pdf
  • Character-level Convolutional Networks for Text Classification - https://papers.nips.cc/paper/2015/file/250cf8b51c773f3f8dc8b4be867a9a02-Paper.pdf
• Word Embeddings
  • Mitigating Gender Based Proximities in Word Embeddings - https://transacl.org/ojs/index.php/tacl/article/view/2011
  • Evaluating Word Embeddings - https://www.aclweb.org/anthology/D15-1036.pdf
  • Word2Vec - https://arxiv.org/pdf/1301.3781.pdf
  • Multi-prototype Embeddings - https://www.aclweb.org/anthology/N10-1013.pdf
  • Debiasing Word Embeddings https://papers.nips.cc/paper/2016/file/a486cd07e4ac3d270571622f4f316ec5-Paper.pdf
• N-gram language models - https://web.stanford.edu/~jurafsky/slp3/3.pdf
• Recurrent Neural Nets
  • Chapter 10 Sequence Modeling: Recurrent and Recursive Nets - https://www.deeplearningbook.org/contents/rnn.html
  • On the difficulty of training recurrent neural networks - http://proceedings.mlr.press/v28/pascanu13.pdf
  • Understanding LSTM Networks - https://colah.github.io/posts/2015-08-Understanding-LSTMs/

August - Machine Translation

• Seq2seq
  • Pointer Generator networks - https://arxiv.org/abs/1704.04368
  • A textbook chapter - https://arxiv.org/pdf/1703.01619.pdf
  • Seq2Seq Encoder Decoder Models - https://proceedings.neurips.cc/paper/2014/file/a14ac55a4f27472c5d894ec1c3c743d2-Paper.pdf
  • BLUE Scores - https://www.aclweb.org/anthology/P02-1040.pdf
• Attention Basics
  • Neural Machine Translation by Jointly Learning to Align and Translate - https://arxiv.org/pdf/1409.0473.pdf
  • Efficient Attention - https://www.aclweb.org/anthology/D15-1166.pdf
  • Attending to Speech - https://arxiv.org/pdf/1508.01211.pdf
  • Multi Modal Attention - https://www.aclweb.org/anthology/W16-2360.pdf
  • Attention is all you need - https://arxiv.org/pdf/1706.03762.pdf
  • Convolutional Attention - https://arxiv.org/pdf/1602.03001.pdf

September - Structured Language and Semantic Parsing

• [To Add]

October - Generative Models

• GAN
  • Tutorial - https://arxiv.org/pdf/1701.00160.pdf
  • Machine Translation with GANs - https://arxiv.org/abs/1703.04887
  • Dialog with GANs - https://www.aclweb.org/anthology/D17-1229.pdf
  • Unrolled GANs - https://openreview.net/pdf?id=BydrOIcle
• Variational auto-encoders

November - Adversarial Methods for Text

• Adversarial Learning
  • Adversarial Multi Task Learning for Text Classification - https://www.aclweb.org/anthology/P17-1001.pdf
  • Professor Forcing - https://arxiv.org/pdf/1610.09038.pdf
  • Style Transfer for Text - https://arxiv.org/pdf/1705.09655.pdf
  • Controlled Text Generation - http://proceedings.mlr.press/v70/hu17e/hu17e.pdf
  • The Curious Case of Neural Text Degeneration - https://openreview.net/pdf?id=rygGQyrFvH

December - Knowledge Graphs

• Knowledge Graph Basics
  • Knowledge Graph through Embeddings - https://proceedings.neurips.cc/paper/2013/file/1cecc7a77928ca8133fa24680a88d2f9-Paper.pdf
  • Reasoning with Neural Tensor Networks for Knowledge Base Completion - https://proceedings.neurips.cc/paper/2013/file/b337e84de8752b27eda3a12363109e80-Paper.pdf
  • Distant Supervision for Relation Extraction - https://www.aclweb.org/anthology/N19-1184.pdf
  • Traversing Knowledge Graphs in Vector Space - https://www.aclweb.org/anthology/D15-1038.pdf

January - Dialog / Generation

• Plug and Play Language Models: A Simple Approach to Controlled Text Generation, Dathathri et al. ICLR 2020
• Common Sense Reasoning