NLP News

By Sebastian Ruder

Get the highlights from Natural Language Processing & Machine Learning research & industry straight to your inbox every month.

Previous issues

The Bitter Lesson, How to Write X, ML Events in 2019

#39 Apr 15, 2019

GPT-2, Sequence generation in arbitrary order

#38 Mar 11, 2019

BERT, Transfer learning for dialogue, Deep Learning SOTA 2019, Gaussian Processes, VI, NLP lesson curricula, fast.ai lessons, AlphaStar, How to manage research teams

#37 Feb 11, 2019

#36

Jan 14, 2019

Challenges in Few-shot learning; 2019 predictions; JAX; Explainable models; MT reading list; Foundations of ML; AI Index 2018; Karen Sparck Jones; Analysis methods survey; ICLR 2019 rejects – Happy 2019 everyone 🎉! May your losses decrease consistently, your models generalize to out-of-domain
#35

Dec 17, 2018

🎅 NeurIPS 2018; The nature of research; Advances in image generation, protein folding, and RL – Happy holiday season wherever you are based! 🎅⛄️🏖😎It's only been a month since the last newsletter, b
#34

Nov 12, 2018

ML on code, Understanding RNNs, Deep Latent Variable Models, Writing Code for NLP Research, Quo vadis, NLP?, Democratizing AI, ML Cheatsheets, Spinning Up in Deep RL, Papers with Code, Unsupervised MT, Multilingual BERT, Graph Networks, AutoML – Hey all,Welcome to this month’s newsletter edition! There's a lot of cool stuff this time, so better
#33

Oct 15, 2018

TensorFlow 2.0, PyToch Dev Conference, DecaNLP, BERT, Annotated Encoder-Decoder, ICLR 2019 reading, fast.ai v1, AllenNLP v0.7, 10 writing tips, AutoML & Maths for ML books, TensorFlow NLP best practices – Hey all,Welcome to this month's newsletter edition, which includes some cool video content about Tens
#32

Sep 17, 2018

Deep Learning Indaba 2018 edition 🌍 – Hey all,I spent the past week at the Deep Learning Indaba 2018 hosted in Stellenbosch in beautiful So
#31

Sep 3, 2018

Fake video, State of ML Code, Notebooks, and Software, Advice for MScing and PhDing, Ada Lovelace, 150+ Best Resources – Hi all,I hope you're all doing well and enjoying your Monday morning. This newsletter features discus
#30

Aug 20, 2018

Learning Meaning in NLP, Recurrence in NNs, Q&A with Yoshua Bengio, ML == pseudo science?, ImageNet < 18mins, Where's Waldo?, Frontiers of NLP – Hi all,This is edition #️⃣3️⃣0️⃣ of this newsletter! This one discusses some super interesting topics
#29

Aug 6, 2018

Future of CV and NLP, Maths (Fields Medal, Maths for ML), AutoML Natural Language, Google Assistant, Cutting through the hype, NALUs – Hi all,Greetings from Ireland ☘️! I actually didn't expect to be thankful for the Irish weather ☔️. D
#28

Jul 23, 2018

ACL 2018, Videos from NAACL 2018 and ICML 2018, Fanatic NMT, MojiTalk, CompareGAN, NLP is fun, Program synthesis, AutoML, DeepStack, Gumbel Softmax – Hi all,It's been a year since the first edition of this newsletter 🎉! Thank you so much for sticking
#27

Jul 9, 2018

RL and teamwork, Tracking the state of AI, Facebook and fake news, Doing research, Conference things – Why did the Bayesian suddenly feel patriotic when he heard fireworks 🎇?He assumed independence.Happy
#26

Jun 25, 2018

Transfer learning, Chris Olah, Software 2.0, NMT with attention notebook, gradient boosting in-depth, Defense Against the Dark Arts, interpretability and bias, RL, scene understanding – Hi all,It feels like quite a lot has been going on in the last two weeks. Consequently, this newslett
#25

Jun 11, 2018

Conversational AI tutorial, RNNs for particle physics, InfoGAN, NLP Coursera, NLP book, killer robots, Code2pix, Google AI principles, relational reasoning – Hi all,We cracked 3,000 subscribers! Woohoo! 🎉Thanks to all of you for reading!This edition contains:
#24

Jun 4, 2018

ML Practica, I/O CodeLabs, All About NLP, Retro games, Dark side of AI, Computer vs. Doctors, Misspellings, Fairness, Causal Inference, X.ai, HuggingFace, Amazon – Skimmed between sessions at NAACL-HLTHi all! Whether you're at a conference or sipping your morning c
#23

May 21, 2018

Fast.ai; Google IO; Semantic segmentation, object detection, network graph overviews; algorithms vs. compute; AI perspectives; MT; semantic similarity; Goodfellow, Schmidhuber, & Kaggle #1 profiles; Maths for ML; synthetic data; uncertainty for dialogue – Hi all!Are you still stressed about your NIPS submission, anxious about the EMNLP deadline or just an
#22

May 7, 2018

Intrinsic dimension video; Ilya Sutskever meta-learning; ICLR 2018 presentations; Pointer Sentinel Mixture Models, PyTorch, einsum tutorials; accessible, open-source AI; lessons of 2 years of AI research – Hi all,Here is your bi-weekly dose of NLP and ML goodness!This time, we have: a cool explainer video
#21

Apr 23, 2018

NLP PyTorch libraries; GAN tutorial; Jupyter tricks; TensorFlow things; Representation Learning; Making NLP more accessible; Michael Jordan essay; Reproducing Deep RL; Rakuten Data Challenge; NAACL Outstanding Papers – This newsletter has a lot of content, so make yourself a cup of coffee ☕️, lean back, and enjoy.This
#20

Apr 9, 2018

Tensorflow DevSummit 2018; Annotated Transformer; TF-Hub; CS224n reports; Awesome-NLP; Meta-learning; World Models; Neural Baby Talk; Semantic Plausibility – Welcome to the 20th edition of NLP News! Thanks for reading! 🎉As it's often the visualizations and fi

Show more issues