NLP News

By Sebastian Ruder

Get curated highlights of recent developments in natural language processing and machine learning straight to your inbox every month.

Previous issues

Reviewing, Taking stock, Theme papers, Poisoning and stealing models, Multimodal generation

#52 Jun 5, 2020

COVID-19 edition 😷

#51 Apr 15, 2020

COVID-19, Hutter Prize, Compression = AGI?, BERT, Green AI

#50 Mar 27, 2020

#49

Feb 25, 2020

Accelerating science, memorizing vs learning to look things up, Schmidhuber's 2010s, Greek BERT, ARC, Illustrated Reformer, Annotated GPT-2, oLMpics – Hi all,This newsletter discusses accelerating science, memorizing vs learning to look things up, and
#48

Jan 27, 2020

NLP Progress, Restrospectives and look ahead, New NLP courses, Independent research initiatives, Interviews, Lots of resources – Happy 2020 everyone 🎉! May your models be sample-efficient, your generalisation error be low, and you
#47

Dec 23, 2019

2020 NLP wish lists, HuggingFace + fastai, NeurIPS 2019, GPT-2 things, Machine Learning Interviews – Happy holidays everyone! 🕯🎄🕎I hope you all had a fantastic year. The last newsletter of 2019 conclude
#46

Nov 19, 2019

Highlights of EMNLP 2019, Ethics in NLP vol. 2, AI and Journalism – Hi all,The themes of this newsletter are highlights from EMNLP 2019, ethical uses of NLP, and AI and
#45

Oct 22, 2019

Deep Learning Indaba, EurNLP, ML echo chamber, Pretrained LMs, Reproducibility papers – Hi all,This month features updates about recent events (ICLR 2020 submissions, Deep Learning Indaba,
#44

Sep 16, 2019

Experimental results and error reporting, Ethics and NLP, Distillation vol. 2, SemEval 2020 – Hi all,This edition is about better ways to report experimental results and model errors, ethics and
#43

Aug 21, 2019

Bigger vs. smaller models, powerful vs. dumb models – Hi all,The theme of this newsletter are juxtapositions: training ever bigger models (GPT-8 8B) vs. ma
#42

Jul 22, 2019

NLP in Industry, Leaderboard madness, fast.ai NLP, Transfer learning tools – Hi all,This month's newsletter covers some cool examples of how NLP is used in industry, some discuss
#41

Jun 24, 2019

BERT, GPT-2, XLNet, NAACL, ICML, arXiv, EurNLP – Hi all,A lot has been going on in the past month. This newsletter contains new stuff about BERT, GPT-
#40

May 20, 2019

Marvel, Stanford & CMU NLP Playlists, Voynich, Bitter Lesson Vol. 2, ICLR 2019, Dialogue Demos – Hi all,There should be something for everyone in this newsletter. NLP and superheroes team up. We hav
#39

Apr 15, 2019

The Bitter Lesson, How to Write X, ML Events in 2019 – Hi all,This newsletter’s spotlight topics are The Bitter Lesson, How to Write X guides, and ML events
#38

Mar 11, 2019

GPT-2, Sequence generation in arbitrary order – Hi all,This newsletter's spotlight topics are GPT-2, OpenAI's recent language model, and sequence gen
#37

Feb 11, 2019

BERT, Transfer learning for dialogue, Deep Learning SOTA 2019, Gaussian Processes, VI, NLP lesson curricula, fast.ai lessons, AlphaStar, How to manage research teams – Hi all,I hope you've had a good start into 2019! This newsletter covers a ton of material: slides fro
#36

Jan 14, 2019

Challenges in Few-shot learning; 2019 predictions; JAX; Explainable models; MT reading list; Foundations of ML; AI Index 2018; Karen Sparck Jones; Analysis methods survey; ICLR 2019 rejects – Happy 2019 everyone 🎉! May your losses decrease consistently, your models generalize to out-of-domain
#35

Dec 17, 2018

🎅 NeurIPS 2018; The nature of research; Advances in image generation, protein folding, and RL – Happy holiday season wherever you are based! 🎅⛄️🏖😎It's only been a month since the last newsletter, b
#34

Nov 12, 2018

ML on code, Understanding RNNs, Deep Latent Variable Models, Writing Code for NLP Research, Quo vadis, NLP?, Democratizing AI, ML Cheatsheets, Spinning Up in Deep RL, Papers with Code, Unsupervised MT, Multilingual BERT, Graph Networks, AutoML – Hey all,Welcome to this month’s newsletter edition! There's a lot of cool stuff this time, so better
#33

Oct 15, 2018

TensorFlow 2.0, PyToch Dev Conference, DecaNLP, BERT, Annotated Encoder-Decoder, ICLR 2019 reading, fast.ai v1, AllenNLP v0.7, 10 writing tips, AutoML & Maths for ML books, TensorFlow NLP best practices – Hey all,Welcome to this month's newsletter edition, which includes some cool video content about Tens

Show more issues