NLP Highlights

Allen Institute for Artificial Intelligence

145 episodes listed below

Listen to the show on

PRESS PLAY

Find your next episode

All episodes

In their own words

**The podcast is currently on hiatus. For more active NLP content, check out the Holistic Intelligence Podcast linked below.** Welcome to the NLP highlights podcast, where we invite researchers to talk about their work in various areas in natural language processing. All views expressed belong to the hosts/guests, and do not represent their employers.

As heard by us

Based on 4 episodes we listened to · September 2026

NLP Highlights makes AI research useful by tracing model results back to choices about data, training, access, and evaluation.

NLP Highlights treats research papers as working material, asking researchers to explain the choices behind language and multimodal systems. Bridger and Pradeep Dazeghi favor direct technical questions: how training data should be organized, what lower-resource teams can use,…

Read our full review in PlayNext →

Why you'd press play

Language-model recipes get their knobs questioned before you have to swallow the finished product.

Press play if you want

  • open-model builders to explain which training choices they would revisit
  • ideas for adapting a model when your compute budget is closer to one GPU
Read the full recommendation in PlayNext →

Talks about

Best episodes of NLP Highlights

Short reviews from the PlayNext desk, based on the episodes we processed.

Are LLMs safe?Feb 29, 2024

A focused argument for treating data design as the real lever in LLM training.

The discussion makes a steady case that model progress depends on treating data as a design problem, not just a compute problem. It follows Sachin Gururangan from UW NLP to his next role at LLaMA, then into adaptive pre-training, where time, language family, language, and domain…

"Imaginative AI" with Mohamed ElhoseinyJan 8, 2024

A clear, concept-led look at multimodal AI, organized around a four-part framework for imagining.

The conversation frames computer vision as more than recognition, pushing toward AI that can imagine as well as interpret. It also follows Dr.

142 - Science Of Science, with Kyle Lo

An attentive look at using NLP to make science easier to study.

The episode treats science of science as a practical problem: how computational methods can help study the process of science, and where language tools can make that work easier to handle.

141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld

A clear look at why open-sourcing language models is treated as a research choice.

Open-sourcing language models is treated here as a research question, not a finished product. The conversation with AI2's ALMA leads stays on the choices that shape a model and its release: how to structure the training recipe, where instruction data belongs, whether human…

Podcasts like NLP Highlights

Episodes

  1. 1

    142 - Science Of Science, with Kyle Lo

    Hidden gem

    Bridger and Pradeep Dazeghi talk with Kyle Lowe from the Allen Institute for Artificial Intelligence about science of science, a field Kyle describes as computational sociology for studying how science progresses.

    ·49m·3 clips
  2. 2

    141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld

    ·30m
  3. 3

    Are LLMs safe?

    Hidden gem

    NLP Highlights interviews Sachin Gururangan, who is finishing a University of Washington PhD and joining Meta's LAMA team next week.

    Feb 29, 2024·42m·2 clips
  4. 4

    "Imaginative AI" with Mohamed Elhoseiny

    Hidden gem

    Dr.

    Jan 8, 2024·23m·1 clip
  5. 5

    140 - Generative AI and Copyright, with Chris Callison-Burch

    Jun 6, 2023·51m
  6. 6

    139 - Coherent Long Story Generation, with Kevin Yang

    Mar 24, 2023·45m
  7. 7

    138 - Compositional Generalization in Neural Networks, with Najoung Kim

    Jan 20, 2023·48m
  8. 8

    137 - Nearest Neighbor Language Modeling and Machine Translation, with Urvashi Khandelwal

    Jan 13, 2023·36m
  9. 9

    136 - Including Signed Languages in NLP, with Kayo Yin and Malihe Alikhani

    May 19, 2022·1h 2m
  10. 10

    135 - PhD Application Series: After Submitting Applications

    Mar 2, 2022·37m
  11. 11

    134 - PhD Application Series: PhDs in Europe versus the US, with Barbara Plank and Gonçalo Correia

    Oct 19, 2021·38m
  12. 12

    133 - PhD Application Series: Preparing Application Materials, with Nathan Schneider and Roma Patel

    Oct 6, 2021·44m
  13. 13

    132 - Alexa Prize Socialbot Grand Challenge and Alquist 4.0, with Petr Marek

    Sep 27, 2021·42m
  14. 14

    131 - Opportunities and Barriers between HCI and NLP, with Nanna Inie and Leon Derczynski

    Aug 20, 2021·47m
  15. 15

    130 - Linking human cognitive patterns to NLP Models, with Lisa Beinborn

    Aug 9, 2021·44m
  16. 16

    129 - Transformers and Hierarchical Structure, with Shunyu Yao

    Jul 2, 2021·36m
  17. 17

    128 - Dynamic Benchmarking, with Douwe Kiela

    Jun 19, 2021·47m
  18. 18

    127 - Masakhane and Participatory Research for African Languages, with Tosin Adewumi and Perez Ogayo

    Jun 8, 2021·47m
  19. 19

    126 - Optimizing Continuous Prompts for Generation, with Lisa Li

    May 24, 2021·48m
  20. 20

    125 - VQA for Real Users, with Danna Gurari

    May 4, 2021·42m
  21. 21

    124 - Semantic Machines and Task-Oriented Dialog, with Jayant Krishnamurthy and Hao Fang

    Apr 14, 2021·46m
  22. 22

    123 - Robust NLP, with Robin Jia

    Apr 5, 2021·48m
  23. 23

    122 - Statutory Reasoning in Tax Law, with Nils Holzenberger

    Nov 12, 2020·46m
  24. 24

    121 - Language and the Brain, with Alona Fyshe

    Oct 30, 2020·43m
  25. 25

    120 - Evaluation of Text Generation, with Asli Celikyilmaz

    Oct 3, 2020·55m
  26. 26

    119 - Social NLP, with Diyi Yang

    Sep 3, 2020·54m
  27. 27

    118 - Coreference Resolution, with Marta Recasens

    Aug 26, 2020·48m
  28. 28

    117 - Interpreting NLP Model Predictions, with Sameer Singh

    Aug 13, 2020·57m
  29. 29

    116 - Grounded Language Understanding, with Yonatan Bisk

    Jul 3, 2020·59m
  30. 30

    115 - AllenNLP, interviewing Matt Gardner

    Jun 17, 2020·33m
  31. 31

    114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro

    May 26, 2020·44m
  32. 32

    113 - Managing Industry Research Teams, with Fernando Pereira

    May 22, 2020·42m
  33. 33

    112 - Alignment of Multilingual Contextual Representations, with Steven Cao

    May 13, 2020·33m
  34. 34

    111 - Typologically diverse, multi-lingual, information-seeking questions, with Jon Clark

    Apr 27, 2020·38m
  35. 35

    110 - Natural Questions, with Tom Kwiatkowski and Michael Collins

    Apr 6, 2020·44m
  36. 36

    109 - What Does Your Model Know About Language, with Ellie Pavlick

    Mar 30, 2020·47m
  37. 37

    108 - Data-To-Text Generation, with Verena Rieser and Ondřej Dušek

    Mar 23, 2020·50m
  38. 38

    107 - Multi-Modal Transformers, with Hao Tan and Mohit Bansal

    Feb 24, 2020·38m
  39. 39

    106 - Ethical Considerations In NLP Research, with Emily Bender

    Feb 17, 2020·39m
  40. 40

    105 - Question Generation, with Sudha Rao

    Feb 10, 2020·43m
  41. 41

    104 - Model Distillation, with Victor Sanh and Thomas Wolf

    Feb 3, 2020·31m
  42. 42

    103 - Processing Language in Social Media, with Brendan O'Connor

    Jan 27, 2020·43m
  43. 43

    102 - Biomedical NLP research at the National Institute of Health with Dina Demner-Fushman

    Jan 20, 2020·37m
  44. 44

    101 - The lottery ticket hypothesis, with Jonathan Frankle

    Jan 14, 2020·41m
  45. 45

    100 - NLP Startups, with Oren Etzioni

    Jan 8, 2020·31m
  46. 46

    99 - Evaluating Protein Transfer Learning, With Roshan Rao And Neil Thomas

    Dec 16, 2019·45m
  47. 47

    98 - Analyzing Information Flow In Transformers, With Elena Voita

    Dec 9, 2019·37m
  48. 48

    97 - Automated Analysis Of Historical Printed Documents, With Taylor Berg-Kirkpatrick

    Nov 27, 2019·44m
  49. 49

    96 - Question Answering as an Annotation Format, with Luke Zettlemoyer

    Nov 12, 2019·30m
  50. 50

    95 - Common sense reasoning, with Yejin Choi

    Oct 7, 2019·35m
  51. 51

    94 - Decompositional Semantics, with Aaron White

    Sep 30, 2019·28m
  52. 52

    93 - NLP/ML for clinical data, with Alistair Johnson

    Jul 22, 2019·37m
  53. 53

    92 - Computational Humanities, with David Bamman

    Jul 5, 2019·34m
  54. 54

    91 - (Executable) Semantic Parsing, with Jonathan Berant

    Jun 26, 2019·42m
  55. 55

    90 - Research in Academia versus Industry, with Philip Resnik and Jason Baldridge

    May 31, 2019·55m
  56. 56

    89 - Dialog Systems, with Zhou Yu

    May 31, 2019·37m
  57. 57

    88 - A Structural Probe for Finding Syntax in Word Representations, with John Hewitt

    May 7, 2019·41m
  58. 58

    87 - Pathologies of Neural Models Make Interpretation Difficult, with Shi Feng

    Apr 25, 2019·33m
  59. 59

    86 - NLP for Evidence-based Medicine, with Byron Wallace

    Apr 15, 2019·32m
  60. 60

    85 - Stress in Research, with Charles Sutton

    Mar 29, 2019·37m
  61. 61

    84 - Large Teams Develop, Small Groups Disrupt, with Lingfei Wu

    Mar 26, 2019·39m
  62. 62

    83 - Knowledge Base Construction, with Sebastian Riedel

    Mar 13, 2019·38m
  63. 63

    82 - Visual Reasoning, with Yoav Artzi

    Mar 6, 2019·42m
  64. 64

    81 - BlackboxNLP, with Afra Alishahi and Tal Linzen

    Feb 6, 2019·31m
  65. 65

    80 - Leaderboards and Science, with Siva Reddy

    Jan 29, 2019·30m
  66. 66

    79 - The glass ceiling in NLP, with Natalie Schluter

    Jan 21, 2019·27m
  67. 67

    78. Where do corpora come from?, with Matt Honnibal and Ines Montani

    Jan 15, 2019·30m
  68. 68

    77. On Writing Quality Peer Reviews, with Noah A. Smith

    Jan 7, 2019·38m
  69. 69

    76 - Increasing In-Class Similarity by Retrofitting Embeddings with Demographics, with Dirk Hovy

    Nov 27, 2018·30m
  70. 70

    75 - Reinforcement / Imitation Learning in NLP, with Hal Daumé III

    Nov 21, 2018·44m
  71. 71

    74 - Deep Reinforcement Learning Doesn't Work Yet, with Alex Irpan

    Nov 16, 2018·41m
  72. 72

    73 - Supersense Disambiguation of English Prepositions and Possessives, with Nathan Schneider

    Nov 13, 2018·53m
  73. 73

    72 - The Anatomy Question Answering Task, with Jordan Boyd-Graber

    Oct 16, 2018·43m
  74. 74

    71 - DuoRC: Complex Language Understanding with Paraphrased Reading Comprehension, with Amrita Saha

    Oct 12, 2018·34m
  75. 75

    70 - Measuring the Evolution of a Scientific Field through Citation Frames, with David Jurgens

    Sep 18, 2018·41m
  76. 76

    69 - Second language acquisition modeling, with Burr Settles

    Sep 10, 2018·35m
  77. 77

    68 - Neural models of factuality, with Rachel Rudinger

    Sep 4, 2018·37m
  78. 78

    67 - GLUE: A Multi-Task Benchmark and Analysis Platform, with Sam Bowman

    Aug 27, 2018·39m
  79. 79

    66 - Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods, with Jieyu Zhao

    Aug 20, 2018·26m
  80. 80

    65 - Event Representations with Tensor-based Compositions, with Niranjan Balasubramanian

    Aug 13, 2018·39m
  81. 81

    64 - Neural Network Models for Sentence Pair Tasks, with Wuwei Lan and Wei Xu

    Aug 8, 2018·36m
  82. 82

    63 - Neural Lattice Language Models, with Jacob Buckman

    Aug 2, 2018·30m
  83. 83

    62 - Sounding Board: A User-Centric and Content-Driven Social Chatbot, with Hao Fang

    Jul 30, 2018·31m
  84. 84

    61 - Neural Text Generation in Stories, with Elizabeth Clark and Yangfeng Ji

    Jul 23, 2018·31m
  85. 85

    60 - FEVER: a large-scale dataset for Fact Extraction and VERification, with James Thorne

    Jun 28, 2018·29m
  86. 86

    59 - Weakly Supervised Semantic Parsing With Abstract Examples, with Omer Goldman

    Jun 12, 2018·35m
  87. 87

    58 - Learning What’s Easy: Fully Differentiable Neural Easy-First Taggers, with André Martins

    Jun 8, 2018·47m
  88. 88

    57 - A Survey Of Cross-lingual Word Embedding Models, with Sebastian Ruder

    Jun 5, 2018·32m
  89. 89

    56 - Deep contextualized word representations, with Matthew Peters

    Apr 4, 2018·30m
  90. 90

    55 - Matchbox: Dispatch-driven autobatching for imperative deep learning, with James Bradbury

    Mar 28, 2018·32m
  91. 91

    54 - Simulating Action Dynamics with Neural Process Networks, with Antoine Bosselut

    Mar 26, 2018·36m
  92. 92

    53 - Classical Structured Prediction Losses for Sequence to Sequence Learning, with Sergey and Myle

    Mar 21, 2018·27m
  93. 93

    52 - Sequence-to-Sequence Learning as Beam-Search Optimization, with Sam Wiseman

    Mar 15, 2018·23m
  94. 94

    51 - A Regularized Framework for Sparse and Structured Neural Attention, with Vlad Niculae

    Mar 12, 2018·17m
  95. 95

    50 - Cardinal Virtues: Extracting Relation Cardinalities from Text, with Paramita Mirza

    Feb 14, 2018·27m
  96. 96

    49 - A Joint Sequential and Relational Model for Frame-Semantic Parsing, with Bishan Yang

    Feb 5, 2018·27m
  97. 97

    48 - Incidental Supervision: Moving Beyond Supervised Learning, with Dan Roth

    Jan 29, 2018·28m
  98. 98

    47 - Dynamic integration of background knowledge in neural NLU systems, with Dirk Weißenborn

    Jan 24, 2018·36m
  99. 99

    46 - Parsing with Traces, with Jonathan Kummerfeld

    Jan 8, 2018·39m
  100. 100

    45 - Build It, Break It workshop, with Allyson Ettinger and Sudha Rao

    Jan 2, 2018·38m
  101. 101

    44 - Truly Low Resource NLP, with Anders Søgaard

    Dec 7, 2017·48m
  102. 102

    43 - Reinforced Video Captioning with Entailment Rewards, with Ramakanth and Mohit

    Dec 4, 2017·48m
  103. 103

    42 - Generating Sentences by Editing Prototypes, with Kelvin Guu

    Nov 30, 2017·39m
  104. 104

    41 - Cross-Sentence N-ary Relation Extraction with Graph LSTMs, with Nanyun (Violet) Peng

    Nov 10, 2017·35m
  105. 105

    40 - On the State of the Art of Evaluation in Neural Language Models, with Gábor Melis

    Nov 7, 2017·30m
  106. 106

    39 - Organizing the SemEval task on scientific information extraction, with Isabelle Augenstein

    Nov 1, 2017·32m
  107. 107

    38 - A Corpus of Natural Language for Visual Reasoning, with Alane Suhr

    Oct 30, 2017·23m
  108. 108

    37 - On Statistical Significance, Training Variance, and Why Reporting Score Distributions Matters

    Oct 24, 2017·13m
  109. 109

    36 - Attention Is All You Need, with Ashish Vaswani and Jakob Uszkoreit

    Oct 23, 2017·41m
  110. 110

    35 - Replicability Analysis for Natural Language Processing, with Roi Reichart

    Oct 19, 2017·31m
  111. 111

    34 - Translating Neuralese, with Jacob Andreas

    Oct 17, 2017·32m
  112. 112

    33 - Entity Linking via Joint Encoding of Types, Descriptions, and Context, with Nitish Gupta

    Oct 16, 2017·24m
  113. 113

    32 - The Effect of Different Writing Tasks on Linguistic Style, with Roy Schwartz

    Oct 10, 2017·24m
  114. 114

    31 - Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling

    Oct 6, 2017·11m
  115. 115

    30 - Probabilistic Typology: Deep Generative Models of Vowel Inventories

    Oct 5, 2017·31m
  116. 116

    29 - Neural machine translation via binary code prediction, with Graham Neubig

    Jul 14, 2017·38m
  117. 117

    28 - Data Programming: Creating Large Training Sets, Quickly

    Jul 11, 2017·25m
  118. 118

    27 - What do Neural Machine Translation Models Learn about Morphology?, with Yonatan Belinkov

    Jul 5, 2017·29m
  119. 119

    26 - Structured Attention Networks, with Yoon Kim

    Jun 30, 2017·26m
  120. 120

    25 - Neural Semantic Parsing over Multiple Knowledge-bases

    Jun 28, 2017·11m
  121. 121

    24 - Improving Hypernymy Detection with an Integrated Path-based and Distributional Method

    Jun 27, 2017·17m
  122. 122

    23 - Get To The Point: Summarization with Pointer-Generator Networks

    Jun 26, 2017·17m
  123. 123

    22 - Deep Multitask Learning for Semantic Dependency Parsing, with Noah Smith

    Jun 16, 2017·31m
  124. 124

    21 - Contextual Explanation Networks, with Maruan Al-Shedivat

    Jun 15, 2017·19m
  125. 125

    20 - A simple neural network module for relational reasoning

    Jun 14, 2017·18m
  126. 126

    19 - End-to-end Differentiable Proving, with Tim Rocktäschel

    Jun 12, 2017·26m
  127. 127

    18 - Generalizing to Unseen Entities and Entity Pairs with Row-less Universal Schema

    Jun 9, 2017·10m
  128. 128

    17 - pix2code: Generating Code from a Graphical User Interface Screenshot

    Jun 8, 2017·13m
  129. 129

    16 - Arc-swift: A Novel Transition System for Dependency Parsing

    Jun 7, 2017·11m
  130. 130

    15 - Attention and Augmented Recurrent Neural Networks

    Jun 6, 2017·14m
  131. 131

    14 - Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning

    Jun 5, 2017·8m
  132. 132

    13 - Question Answering from Unstructured Text by Retrieval and Comprehension

    Jun 2, 2017·23m
  133. 133

    12 - Supervised Learning of Universal Sentence Representations from Natural Language Inference Data

    Jun 1, 2017·20m
  134. 134

    11 - Relation Extraction with Matrix Factorization and Universal Schemas

    May 29, 2017·16m
  135. 135

    10 - A Syntactic Neural Model for General-Purpose Code Generation

    May 26, 2017·16m
  136. 136

    09 - Learning to Generate Reviews and Discovering Sentiment

    May 25, 2017·12m
  137. 137

    08 - Finding News Citations for Wikipedia

    May 24, 2017·13m
  138. 138

    07 - Capturing Semantic Similarity for Entity Linking with Convolutional Neural Networks

    May 23, 2017·14m
  139. 139

    06 - Design Challenges for Entity Linking

    May 22, 2017·13m
  140. 140

    05 - Transition-Based Dependency Parsing with Stack Long Short-Term Memory

    May 19, 2017·10m
  141. 141

    04 - Recurrent Neural Network Grammars, with Chris Dyer

    May 12, 2017·25m
  142. 142

    00 - Intro to the podcast

    May 12, 2017·3m
  143. 143

    03 - FastQA: A Simple and Efficient Neural Architecture for Question Answering

    May 12, 2017·9m
  144. 144

    02 - Bidirectional Attention Flow for Machine Comprehension

    May 12, 2017·14m
  145. 145

    01 - A Comparative Study of Word Embeddings for Reading Comprehension

    May 12, 2017·9m