The Thesis Review

48 episodes listed below

Listen to the show on

Researchers revisit their PhD theses and trace what changed since.

The gist

Researchers go back through their PhD theses with host Sean, then carry the ideas forward into current work on language models, machine translation, formal verification and large-scale training systems. The questions stay technical but leave room for how each guest got there, and several episodes end with advice for new PhD students.

PRESS PLAY

Find your next episode

All episodes

About The Thesis Review

The Thesis Review picks an unusual starting point for a research interview. Instead of a guest's newest paper, the anchor is their PhD thesis. Sean, the host, treats that document as a fixed point and traces the line forward: what the guest set out to do, what the field did next, and what still holds. In some introductions he describes himself as a postdoctoral researcher at the University of Washington working on machine learning methods for generating and reasoning with natural language. That shows in the questions, which are specific and technical but give the guest room to tell how the work came about. The guest list reaches across computer science. Tianqi Chen, introduced as a pioneer where machine learning meets systems, recalls building an open-source framework around computational graphs, automatic differentiation and CUDA acceleration, and the work of scaling training to more devices. Niloofar Mireshghallah, a postdoctoral scholar at the University of Washington, takes up privacy and safety in large language models, including a 2020 paper by Nicholas Carlini and collaborators that extracted full sequences from GPT-2 by sampling heavily and re-ranking the results. Yulia Tsvetkov describes multilingual NLP moving from a few good translation systems for major languages toward dialects, language varieties and translation built for a particular population. Hady Elsahar credits prompting with turning language models from sentence completers into tools that can answer questions and do math. Swarat Chaudhuri argues that a neural network is a low-level program embedded in human-written code, which brings formal methods and property specification into play for systems like self-driving cars. The episode names alone show the spread, from 'Learning to Map Sentences to Logical Form' to 'Linguistic Knowledge in Data-Driven NLP' to 'Logics and Algorithms for Software Model Checking'. Comparing then with now is what holds each conversation together. Luke Zettlemoyer says dialogue drove the final part of his thesis even though, by his account, he wrote few if any papers on it, and that what context means for language understanding is still wide open. Tsvetkov admits she had to refresh her memory of her own dissertation. Mireshghallah says that talking about her work lets her step outside it and see it from a new angle, a remark Sean calls the thesis of the show itself. The mood is friendly. Sean tells Elsahar he is a big fan of his work and hears the same line back. Several episodes end on advice for people starting a PhD. Chen's version is that five years is long enough to try something bold. Zettlemoyer's is to think about how to be different and have an impact others could not, and Sean notes that no two researchers have answered the same way.

Made for: Suits a listener who follows machine learning and NLP research and wants the story behind a researcher's current work, starting from the dissertation. It also fits someone in a PhD, or weighing one, who wants to hear researchers look back on theirs and offer advice.

What sets it apart: Rather than starting from a guest's latest result, it anchors each conversation to the guest's PhD thesis and measures the present against it. Comparing then with now makes each interview a record of which ideas held up and which shifted.

In their own words

Each episode of The Thesis Review is a conversation centered around a researcher's PhD thesis, giving insight into their history, revisiting older ideas, and providing a valuable perspective on how their research has evolved (or stayed the same) since.

Why you'd press play

Sean Willick brings a PhD thesis back to its author; you hear which questions survived.

Press play if you want

  • to see how a language model can reveal text from its training data
  • to hear why an almost-right proof still fails to type-check
Read the full recommendation in PlayNext →
PhD theses revisitedmachine learning systems and frameworksprivacy and safety in large language modelsmultilingual NLP and machine translationprompting and controlling language modelsformal methods and neural networkshow research directions evolveadvice for PhD students

Talks about

Best episodes of The Thesis Review

Short reviews from the PlayNext desk, based on the episodes we processed.

[48] Tianqi Chen - Scalable and Intelligent Learning SystemsOct 28, 2024

A focused technical history of XGBoost, MXNet, and TVM, grounded by a case for bold PhD work.

Tianqi Chen's PhD work gives this episode a clean path through one of machine learning's less glamorous but central problems: making training and deployment efficient enough to scale.

[46] Yulia Tsvetkov - Linguistic Knowledge in Data-Driven NLPAug 12, 2023

A thesis-led discussion of multilingual NLP, adaptive translation, and research goals anchored in curiosity.

Yulia Svedkov's PhD thesis gives the episode its through line, as the University of Washington computer science professor revisits the point where linguistics and data-driven NLP meet.

[45] Luke Zettlemoyer - Learning to Map Sentences to Logical FormJul 25, 2023

A thesis on logical form opens into a broader conversation about context, language models, and research choices.

Luke Settlemoyer's PhD thesis, Learning to Map Sentences to Logical Form, gives The Thesis Review a clean bridge from semantic parsing to today's language-model questions.

[44] Hady Elsahar - NLG from Structured Knowledge Bases (& Controlling LMs)Aug 23, 2022

A clear research-led episode that keeps prompting's usefulness and its selection bias in view.

Hady El-Sahar's route from a 2019 PhD on natural language and structured knowledge bases to controlled language generation gives the episode a clear technical backbone.

Podcasts like The Thesis Review

Episodes

  1. 1

    [48] Tianqi Chen - Scalable and Intelligent Learning Systems

    Tianqi Chen says a six-month CUDA attempt to train an ImageNet model in his master's work pushed him toward machine learning systems, not just modeling.

    Oct 28, 2024·46m·3 clips
  2. 2

    [47] Niloofar Mireshghallah - Auditing and Mitigating Safety Risks in Large Language Models

    Hidden gem

    The Thesis Review episode with Sean Wellick centers on Niloufar Mireshghallah's UC San Diego PhD work on auditing and mitigating safety risks in large language models.

    Oct 15, 2024·1h 17m·5 clips
  3. 3

    [46] Yulia Tsvetkov - Linguistic Knowledge in Data-Driven NLP

    Hidden gem

    ["Yulia Svedkov's 2016 CMU thesis, \"Linguistic Knowledge in Data-Driven Natural Language Processing,\" sits at the center of a Thesis Review interview recorded in late 2022.", "Sean Wellick talks with her about moving from software work in Israel into NLP research and later into the University of Washington Allen School.", "She describes a Swahili machine-translation problem with almost no resources, Arabic influence on Swahili, and lexical borrowing as a bridge when bilingual dictionaries were missing.", "She also discusses polyglot language models, computational ethics, controllable generation, and why static pre-trained models and narrow labels miss important problems."]

    Aug 12, 2023·1h·4 clips
  4. 4

    [45] Luke Zettlemoyer - Learning to Map Sentences to Logical Form

    Hidden gem

    Sean Whalick interviews Luke Settlemoyer about his thesis, Learning to Map Sentences to Logical Form, and frames the conversation around how a University of Washington professor and Meta researcher moved from semantic parsing to large language models.

    Jul 25, 2023·1h·5 clips
  5. 5

    [44] Hady Elsahar - NLG from Structured Knowledge Bases (& Controlling LMs)

    Hidden gem

    Hady El-Sahar argues that prompting is useful but noisy, and he contrasts it with distributional control for language models.

    Aug 23, 2022·1h 6m·4 clips
  6. 6

    [43] Swarat Chaudhuri - Logics and Algorithms for Software Model Checking

    Hidden gem

    Sean Willick interviews Swarat Choudhury, an associate professor at the University of Texas, about his 2007 University of Pennsylvania thesis, Logics and Algorithms for Software Model Checking.

    Jun 28, 2022·1h 6m·4 clips
  7. 7

    [42] Charles Sutton - Efficient Training Methods for Conditional Random Fields

    The Thesis Review host Sean Willick interviews Charles Sutton about his 2008 UMass Amherst PhD thesis, Efficient Training Methods for Conditional Random Fields.

    Apr 19, 2022·1h 18m·5 clips
  8. 8

    [41] Talia Ringer - Proof Repair

    Hidden gem

    The Thesis Review's [41] Talia Ringer - Proof Repair examines Ringer's 2021 University of Washington PhD thesis on maintaining proofs when verified software changes.

    Mar 30, 2022·1h 19m·5 clips
  9. 9

    [40] Lisa Lee - Learning Embodied Agents with Scalably-Supervised RL

    Hidden gem

    The Thesis Review’s episode with Lisa Lee examines her 2021 Carnegie Mellon thesis, Learning Embodied Agents with Scalably Supervised Reinforcement Learning.

    Mar 9, 2022·47m·3 clips
  10. 10

    [39] Burr Settles - Curious Machines: Active Learning with Structured Instances

    Hidden gem

    Sean Willick interviews Burr Settles about his 2008 University of Wisconsin-Madison thesis, Curious Machines: Active Learning with Structured Instances, and his research leadership at Duolingo.

    Feb 2, 2022·1h 7m·4 clips
  11. 11

    [38] Andrew Lampinen - A Computational Framework for Learning and Transforming Task Representations

    Jan 8, 2022·1h 5m
  12. 12

    [37] Joonkoo Park - Neural Substrates of Visual Word and Number Processing

    Dec 21, 2021·1h 9m
  13. 13

    [36] Dieuwke Hupkes - Hierarchy and Interpretability in Neural Models of Language Processing

    Nov 30, 2021·1h 2m
  14. 14

    [35] Armando Solar-Lezama - Program Synthesis by Sketching

    Nov 6, 2021·1h 16m
  15. 15

    [34] Sasha Rush - Lagrangian Relaxation for Natural Language Decoding

    Oct 20, 2021·1h 8m
  16. 16

    [33] Michael R. Douglas - G/H Conformal Field Theory

    Oct 1, 2021·1h 13m
  17. 17

    [32] Andre Martins - The Geometry of Constrained Structured Prediction

    Sep 16, 2021·1h 27m
  18. 18

    [31] Jay McClelland - Preliminary Letter Identification in the Perception of Words and Nonwords

    Aug 29, 2021·1h 34m
  19. 19

    [30] Dustin Tran - Probabilistic Programming for Deep Learning

    Aug 14, 2021·1h 3m
  20. 20

    [29] Tengyu Ma - Non-convex Optimization for Machine Learning

    Aug 1, 2021·1h 17m
  21. 21

    [28] Karen Ullrich - A Coding Perspective on Deep Latent Variable Models

    Jul 16, 2021·1h 6m
  22. 22

    [27] Danqi Chen - Neural Reading Comprehension and Beyond

    Jul 2, 2021·56m
  23. 23

    [26] Kevin Ellis - Algorithms for Learning to Induce Programs

    May 29, 2021·1h 18m
  24. 24

    [25] Tomas Mikolov - Statistical Language Models Based on Neural Networks

    May 14, 2021·1h 19m
  25. 25

    [24] Martin Arjovsky - Out of Distribution Generalization in Machine Learning

    Host Sean Wellick interviews Martin Arjovsky about his PhD thesis on out-of-distribution generalization in machine learning, covering his research journey and key contributions like Wasserstein GAN and invariant risk minimization.

    Apr 30, 2021·1h 3m
  26. 26

    [23] Simon Du - Gradient Descent for Non-convex Problems in Modern Machine Learning

    Apr 16, 2021·1h 7m
  27. 27

    [22] Graham Neubig - Unsupervised Learning of Lexical Information

    Apr 2, 2021·1h 3m
  28. 28

    [21] Michela Paganini - Machine Learning Solutions for High Energy Physics

    Mar 19, 2021·1h 8m
  29. 29

    [20] Josef Urban - Deductive and Inductive Reasoning in Large Libraries of Formalized Mathematics

    Mar 5, 2021·1h 25m
  30. 30

    [19] Dumitru Erhan - Understanding Deep Architectures and the Effect of Unsupervised Pretraining

    Feb 19, 2021·1h 20m
  31. 31

    [18] Eero Simoncelli - Distributed Representation and Analysis of Visual Motion

    Feb 5, 2021·1h 26m
  32. 32

    [17] Paul Middlebrooks - Neuronal Correlates of Meta-Cognition in Primate Frontal Cortex

    Jan 22, 2021·1h 36m
  33. 33

    [16] Aaron Courville - A Latent Cause Theory of Classical Conditioning

    Jan 8, 2021·1h 19m
  34. 34

    [15] Christian Szegedy - Some Applications of the Weighted Combinatorial Laplacian

    Dec 22, 2020·1h 7m
  35. 35

    [14] Been Kim - Interactive and Interpretable Machine Learning Models

    Dec 10, 2020·1h 4m
  36. 36

    [13] Adji Bousso Dieng - Deep Probabilistic Graphical Modeling

    Nov 26, 2020·1h 8m
  37. 37

    [12] Martha White - Regularized Factor Models

    Nov 12, 2020·1h 9m
  38. 38

    [11] Jacob Andreas - Learning from Language

    Oct 29, 2020·1h 20m
  39. 39

    [10] Chelsea Finn - Learning to Learn with Gradients

    Host Sean Wellick interviews Chelsea Finn about her PhD thesis on meta-learning and the MAML algorithm for robot learning.

    Oct 15, 2020·52m
  40. 40

    [09] Kenneth Stanley - Efficient Evolution of Neural Networks through Complexification

    Oct 1, 2020·1h 21m
  41. 41

    [08] He He - Sequential Decisions and Predictions in NLP

    Sep 25, 2020·1h 1m
  42. 42

    [07] John Schulman - Optimizing Expectations: From Deep RL to Stochastic Computation Graphs

    Sep 11, 2020·1h 4m
  43. 43

    [06] Yoon Kim - Deep Latent Variable Models of Natural Language

    Aug 28, 2020·1h 6m
  44. 44

    [05] Julian Togelius - Computational Intelligence and Games

    Aug 14, 2020·1h 12m
  45. 45

    [04] Sebastian Nowozin - Learning with Structured Data: Applications to Computer Vision

    Jul 31, 2020·1h 45m
  46. 46

    [03] Sebastian Ruder - Neural Transfer Learning for Natural Language Processing

    Jul 17, 2020·1h 25m
  47. 47

    [02] Colin Raffel - Learning-Based Methods for Comparing Sequences

    Jul 3, 2020·1h 16m
  48. 48

    [01] Gus Xia - Expressive Collaborative Music Performance via Machine Learning

    Jun 18, 2020·58m