NLP Highlights · Allen Institute for Artificial Intelligence
141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld
·30 min
As heard by us
A clear look at why open-sourcing language models is treated as a research choice.
Open-sourcing language models is treated here as a research question, not a finished product. The conversation with AI2's ALMA leads stays on the choices that shape a model and its release: how to structure the training recipe, where instruction data belongs, whether human…
Why you'd press play
Hear a special NLP Highlights episode on the decisions behind building and releasing open-sourced language models, with AI2’s ALMA project leads.
Listen to the show on