NLP Highlights · Allen Institute for Artificial Intelligence

141 - Building an open source LM, with Iz Beltagy and Dirk Groeneveld

·30 min

As heard by us

A clear look at why open-sourcing language models is treated as a research choice.

Open-sourcing language models is treated here as a research question, not a finished product. The conversation with AI2's ALMA leads stays on the choices that shape a model and its release: how to structure the training recipe, where instruction data belongs, whether human…

Read the full review in PlayNext →

Why you'd press play

Hear a special NLP Highlights episode on the decisions behind building and releasing open-sourced language models, with AI2’s ALMA project leads.

Read the full recommendation in PlayNext →
Listen to the show on