CLSP Fall Seminar Series: Luca Soldaini

Description

Luca Soldaini, a senior applied research scientist at the Allen Institute for AI, will present a Center for Language and Speech Processing seminar titled "OLMo: Accelerating the Science of Open Language Models."

Abstract:

Recently, we have seen tremendous progress in the field of language models (LMs), with the release of numerous open models and closed API systems. However, fewer and fewer disclose how they are created: Which corpora do they use? How are they trained? How much energy do they consume? In this talk, I will provide an overview of OLMo (https://allenai.org/olmo), an initiative at AI2 aimed at creating transparent artifacts and tools that advance the science of LMs. I will discuss current releases, such as Tulu, Dolma, and OLMo-7b, as well as the goals, ethical, and legal considerations of this initiative, and what's coming next.