Join us for our inaugural online journal club. In this session, we will discuss together Meta AI’s work on Large Concept Models [1]. Our team from Tübingen AI Center will host and lead the discussion. The session is open to all and free of charge. We encourage you to read the paper before joining, but it’s not a strict requirement. If you have specific questions that you want to have discussed during the session, send them to minerva@tuebingen.ai.

Large Concept Models are Meta AI’s suggestion how to improve reasoning and semantic processing of LLMs by introducing an abstraction layer in the typical LLM architecture that represents higher-level semantic units which they call “concepts”. Concepts are independent of their concrete textual representation and are thus represented using an existing sentence embedding space.  In the session, we will discuss together what all of this means in detail.

Looking forward to see many of you online and diving deep into the research trends.

[1] https://ai.meta.com/research/publications/large-concept-models-language-modeling-in-a-sentence-representation-space/