Zhipu AI releases the bilingual ChatGLM-130B
Zhipu AI releases a 130-billion-parameter dialogue model built for Chinese and English, establishing the first generation of the ChatGLM line.
EVENT ARCHIVE
Events
Browse published English reports with original sources and content provenance.
AI-generated
Google Research announces Imagen
Google Research announces Imagen, a text-to-image diffusion model focused on photorealism and language understanding; its code and public demo were not released at launch.
Meta releases the OPT family with restricted access to OPT-175B
Meta releases the 125M-to-175B OPT family; smaller checkpoints and code are available, while OPT-175B is limited to approved noncommercial research access.
DeepMind introduces the Flamingo visual language model
DeepMind introduced Flamingo, an 80-billion-parameter visual language model that used a few examples to handle image, video, and text tasks.
EleutherAI releases GPT-NeoX
EleutherAI scales an open foundation model to the 20-billion-parameter range.
OpenAI introduces DALL·E 2 in a limited research preview
OpenAI introduces DALL·E 2, built around CLIP image embeddings and a diffusion decoder, and initially opens it only to a small group of invited users.
Google publishes the 540B-parameter PaLM
Google presents a 540B-parameter dense language model trained with Pathways; the initial release is a research disclosure, without public weights or a general-purpose API.
DeepMind introduces the competitive programming system AlphaCode
DeepMind introduced the code-generation system AlphaCode, which performed at about the median level of participants in Codeforces competitions.
Google publishes the LaMDA research paper
The paper documents LaMDA as a dialogue-focused model family with up to 137B parameters and examines response quality, safety and factual grounding.
DeepMind introduces the 280-billion-parameter Gopher language model
DeepMind introduced Gopher, a 280-billion-parameter language model, and published research on its capabilities, limitations, and risks without releasing public weights or an API.
OpenAI releases Codex
OpenAI releases a code-generation model fine-tuned from GPT-3 and used in the early GitHub Copilot.
AI21 Labs launches Jurassic-1
AI21 Labs launched the Jurassic-1 language model family and opened its API and web interface through the AI21 Studio open beta.
EleutherAI releases GPT-J
EleutherAI releases an early open 6-billion-parameter model that sees broad academic use.
Google first introduces LaMDA
Google introduces LaMDA for open-domain dialogue at I/O 2021; the model remains an internal research system without public weights or a general-purpose API.
EleutherAI releases GPT-Neo
EleutherAI releases an early open alternative to GPT-3.
Google publishes Switch Transformer, scaling a sparse model to 1.6T parameters
Switch Transformer routed each token to a single expert, scaling total sparse parameters to about 1.6 trillion without activating the full model for every token.
OpenAI introduces the 12B text-to-image model DALL·E
OpenAI introduces DALL·E, a 12B autoregressive Transformer that models text and discrete image tokens as one sequence.
OpenAI releases the CLIP vision-language model
OpenAI released CLIP, a vision-language model trained with natural-language supervision, together with its paper, code, and pretrained models.
Meta publishes BART research and pretrained models
Meta published the BART denoising sequence-to-sequence model and made code and pretrained weights available through fairseq.
GShard paper demonstrates a sparse-expert translation model with more than 600B parameters
Google researchers introduce GShard automatic sharding and use it to train a multilingual translation MoE with more than 600B total parameters on 2,048 TPU v3 accelerators.