Meta releases the OPT family with restricted access to OPT-175B
Meta releases the 125M-to-175B OPT family; smaller checkpoints and code are available, while OPT-175B is limited to approved noncommercial research access.
EVENT ARCHIVE
Events
20 English reports are shown on this page. Refine the keywords, date range, company, or event type below.
AI-assisted · reviewed
DeepMind introduces the Flamingo visual language model
DeepMind introduced Flamingo, an 80-billion-parameter visual language model that used a few examples to handle image, video, and text tasks.
EleutherAI releases GPT-NeoX
EleutherAI scales an open foundation model to the 20-billion-parameter range.
OpenAI introduces DALL·E 2 in a limited research preview
OpenAI introduces DALL·E 2, built around CLIP image embeddings and a diffusion decoder, and initially opens it only to a small group of invited users.
Google publishes the 540B-parameter PaLM
Google presents a 540B-parameter dense language model trained with Pathways; the initial release is a research disclosure, without public weights or a general-purpose API.
Google DeepMind releases Chinchilla
Google DeepMind releases a model and scaling-law result arguing that parameter count and training data should grow in proportion.
DeepMind introduces the competitive programming system AlphaCode
DeepMind introduced the code-generation system AlphaCode, which performed at about the median level of participants in Codeforces competitions.
OpenAI releases InstructGPT
OpenAI releases a model trained with reinforcement learning from human feedback to better follow user intent.
Google publishes the LaMDA research paper
The paper documents LaMDA as a dialogue-focused model family with up to 137B parameters and examines response quality, safety and factual grounding.
DeepMind introduces the 280-billion-parameter Gopher language model
DeepMind introduced Gopher, a 280-billion-parameter language model, and published research on its capabilities, limitations, and risks without releasing public weights or an API.
NVIDIA releases Megatron-Turing NLG
Microsoft and NVIDIA jointly train a 530-billion-parameter dense language model.
OpenAI releases Codex
OpenAI releases a code-generation model fine-tuned from GPT-3 and used in the early GitHub Copilot.
AI21 Labs launches Jurassic-1
AI21 Labs launched the Jurassic-1 language model family and opened its API and web interface through the AI21 Studio open beta.
EleutherAI releases GPT-J
EleutherAI releases an early open 6-billion-parameter model that sees broad academic use.
Google first introduces LaMDA
Google introduces LaMDA for open-domain dialogue at I/O 2021; the model remains an internal research system without public weights or a general-purpose API.
EleutherAI releases GPT-Neo
EleutherAI releases an early open alternative to GPT-3.
Naver releases HyperCLOVA
Naver releases a large language model optimized for Korean.
Google publishes Switch Transformer, scaling a sparse model to 1.6T parameters
Switch Transformer routed each token to a single expert, scaling total sparse parameters to about 1.6 trillion without activating the full model for every token.
OpenAI introduces the 12B text-to-image model DALL·E
OpenAI introduces DALL·E, a 12B autoregressive Transformer that models text and discrete image tokens as one sequence.
OpenAI releases the CLIP vision-language model
OpenAI released CLIP, a vision-language model trained with natural-language supervision, together with its paper, code, and pretrained models.