NVIDIA releases Megatron-Turing NLG
Microsoft and NVIDIA jointly train a 530-billion-parameter dense language model.
ME1 English report
MODEL
Megatron-Turing NLG
- Release date:
- 2021-10-11
- Parameters:
- 530B
- Architecture:
- Autoregressive Transformer
- Legacy modality:
- Text
- Openness:
- Closed-source
- Organization:
- NVIDIA
Official links | Chat | Code Plan | Agent tools | API |
|---|---|---|---|---|
| Global | — | — | — |
Related English reports
English reports linked to this entity will appear here as their translations are published.
AI-assisted · reviewed