Difference between revisions of "GPT-3"
Jump to navigation
Jump to search
| (4 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
| − | [[wikipedia:GPT-3]] | + | [[wikipedia:GPT-3]] (Jun 2020) |
[[wikipedia:Generative Pre-trained Transformer 3]] | [[wikipedia:Generative Pre-trained Transformer 3]] | ||
| + | The architecture is a decoder-only [[transformer network]] with a 2048-token-long context and 175 billion [[parameters]], requiring 800GB to store. | ||
| Line 17: | Line 18: | ||
* {{NLP}} | * {{NLP}} | ||
* {{OpenAI}} | * {{OpenAI}} | ||
| + | |||
| + | [[Category:IT]] | ||
Latest revision as of 15:22, 9 April 2023
wikipedia:GPT-3 (Jun 2020)
wikipedia:Generative Pre-trained Transformer 3
The architecture is a decoder-only transformer network with a 2048-token-long context and 175 billion parameters, requiring 800GB to store.
See also[edit]
Advertising:
