Difference between revisions of "Mistral AI"
Jump to navigation
Jump to search
| Line 3: | Line 3: | ||
* [[Arthur Mensch]], [[Timothée Lacroix]] and [[Guillaume Lample]] | * [[Arthur Mensch]], [[Timothée Lacroix]] and [[Guillaume Lample]] | ||
| − | * Products: [[Mistral 7B]], [[Mixtral 8x7B]], [[Mistral Medium]] | + | * Products: |
| + | ** [[Mistral 7B]], [[Mixtral 8x7B]] | ||
| + | ** [[Mistral Small]], [[Mistral Medium]], [[Mistral Large]] | ||
Revision as of 09:20, 10 April 2024
- Products:
Mistral 7B uses Grouped-query attention (GQA) intended for faster inference and Sliding Window Attention (SWA) intended to handle longer sequences
Related
See also
Advertising:
