Mistral AI
July 18, 2024 · Read the original
Mistral released Mistral NeMo, a 12B model built in collaboration with NVIDIA, with a context window of up to 128k tokens. Pre-trained base and instruction-tuned checkpoints are released under the Apache 2.0 license, and the model was trained with quantisation awareness to enable FP8 inference without performance loss. Mistral NeMo uses a new tokenizer called Tekken, based on Tiktoken and trained on more than 100 languages, which the company says compresses source code and several languages more efficiently than the SentencePiece tokenizer used in previous Mistral models. The model is exposed on la Plateforme as open-mistral-nemo-2407 and is packaged as an NVIDIA NIM inference microservice available from ai.nvidia.com.
Written from the article itself at capture time and checked against it before publication: every number and every name in it comes from the source. It is our summary, not the lab’s wording — the original is linked above.
The announcement says what the lab claims. The record says what was measured, by whom, and whether anyone reproduced it. Read both before believing either.