Skip to main content
Version: Canary 🐤

Chat: mistralai/Mistral-7B-Instruct-v0.1

Changes to Anyscale Endpoints API

Effective August 1, 2024 Anyscale Endpoints API will be available exclusively through the fully Hosted Anyscale Platform. Multi-tenant access to LLM models will be removed.

With the Hosted Anyscale Platform, you can access the latest GPUs billed by the second, and deploy models on your own dedicated instances. Enjoy full customization to build your end-to-end applications with Anyscale. Get started today.

info

Model supports Function Calling + JSON Mode

About this model

Model name to use in API calls:

mistralai/Mistral-7B-Instruct-v0.1

The Mistral-7B-Instruct-v0.1 Large Language Model (LLM) is a instruct fine-tuned version of the Mistral-7B-v0.1 generative text model using a variety of publicly available conversation datasets. This model supports function calling and JSON mode.

Model Developers: Mistral

Input Models: input text only.

Output Models: generate text only.

Model ArchitectureMistral-7B-v0.1, a transformer model, serves as the base for this instruction model, and it has the following architecture choices:

  • Grouped-Query Attention
  • Sliding-Window Attention
  • Byte-fallback BPE tokenizer

Context Length: 16384

License: Apache 2.0