Skip to main content
Version: Latest

Chat: codellama/CodeLlama-70b-Instruct-hf

Check your docs version

These docs are for the new Anyscale design. If you started using Anyscale before April 2024, use Version 1.0.0 of the docs. If you're transitioning to Anyscale Preview, see the guide for how to migrate.

::⚠️ DEPRECATED - This model will be removed in favor of the Llama 3 family of models starting May 28th. See the Hugging Face model page for more model details. :::

About this model​

Model name to use in API calls:

codellama/CodeLlama-70b-Instruct-hf

Code Llama is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. This is the 70B parameter version, fine tuned for instructions. This model is useful for general code synthesis and understanding. Links to other models are in the index at the bottom.

Model Developers: Meta

Variations: Code Llama comes in four model sizes (7B, 13B, 34B, 70B), and three variants:

  • Code Llama: base models designed for general code synthesis and understanding
  • Code Llama - Python: designed specifically for Python
  • Code Llama - Instruct: for instruction following and safer deployment

Input Models: input text only.

Output Models: generate text only.

Model Architecture: Code Llama is an auto-regressive language model that uses an optimized transformer architecture.

Context Length: 4096

Model Dates: Code Llama and its variants completed training between January 2023 and January 2024.

Status: this is a static model trained on an offline dataset.

License: a custom commercial license is available at: https://ai.meta.com/llama/license/

Intended Use Cases: Code Llama and its variants are for commercial and research use in English and relevant programming languages. The base model Code Llama is adaptable for a variety of code synthesis and understanding tasks, Code Llama - Python is specifically for handling the Python programming language, and Code Llama - Instruct has the intention of safer use for code assistant and generation applications.

Out-of-scope Uses: use in any manner that violates applicable laws or regulations, including trade compliance laws. Use in languages other than English. Use in any other way that's prohibited by the Acceptable Use Policy and Licensing Agreement for Code Llama.