Skip to main content
Version: Canary 🐤

Authenticate

Changes to Anyscale Endpoints API

Effective August 1, 2024 Anyscale Endpoints API will be available exclusively through the fully Hosted Anyscale Platform. Multi-tenant access to LLM models will be removed.

With the Hosted Anyscale Platform, you can access the latest GPUs billed by the second, and deploy models on your own dedicated instances. Enjoy full customization to build your end-to-end applications with Anyscale. Get started today.

Locate your API key​

Once you have finished the account and billing setup, you can generate your API key on the Credentials page under your account.

Use your API key​

When calling the Anyscale Endpoints APIs, you must attach your API key as the bearer token as part of the request. For example:

export ANYSCALE_API_KEY=<YOUR_ANYSCALE_ENDPOINT_API_KEY>
curl https://api.endpoints.anyscale.com/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $ANYSCALE_API_KEY" \
  -d '{
     "model": "meta-llama/Meta-Llama-3-8B-Instruct",
     "messages": [{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Hello!"}],
     "temperature": 0.7
   }'

Manage your API keys​

You can revoke API keys on the Credentials page.