Skip to main content

Concepts

This page describes the top-level Anyscale concepts that you see when logging into the console.

Cloud

A defined deployment area in your AWS accounts or GCP projects where you can launch Ray clusters.

Anyscale supports multi-cloud setup and your organization can choose to deploy multiple Clouds in one cloud provider or across different cloud providers. View architecture for more details about how Anyscale Clouds are deployed.

Accounts and Organizations

An Anyscale Account represents an organization where administrators can manage users, credentials, billing, and other top level configurations.

Workspaces

Workspaces are fully managed development environments that let you program the cluster by using familiar tools like Visual Studio Code or JupyterLab Notebooks. They give you auto-scaling compute resources, friendly package distribution, and seamless code-test-debug experience in the Anyscale cloud.

Jobs

Discrete batch operations managed by Anyscale and running in their own Ray clusters with full cluster lifecycle management, retry capabilities, alerting, and scheduling.

Services

Anyscale Services serve your models behind endpoints in a high-available manner with support for zero downtime upgrade, performance monitoring, alerting, etc.

Clusters

Anyscale Clusters are managed Ray clusters started by Anyscale for your Workspaces, Jobs, and Services. You can also manually create and interact directly with them.

Compute Configs

Compute Configs specify the hardware settings of your cluster, including but not limited to Anyscale Cloud, node types, autoscaling configurations, etc.

Cluster Environments

Cluster Environments specify the software dependencies of your cluster, including but not limited to base images, environment variables, pip dependencies, etc. They can be built on top of the Anyscale-supplied base images or your own docker.

Projects

Anyscale projects provide a way to organize your Workspaces, Jobs, Services, as well as underlying clusters and may be either private or shared with your organization via access controls.

If a Project is not specified, resources are created without a Project and accessible to all the users of that Cloud.

Interfaces

Throughout this documentation, you'll see references to the four interfaces that Anyscale supports:

  • A Web UI, accessible at console.anyscale.com,
  • A CLI, which can be installed via pip install anyscale,
  • A Python SDK, which will also be installed with pip install anyscale, and
  • An HTTP API, which can be used for programmatic access in any language.