Skip to main content

Supported Node Types

When launching new clusters, it is possible to specify the instance types to be used for the head node and for worker nodes launched by the autoscaler. The instance types vary depending on the cloud provider availability and nomenclature.

AWS

Bring your own cloud

Anyscale currently supports all of the instance types offered by AWS. In order to specify any AWS instance type, specify the AWS "instance size" (i.e., the name) as referenced in the AWS documentation. Note that availability of instance types may vary by region (refer to the AWS documentation for more details).

GCP

Predefined VMs

Anyscale supports all of the predefined VMs in the following families:

  • N2 (general-purpose) (including N2 standard, N2 high-mem and N2 high-cpu)
  • C2 (compute-optimized)
  • A2 (accelerator-optimized)
note

Only nodes with 8 vCPUs or more are supported (this means that nodes in the N2 and C2 family should end with -8 or greater).

In order to specify any VM from the supported CPU families, specify the GCP "machine type" (i.e., the name) as referenced in the GCP documentation.

Custom VMs

Anyscale incorporates some custom VM configurations to add support for additional GPU accelerator types. These can be specified by using the Anyscale node type from the following table:

Anyscale node typeGCP base typevCPUsMemory (GB)GPU modelGPUs
n1-highmem-4-nvidia-tesla-v100-1n1-highmem-4426nvidia-tesla-v1001
n1-highmem-8-nvidia-tesla-v100-1n1-highmem-8852nvidia-tesla-v1001
n1-highmem-32-nvidia-tesla-v100-4n1-highmem-3232208nvidia-tesla-v1004
n1-highmem-64-nvidia-tesla-v100-8n1-highmem-6464416nvidia-tesla-v1008
n1-highmem-96-nvidia-tesla-v100-8n1-highmem-9696624nvidia-tesla-v1008
n1-standard-4-nvidia-tesla-t4-1n1-standard-4415nvidia-tesla-t41
n1-standard-8-nvidia-tesla-t4-1n1-standard-8830nvidia-tesla-t41
n1-standard-16-nvidia-tesla-t4-1n1-standard-161660nvidia-tesla-t41