Data classification
Check your docs version
These docs are for the new Anyscale design. If you started using Anyscale before April 2024, use Version 1.0.0 of the docs. If you're transitioning to Anyscale Preview, see the guide for how to migrate.
| Name | Description | Examples (not exhaustive) | Location |
|---|---|---|---|
| Application logs and customer data (stored locally on the cluster) | Unstructured application data or semi-structured application data generated by customer code. Customer data refers to the data that customers use. | Ray Core, Ray Tune logs, session command jobs, job logs, driver and worker logs | Customer Data Plane |
| Ingested application logs (used to enable log viewer feature) | Structured application logs generated by customer code and by Ray. The log ingestion is opted-in by default for Anyscale Hosted clouds and clouds created through anyscale cloud setup CLI. For clouds created using anyscale cloud register CLI, you must opt-in to the log viewer feature using anyscale cloud config update. | Ray jobs and services logs in log viewer. | Anyscale Control Plane |
| System Logs | Unstructured or semi-structured system data generated by executing Ray or Anyscale components or processes | Autoscaler, GCS, other system logs | Anyscale Control Plane |
| Observability metrics (Grafana or Ray dashboard metrics) | Structured data that contains selected KPI’s of the system | CPU or Disk utilization, Memory | Anyscale Control Plane |
| Metadata | Structured data that describes other data in the system | Start time, stop time, Cloud name, Entry point, YAML file | Anyscale Control Plane |
| Runtime environment metadata | List of dependencies that the application needs to run. Anyscale stores the definitions to understand what to install dynamically. | Filenames, packages, module names, working directory, environment variables | Anyscale Control Plane |
| User actions | Actions performed by users against Anyscale | Login or logout, creating a organization or project, clusters, archiving a job or service, etc. | Anyscale Control Plane |