Types of Compute in Databricks
All Purpose Compute
Used when you run interactive
Clusters
Policy is
- Unrestricted
- Personal Compute
- Power User Compute
- Shared Compute
- Legacy Shared Compute
- User Defined Compute
Worker type
Permissions for Cluster for users:
- Can Manage
- Can Restart
- Can Attach to
Job Compute
On runtime they are created for automated jobs, ETL Pipeline