This repository has been archived by the owner on Jun 25, 2024. It is now read-only.
Add flag to Get-DatabricksClusters for excluding "Job clusters" #155
Labels
enhancement
New feature or request
We had an issue in my organization after doing some experimenting about running notebooks on Job Clusters from Data Facotry. We tried to deploy all clusters to another Databricks Workspace, and the process crashed since those Job Clusters were linked to a non-existing Cluster Pool in the target environment.
We never though that Get-DatabricksClusters will retrieve also "Job Clusters", since they are created on the spot by Data Factory and there is no way to delete them from the UI, getting the impression that "Job Clusters" section was just a "history" of job clusters used before.
I think it would be a nice addition to the module to add a flag "-ExcludeJobClusters" to the "Get-DatabricksClusters" function, to solve this issue and create some awareness to users and avoid problems.
The implementation would be super easy since it only requires a filtering of the retrieved clusters before returning them.
The text was updated successfully, but these errors were encountered: