Skip to content
This repository has been archived by the owner on Jun 25, 2024. It is now read-only.

Add flag to Get-DatabricksClusters for excluding "Job clusters" #155

Open
dsu4rez opened this issue Nov 13, 2020 · 1 comment
Open

Add flag to Get-DatabricksClusters for excluding "Job clusters" #155

dsu4rez opened this issue Nov 13, 2020 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@dsu4rez
Copy link
Contributor

dsu4rez commented Nov 13, 2020

We had an issue in my organization after doing some experimenting about running notebooks on Job Clusters from Data Facotry. We tried to deploy all clusters to another Databricks Workspace, and the process crashed since those Job Clusters were linked to a non-existing Cluster Pool in the target environment.

We never though that Get-DatabricksClusters will retrieve also "Job Clusters", since they are created on the spot by Data Factory and there is no way to delete them from the UI, getting the impression that "Job Clusters" section was just a "history" of job clusters used before.

I think it would be a nice addition to the module to add a flag "-ExcludeJobClusters" to the "Get-DatabricksClusters" function, to solve this issue and create some awareness to users and avoid problems.

The implementation would be super easy since it only requires a filtering of the retrieved clusters before returning them.

@simondmorias simondmorias self-assigned this Nov 18, 2020
@simondmorias simondmorias added the enhancement New feature or request label Nov 18, 2020
@simondmorias
Copy link
Member

Makes sense - I will take a look.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants