Feature Request - Complete Deployment of Code to a Workspace

[jontreynes]

As part of this method,
https://github.com/DataThirstLtd/azure.databricks.cicd.tools/blob/d7c765f3cec50a019d9b3e64822cc854f547cf71/Public/Import-DatabricksFolder.ps1,

there should be a flag to run a complete deployment rather than just incremental or clean.

By complete, I mean, run an incremental deploy, and delete the workspace notebooks that do not exist from the local import. Whereas clean simply deletes all workspace notebooks and imports all local imports which is a costly procedure when importing many notebooks during a CICD process.

This may not be as simply as triggering a flag in the databricks api. Instead, one could first write a list-all module that lists all the notebooks in a given workspace using
https://docs.microsoft.com/en-us/azure/databricks/dev-tools/api/latest/workspace#--list

. The output of this method could be used to diff the local notebooks to see which should be deleted. The final logic to run for a "complete" deployment would be to use the import api method already seen in import-databricksfolder.ps1