DevOps for Databricks Jobs
I am trying to implement DevOps on Databricks.
I have completed devops implementation for databricks notebooks and dbfs files.
I do have many databricks jobs running on my cluster based on schedule. Some of these jobs points to notebook files and few points to jar file in the dbfs location.
Is there any way to implement devops process on the databricks jobs so that any change in any of the jobs will invoke build pipeline and deploy the same in another databricks instance.
First of all I just wanted to know whether it is possible to implement devops on databricks jobs.
Any Leads Appreciated!