I’ve been waiting for this feature for what feels like forever.
Databricks-Connect is here! Well almost - it’s still preview, but the release looks imminent. It allows you to develop using an IDE like VSCode, PyCharm, IntelliJ etc and connect to a remote Databricks cluster to execute the task. Read More
Databricks-Connect is the feature I’ve been waiting for. It is a complete game changer for developing data pipelines - previously you could develop locally using Spark but that meant you couldn’t get all the nice Databricks runtime features - like Delta, DBUtils etc. Read More
A few weeks ago now Databricks added the ability to have Azure Key Vault backed Secret Scopes. These are still in preview. Read More
Last year we released a a PowerShell module called azure.databricks.cicd.tools on GitHub and PowerShell Gallery. What we never did is publish anything about what it can do. Read More