Having recently tried to get DBConnect working on a Windows 10 machine I’ve realised things are not as easy as you might think.Read More
I’ve been waiting for this feature for what feels like forever.
Databricks-Connect is here! Well almost - it’s still preview, but the release looks imminent. It allows you to develop using an IDE like VSCode, PyCharm, IntelliJ etc and connect to a remote Databricks cluster to execute the task.Read More
The data required “unpivoting” so that the measures became just three columns for Volume, Retail & Actual - and then we add 3 rows for each row as Years 16, 17 & 18.
Their are various ways of doing this in Spark, using Stack is an interesting one. But I find this complex and hard to read.Read More