-
Data Warehousing with Databricks – Part 2 Transforming Data with DBT
Introduction In the previous post (Data Warehousing with Databricks – Part 1 Dynamic Extract and Load – Cookie Codes) I demonstrated how Azure Data Factory can take various distributed data sources and bring them into a centralised location via a metadata driven process. As demonstrated in that post we have our data in a centralised…
-
Data Warehousing with Databricks – Part 1 Dynamic Extract and Load
Introduction I want you to do me a favour – Imagine you work for a disorganised company (that really wasn’t hard was it!). This company operates in a fairly isolated approach to business with different systems for different departments and very limited ability to link together data to show organisational metrics, its also possible due…
-
The Data LakeHouse – Introducing Databricks
Introduction One of the goals in making this blog was to allow me to have a space to learn new technologies I haven’t used much in the past and hopefully provide interesting examples to help others learn these technologies. I have never used Databricks before but have heard a lot about it, I simply just…