Immediately, we’re thrilled to announce Databricks Ventures’ funding in dbt Labs. With this funding, we’re proud to assist the expansion of the corporate behind a pivotal open supply motion. Alongside this announcement, we’re additionally excited to introduce main enhancements to our partnership together with a native Databricks adapter for dbt, automated question acceleration for dbt workloads in Photon and, quickly, one-click connectivity by Associate Join. We consider these enhancements make the Databricks Lakehouse Platform the very best place to construct your subsequent dbt mission.
Why dbt Labs? On the highest degree, they share our imaginative and prescient of an open future during which data-driven use instances are accessible and priceless throughout all knowledge groups. dbt is a metamorphosis framework that permits analytics engineers to simply construct knowledge pipelines utilizing SQL. All the pieces is organized inside a mission, in readable SQL and YAML information, making model management, deployment, and knowledge high quality testing easy. This opinionated method permits knowledge practitioners to confidently ship worth throughout the group whereas following software program engineering finest practices.
At Databricks, we consider that open supply and open protocols equivalent to Delta Lake and MLflow aren’t solely basically aligned with the pursuits of our prospects, but additionally foster vibrant communities that construct transformative software program. The dbt group is an excellent instance of this dynamic: tens of 1000’s of analytics engineers collaborate, share finest practices, and train one another the right way to construct higher software program throughout Slack, Discord and extra. Our funding in dbt Labs anticipates the unbelievable potential of this group and the function we consider dbt Labs will play in rising it within the coming years.
As well as, we proceed to companion intently with dbt Labs and the group to make Databricks the very best place to develop and productionalize dbt initiatives. The dbt-databricks adapter is now usually obtainable with a v1.0.0 launch. It gives simplified set up, assist for Delta Lake tables, and loads of idiomatic macros that make creating and testing dbt initiatives a breeze. Databricks SQL, our record-setting providing for knowledge warehousing workloads, robotically and transparently accelerates SQL expressions generated by dbt.
Lastly, by Databricks Associate Join, prospects will quickly have the opportunity join Databricks to dbt Cloud with a few clicks. dbt Labs gives a beneficiant free trial that makes it straightforward to productionize dbt deployments, together with turnkey assist for scheduling jobs, CI/CD, serving documentation, monitoring and alerting, and an Built-in Developer Setting (IDE). Look out for extra updates this spring.
With this funding, Databricks is happy to take part in a motion that aligns so intently with our personal values. We’re grateful to the dbt group for offering us with invaluable suggestions, and invite you to construct your subsequent dbt mission on Databricks.
To get began, please be a part of the dialog on Slack.