Writing about data & AI
Technical articles on data engineering, Databricks and AI.
Community Connectors in Databricks
If you have ever worked with data ingestion at scale, you know that a considerable part of the effort is not in transformation or modeling, but in…
Secure authentication in Microsoft Fabric notebooks with Workspace Identity and Connection Objects
If you work with notebooks in Microsoft Fabric, you have probably hit the classic situation: during development everything works…
VOID Columns in Delta Lake
Why a typeless column shows up in your Delta schema, what it breaks, and how to fix it idempotently.
The next generation of Databricks Genie
Databricks Genie is no longer just a data chatbot. With the recent updates announced by Databricks, the product is positioning itself as something…
AI/BI Dashboards and DABs: the lesson I almost learned the hard way
There is a behavior in Databricks that looks like a bug but is a feature, and that almost no one discovers until they lose a dashboard in production.
DABs Python Mutators: how to guarantee consistent configuration across 50 jobs without copy-paste
As a Databricks project grows, the number of jobs in the bundle grows with it. Ten jobs become twenty, twenty become fifty. And along with the…
Databricks Apps: building data applications without leaving the Lakehouse
For a long time, the lifecycle of a data project had a very clear split: you built your pipelines, transformations, and models inside a platform like…
Liquid Clustering in Databricks: the evolution of OPTIMIZE + ZORDER in Delta Lake
If you have worked with Delta Lake in Databricks for a while, you have certainly come across the OPTIMIZE + ZORDER BY combo to physically organize…
How to build a naming governance agent for Databricks Unity Catalog
Naming conventions are one of those topics every data team agrees on in theory and ignores in practice. The rule exists, the document is in Confluence…
Evolving agentic applications in Microsoft Fabric: automated deployment and integration with Data Agents
Over the last few months, I have closely followed how Microsoft Fabric has accelerated its evolution to compete directly in the AI and agents space.…