Data Engineering
What is data engineering? The lifecycle, stack and roles
How raw source data becomes something the business can trust and use.
14 min of reading
Explore our articles
Insights in Software, Data, and AI
Stay connected with the latest news in technology, innovation, software development, and best market practices from the perspective of our experts in software, data, and artificial intelligence.
Data Engineering
Data Analytics
The future of SQL: what changes when data is distributed
Why SQL still runs distributed analytics, and what changes per engine
12 min of reading
Data Engineering
Data Analytics
Workflow orchestration with Apache Airflow: a practical guide
How workflow orchestration with Apache Airflow keeps data pipelines reliable
15 min of reading
Data Engineering
When to use Apache Kafka (and when batch is enough)
When Apache Kafka is worth the cluster, and when batch still wins.
14 min of reading
Data Engineering
Data Analytics
Great Expectations (GX) demystified: a practical guide to automated data validation
Automated data validation with Great Expectations (GX): a practical guide.
13 min of reading
Data Engineering
Data Analytics
Data lake, data warehouse or lakehouse: how to choose
Choosing between data lake, data warehouse and lakehouse
14 min of reading
Data Engineering
Data Analytics
GCP Dataplex: how to automate data quality checks
How GCP Dataplex automates data quality across BigQuery and Cloud Storage.
9 min of reading
Data Engineering
Business Intelligence
Microsoft Fabric cost optimization: mastering capacity units and workloads
Microsoft Fabric cost optimization: right-size capacity units
13 min of reading
Data Engineering
Business Intelligence
Azure Databricks vs Microsoft Fabric: choosing your Azure data platform
Azure Databricks vs Microsoft Fabric: choose your Azure platform
12 min of reading
