itcraftsman·3d agoWhat I actually ask in Data Engineering interviews (and the answers that sink candidates)The tool list on a CV is easy to pad. I stay with it until I can tell who built the pipeline, and who was just on the project.A response icon1A response icon1
itcraftsman·4d agoThe Data Engineering Stack for 2027: What I’d Keep, What I’d DropFewer tools, more of them owned by the same company, and a “skip it if” for every recommendation I make.A response icon4A response icon4
angga faizul·5d agoBuilding Resilient Airflow Data Pipelines: From Task Retries to Data CheckpointsBusiness Problem
Bechir Bejaoui·Nov 6Same guarantees, without programming them: Hydra ETL vs Airflow + dlt + dbt vs Airflow + Airbyte +…Most comparisons of data tools show the happy path. I wanted to see the other one: what happens when the source file is missing, when one…A response icon1A response icon1
Nicolas Pogeant·Nov 5dbt Knows the Order, Not the ScheduleOrdering models is dbt’s job. Deciding when anything runs, and what must finish first, belongs to the layer around it
Alexander Daniel Pratama·Nov 5Orchestrate your Arcpy in AirflowFor years, all my ETL scripts did its job well. Then one day a colleague asked me to explain how it worked, and I froze because it will…
Michalzarnecki·Nov 4From Data to Production Decisions, Models and Prototypes: Classification, Streamlit, and Airflow —…So far, we have worked mainly without ready-made answers.
Ahmed Abdulwahid·Nov 4Apache Airflow for Data Engineers🌪️: From Beginner to Production (Part 2)This is Part 2 of the Apache Airflow Course. Before we dive in, make sure you’ve gone through Part 1, as many of the concepts we’ll discuss…A response icon3A response icon3
Ahmed Abdulwahid·Nov 3Apache Airflow for Data Engineers🌪️: From Beginner to Production (Part 1)Imagine You’re Running a Restaurant 🍳. Every day, you must:A response icon4A response icon4
