Mykola-Bohdan Vynnytskyi·2h agoUnderstanding Databricks: Six Sources into Bronze, the Imperative WayDesigning a real pipeline, generating a million rows, and loading six formats into Bronze, bugs included. Updated November 2026.
Lalatendu Keshari Swain·4h agoApache HTTP/2 Flaw CVE-2026–119618: How to Check Your Servers and Patch to 2.4.71A critical bug in mod_http2 can allow remote code execution without a login. Here is how to find out whether your servers are really…
Pandraju Isaac·1d agoStop Pasting Values Into spark.sql: Parameter Markers and IDENTIFIER() in PySparkspark.sql has taken an args= parameter since Spark 3.4, and IDENTIFIER() arrived in 3.5. I ran named and positional markers, dynamic table…
Helana Nosrat·1d agoA Field Guide to Apache Spark RDDsPartitions, lineage, and what happens when you ask a cluster to send everything back to one machine.
InITNEXTbySebastian Daberdaku·2d agoAWS Glue for Spark and Delta Lake without the Hive clientgluecat is a Spark catalog plugin that gives each Spark catalog its own Glue catalog ID and IAM role, and creates Delta tables there.A response icon1A response icon1
Pawan Deore·2d agoThe Small-File Problem: Why Your 100 GB Data Pipeline Runs Slower Than a 1 TB PipelineAn engineering deep dive into Apache Spark, Parquet, object storage, and the performance problems that adding more compute won’t…A response icon1A response icon1
Kaizen·2d agoTop 50 Apache Spark Interview Questions and Answers for Data EngineersA practical interview preparation guide based on my Data Engineering interview experiences
Dimsx·2d agoBIgData#10 — Pemrosesan Data Streaming dengan Spark Structured Streaming1. Batch vs Streaming: Apa Bedanya?
Kristian Agung Nugroho·2d agoBigData(10): Real-Time Data Processing using PySpark Structured Streaming1. Introduction
Hemanshu Vispute·2d agoFiles, References and Statistics in Delta LakeWhy partitioning gave way to liquid clustering, and what that means for table maintenanceA response icon1A response icon1
