Python was already the most popular language in Spark before the latest batch of improvements (and Databricks and the Apache Spark community aren’t done). So it’s interesting to note the level of ...

Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire ...