It's one of a growing number of approaches for flattening the Lambda architecture, so ... support for the Beam programming model is roughly 70 percent complete across Apache Apex, Flink, and Spark ...

Fast, flexible, and developer-friendly, Apache Spark is the leading platform for large-scale SQL, batch processing, stream processing, and machine learning.