Spark SQL has become more and more important to the Apache Spark project. It is the interface most commonly ... integrated web-based notebook development, and proprietary optimized I/O performance ...