Towards dynamic SQL compilation in Apache Spark
Informazioni aggiuntive
Autori
Schiavio F.,
Bonetta D.,
Binder W.
Tipo
Contributo in atti di convegno
Anno
2020
Lingua
Inglese
Sommario
Big-data systems have gained significant momentum, and Apache Spark is becoming a de-facto standard for modern data analytics. Spark relies on code generation to optimize the execution performance of SQL queries on a variety of data sources. Despite its already efficient runtime, Spark’s code generation suffers from significant runtime overheads related to data de-serialization during query execution. Such performance penalty can be significant, especially when applications operate on human-readable data formats such as CSV or JSON.
Parole chiave
Apache Spark SQL, SQL Compilation, Dynamic Compilation
Titolo atti di convegno
Companion Proceedings of the 4th International Conference on the Art, Science, and Engineering of Programming ( Companion), March 23–26, 2020, Porto, Portugal
Pagine (o numero dell’articolo)
4 p.
Diffusione
Licenza
Licenza non definita
Visibilità
Pubblico
Status open access
Green
