[spark] AQE (Adaptive Query Execution)

https://eyeballs.tistory.com/245 [Spark3] Adaptive Query Execution databricks 의 Adaptive Query Execution: Speeding Up Spark SQL at Runtime 을 기반으로 함. https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html 해당 포스트는 위 링크의 내용을 (모자란 실 eyeballs.tistory.com
공부 2023. 3. 1. 21:58
[spark] spark.sql.cbo.enabled=true

https://stackoverflow.com/questions/52058565/spark-sql-cbo-enabled-true-with-hive-table spark.sql.cbo.enabled=true with Hive table In Spark 2.2 the Cost Based Optimizer option has been enabled. The documentation appears to be saying that we need to analyze the tables in Spark before enabling this option. I would like to know i... stackoverflow.com
공부 2023. 3. 1. 21:54
1
728x90
728x90