공부
[Spark] MySQL jdbc write `rewriteBatchedStatements=true`
승가비
2020. 10. 28. 05:53
728x90
https://stackoverflow.com/questions/36912442/low-jdbc-write-speed-from-spark-to-mysql
Low JDBC write speed from Spark to MySQL
I need write about 1 million rows from Spark a DataFrame to MySQL but the insert is too slow. How can I improve it? Code below: df = sqlContext.createDataFrame(rdd, schema) df.write.jdbc(url='x...
stackoverflow.com
728x90