공부
[Spark] write mode overwrite
승가비
2022. 1. 16. 20:55
728x90
https://www.titanwolf.org/Network/q/5e2bf2fd-8971-472d-9092-235f1ce15046/y
Question : Overwrite csv file on s3 fails in pyspark
952 visibility 0 arrow_circle_up 0 arrow_circle_down When I load data into pyspark dataframe from s3 bucket then make some manipulations (join, union) and then I try to overwrite the same path ('data/csv/') I read before. I'm getting this error: py4j.proto
www.titanwolf.org
728x90