티스토리 뷰

공부

[Spark] write mode overwrite

승가비 2022. 1. 16. 20:55
728x90

https://www.titanwolf.org/Network/q/5e2bf2fd-8971-472d-9092-235f1ce15046/y

 

Question : Overwrite csv file on s3 fails in pyspark

952 visibility 0 arrow_circle_up 0 arrow_circle_down When I load data into pyspark dataframe from s3 bucket then make some manipulations (join, union) and then I try to overwrite the same path ('data/csv/') I read before. I'm getting this error: py4j.proto

www.titanwolf.org

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Java] Use reflection API to get field names and values  (0) 2022.02.04
[Tableau] 날짜 함수  (0) 2022.02.04
[Java] delete topic  (0) 2022.01.16
[IntelliJ] test coverage 80%  (0) 2022.01.16
[Kafka] configuration partition rebalancing  (0) 2022.01.16
댓글