티스토리 뷰

공부

[spark] Spark throwing FileNotFoundException when overwriting dataframe on S3

승가비 2023. 3. 12. 23:25
728x90

https://stackoverflow.com/questions/37254681/spark-throwing-filenotfoundexception-when-overwriting-dataframe-on-s3

 

Spark throwing FileNotFoundException when overwriting dataframe on S3

I have partitioned parquet files stored on two locations on S3 in the same bucket: path1: s3n://bucket/a/ path2: s3n://bucket/b/ The data has the same structure. I want to read the files from the...

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[yarn] memory & core  (0) 2023.03.14
[zeppelin] lifecyclemanager  (0) 2023.03.12
[sh] sleep 3 (3s); sleep 0.3 (0.3s)  (0) 2023.03.12
[sh] python jq  (0) 2023.03.12
[spark] get yarn application id  (0) 2023.03.10
댓글