티스토리 뷰

공부

[Spark] Exception“org.apache.spark.shuffle.FetchFailedException: Failed to connect”

승가비 2019. 11. 19. 00:45
728x90

You need merged.txt in one partition

[AS-IS]
/yyyy=2019/a.txt
/yyyy=2019/b.txt
/yyyy=2019/c.txt

[TO-BE]
/yyyy=2019/merged.txt

[출처] https://stackoverflow.com/questions/39268624/how-to-fix-org-apache-spark-shuffle-fetchfailedexception-failed-to-connect-in/58918235#58918235

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Java] Join List<String>  (0) 2019.12.21
[JS] VueJS `\n` 줄바꿈 적용  (0) 2019.12.21
[Java] Unescape HTML  (0) 2019.11.19
[Spark] SQL  (0) 2019.11.19
[Python] Execute shell command  (0) 2019.11.18
댓글