공부

[Spark] What's the difference between --archives, --files, py-files in pyspark job arguments

승가비 2021. 2. 25. 12:43
728x90

stackoverflow.com/questions/38066318/whats-the-difference-between-archives-files-py-files-in-pyspark-job-argum

 

What's the difference between --archives, --files, py-files in pyspark job arguments

--archives, --files, --py-files and sc.addFile and sc.addPyFile are quite confusing, can someone explain these clearly?

stackoverflow.com

 

728x90
저작자표시 비영리 (새창열림)