공부
[Spark] `foreach` vs `foreachPartition`
승가비
2020. 12. 10. 10:29
728x90
Apache Spark - foreach Vs foreachPartitions When to use What?
I would like to know if the foreachPartitions will results in better performance, due to an higher level of parallelism, compared to the foreach method considering the case in which I'm flowing th...
stackoverflow.com
Does sparks foreachPartition run on the driver or on the worker?
It is unclear from documentation where exactly does the lambda given to the foreachpartition run- on the driver or on the worker?
stackoverflow.com
728x90