티스토리 뷰

공부

[yarn] yarn.resourcemanager.am.max-attempts=1

승가비 2023. 2. 16. 00:58
728x90

https://stackoverflow.com/questions/38709280/how-to-limit-the-number-of-retries-on-spark-job-failure

 

How to limit the number of retries on Spark job failure?

We are running a Spark job via spark-submit, and I can see that the job will be re-submitted in the case of failure. How can I stop it from having attempt #2 in case of yarn container failure or

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[yarn] cost tool `migration-hadoop-to-emr-tco-simulator`  (0) 2023.02.16
[glue] crawler (load s3)  (0) 2023.02.16
[sh] while loop (sub shell) not assign global variables -> for in loop  (0) 2023.02.16
[kotlin] instanceOf list (is List<*>)  (0) 2023.02.14
[kotlin] ip  (0) 2023.02.14
댓글