티스토리 뷰

공부

[Spark] `spark.executor.extraJavaOptions` log4j.xml (multi options)

승가비 2020. 5. 17. 05:26
728x90
--conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=log4j.xml -Dfile.encoding=utf-8"

https://stackoverflow.com/questions/41203431/configuring-spark-logging-with-log4j-xml

 

Configuring Spark logging with log4j.xml

I guesss its a silly question, but I couldnt find answer anywhere. Can I configure logging in spark using log4j.xml? In spark documentation its mentioned you can configure logging with log4j.

stackoverflow.com

https://albertusk95.github.io/posts/2019/09/multiple-extra-java-options-spark-submit/

 

Apache Spark [PART 29]: Multiple Extra Java Options for Spark Submit Config Parameter

There’s a case where we need to pass multiple extra java options as one of configurations to spark driver and executors. Here’s an example:

albertusk95.github.io

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Java] `StringUtils.join` + `big Arrays` = `OutOfMemory`  (0) 2020.05.17
[Java] encoding in server  (0) 2020.05.17
[JS] convert bytes array to image  (0) 2020.05.17
[JS] check isEmpty  (0) 2020.05.17
[SpringBoot] configuration memory heap size  (0) 2020.05.17
댓글