티스토리 뷰
공부
[Spark] `spark.executor.extraJavaOptions` log4j.xml (multi options)
seunggabi 승가비 2020. 5. 17. 05:26728x90
--conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=log4j.xml -Dfile.encoding=utf-8"
https://stackoverflow.com/questions/41203431/configuring-spark-logging-with-log4j-xml
Configuring Spark logging with log4j.xml
I guesss its a silly question, but I couldnt find answer anywhere. Can I configure logging in spark using log4j.xml? In spark documentation its mentioned you can configure logging with log4j.
stackoverflow.com
https://albertusk95.github.io/posts/2019/09/multiple-extra-java-options-spark-submit/
Apache Spark [PART 29]: Multiple Extra Java Options for Spark Submit Config Parameter
There’s a case where we need to pass multiple extra java options as one of configurations to spark driver and executors. Here’s an example:
albertusk95.github.io
728x90
'공부' 카테고리의 다른 글
| [Java] `StringUtils.join` + `big Arrays` = `OutOfMemory` (0) | 2020.05.17 |
|---|---|
| [Java] encoding in server (0) | 2020.05.17 |
| [Spark] `spark.executor.extraJavaOptions` log4j.xml (multi options) (0) | 2020.05.17 |
| [JS] convert bytes array to image (0) | 2020.05.17 |
| [JS] check isEmpty (0) | 2020.05.17 |
| [SpringBoot] configuration memory heap size (0) | 2020.05.17 |
댓글