티스토리 뷰

공부

[spark] --name {appName}

승가비 2022. 12. 28. 00:09
728x90

https://stackoverflow.com/questions/36747268/why-does-conf-setspark-app-name-appname-not-set-the-name-in-the-ui

 

Why does conf.set("spark.app.name", appName) not set the name in the UI?

I am calling val appName : String = arguments.getNameFromConfig val conf = new SparkConf() conf.set("spark.driver.maxResultSize", "30G") conf.set("spark.app.name", appName) println("Master: " +

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[spark] sql `SHOW PARTITIONS` & `SELECT * FROM db_name."table_name$partitions" ORDER BY column_name DESC`  (0) 2022.12.28
[airflow] loop dags  (0) 2022.12.28
[sh] grep exclude word `grep -v 'exclude_word' file`  (0) 2022.12.28
[spark] text files  (0) 2022.12.20
[hive] `PARTITIONED BY` & `CLUSTERED BY`  (0) 2022.12.20
댓글