티스토리 뷰

공부

[Spark] keytab & principal

승가비 2020. 12. 13. 00:50
728x90
spark-submit \
--master spark://Spark master_url \
-–conf spark.yarn.keytab=path_to_keytab \
-–conf spark.yarn.principal=principal@REALM.COM \
--class main-class application-jar hdfs://namenode:9000/path/to/input

https://www.ibm.com/support/knowledgecenter/SSZU2E_2.3.0/managing_cluster/kerberos_hdfs_keytab.html

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Spark] sort other columns  (0) 2020.12.13
[Deploy] rolling, blue green, canary  (0) 2020.12.13
[Java] new ArrayList<>(Arrays.asList("a", "b", "c"))  (0) 2020.12.13
[Spark] hadoop.fs.default.name (default file system)  (0) 2020.12.13
[Spark] hive dynamic partition  (0) 2020.12.13
댓글