티스토리 뷰

공부

[Sh] HDFS exists directory

승가비 2020. 12. 10. 10:26
728x90
hdfs dfs -test -d $yourdir

if [ $? == 0 ]; then
    echo "exists"
else
    echo "dir does not exists"
fi

https://stackoverflow.com/questions/26513861/checking-if-directory-in-hdfs-already-exists-or-not

 

Checking if directory in HDFS already exists or not

I am having following directory structure in HDFS, /analysis/alertData/logs/YEAR/MONTH/DATE/HOURS That is data is coming on houly basis and stored in format of year/month/day/hour. I have writt...

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Spark] string to date  (0) 2020.12.10
[Spark] `foreach` vs `foreachPartition`  (0) 2020.12.10
[Spark] Encounter SparkException “Cannot broadcast the table that is larger than 8GB”  (0) 2020.12.10
[Spring] security actuator disable  (0) 2020.11.28
[Docker] docker attach ${name}  (0) 2020.11.28
댓글