티스토리 뷰

공부

[Spark] install

승가비 2021. 12. 27. 15:26
728x90
 curl -O https://archive.apache.org/dist/spark/spark-3.2.0/spark-3.2.0-bin-hadoop3.2.tgz
 tar -xf spark-3.2.0-bin-hadoop3.2.tgz

https://archive.apache.org/dist/spark/spark-3.2.0/

 

Index of /dist/spark/spark-3.2.0

 

archive.apache.org

./bin/spark-shell
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/Users/seunggabi/seunggabi/study/spark/spark-3.2.0-bin-hadoop3.2/jars/spark-unsafe_2.12-3.2.0.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
21/12/27 15:25:55 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Spark context Web UI available at http://192.168.219.126:4040
Spark context available as 'sc' (master = local[*], app id = local-1640586356814).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.2.0
      /_/

Using Scala version 2.12.15 (OpenJDK 64-Bit Server VM, Java 14.0.1)
Type in expressions to have them evaluated.
Type :help for more information.

scala>​
728x90

'공부' 카테고리의 다른 글

[MySQL] IFNULL(field, 'default')  (0) 2021.12.27
[Java] HashMap vs HashTable  (0) 2021.12.27
[programers] 순위검색 (dfs & binary search)  (0) 2021.12.26
[HBASE] basic  (0) 2021.12.21
[Java] Heap (add & peek & poll)  (0) 2021.12.20
댓글