티스토리 뷰

공부

[spark] DFSClient: DFSOutputStream ResponseProcessor exception for block BP-1565110817-10.161.67.203-1521280878051:blk_1440726264_367066900java.io.EOFException: Premature EOF: no length prefix available at org.apache.hadoop.hdfs.protocolPB.PBHelper..

승가비 2023. 3. 6. 00:52
728x90

data -> split chunk -> loop

 

https://www.ibm.com/support/pages/spark-dirver-reported-outofmemoryerror

 

Spark dirver reported OutOfMemoryError

Spark dirver reported OutOfMemoryError

www.ibm.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[terraform] terraform apply -auto-approve  (0) 2023.03.06
[spark] executor-cores = 5 (recommended)  (0) 2023.03.06
[spark] drop view (createTempView)  (0) 2023.03.06
[spark] AQE (Adaptive Query Execution)  (0) 2023.03.01
[spark] spark.sql.cbo.enabled=true  (0) 2023.03.01
댓글