티스토리 뷰

728x90
spark = SparkSession
  .builder
  .appName("Your App")
  .config("spark.sql.broadcastTimeout", "36000")
  .getOrCreate()

https://stackoverflow.com/questions/41123846/why-does-join-fail-with-java-util-concurrent-timeoutexception-futures-timed-ou

 

Why does join fail with "java.util.concurrent.TimeoutException: Futures timed out after [300 seconds]"?

I am using Spark 1.5. I have two dataframes of the form: scala> libriFirstTable50Plus3DF res1: org.apache.spark.sql.DataFrame = [basket_id: string, family_id: int] scala>

stackoverflow.com

 

728x90

'공부' 카테고리의 다른 글

[Python] thread  (0) 2020.12.13
[Pyspark] df.repartition(10).write.format('jdbc')...  (0) 2020.12.13
[Spark] sort other columns  (0) 2020.12.13
[Deploy] rolling, blue green, canary  (0) 2020.12.13
[Spark] keytab & principal  (0) 2020.12.13
댓글