티스토리 뷰

공부

[Spark] dataframe to table

승가비 2022. 11. 7. 20:18
728x90
my_DF.createOrReplaceTempView("my_temp_table");
spark.sql("drop table if exists my_table");
spark.sql("create table my_table as select * from my_temp_table");

https://stackoverflow.com/questions/42261701/how-to-create-hive-table-from-spark-data-frame-using-its-schema

 

How to create hive table from Spark data frame, using its schema?

I want to create a hive table using my Spark dataframe's schema. How can I do that? For fixed columns, I can use: val CreateTable_query = "Create Table my table(a string, b string, c double)"

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Spark] `repartition` vs `coalesce`  (0) 2022.11.07
[Gradle] Error: Could not find or load main class org.gradle.wrapper.GradleWrapperMain  (0) 2022.11.07
[HBase] tuning  (0) 2022.11.07
[bitbucket] gradle build & s3 deploy  (0) 2022.11.07
[AWS] graviton  (0) 2022.11.07
댓글