티스토리 뷰

공부

[Hive] How to convert hive table format to ORC

승가비 2021. 12. 11. 17:17
728x90
INSERT OVERWRITE TABLE table_name_orc 
SELECT * FROM table_name

https://community.cloudera.com/t5/Support-Questions/How-to-convert-hive-table-format-to-ORC/td-p/281421

 

How to convert hive table format to ORC

I have a super large json file and I have created an external hive table to read the file which is partitioned by date and hour. However, I ran into out-of-memory error when pulling out data for just one day.  For now the output is stored in the text form

community.cloudera.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[Hive] Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Number of dynamic partitions created is 5480, which is more than 5000. To solve this try to set hive.exec.max.dynamic.partition..  (0) 2021.12.15
[Java] List -> Map  (0) 2021.12.13
[Python] delete element in map by key `del map[key]`  (0) 2021.12.09
[thymeleaf] ${#lists.size(prods[0].comments)}  (0) 2021.12.09
[Python] list to map  (0) 2021.12.08
댓글