티스토리 뷰

공부

[spark] `gzip` vs `snappy` vs `lzo`

승가비 2022. 12. 29. 21:30
728x90

https://stackoverflow.com/questions/35789412/spark-sql-difference-between-gzip-vs-snappy-vs-lzo-compression-formats

 

Spark SQL - difference between gzip vs snappy vs lzo compression formats

I am trying to use Spark SQL to write parquet file. By default Spark SQL supports gzip, but it also supports other compression formats like snappy and lzo. What is the difference between these

stackoverflow.com

https://community.cloudera.com/t5/Support-Questions/Hive-table-format-and-compression/td-p/111356

 

Hive table format and compression

Throwing this error while creating Hive parquet table with snappy compression in hive beeline mode. Error: Error while compiling statement: FAILED: ParseException line 19:15 cannot recognize input near 'parquet' '.' 'compress' in table properties list (sta

community.cloudera.com

https://stackoverflow.com/questions/48395999/hive-parquet-snappy-compression-not-working

 

Hive parquet snappy compression not working

I am creating one table skeleton using the table properties as TBLPROPERTIES('PARQUET.COMPRESSION'='SNAPPY') (as the files are in parquet format) and setting few of the parameters before creating ...

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[slack] hyper link `<url|asdf>`  (0) 2022.12.29
[tableau] workbook & webhook & auth (sign_in, sign_out)  (0) 2022.12.29
[python] throw err; raise Exception("message")  (0) 2022.12.29
[python] `PYTHONPATH=/foo:/bar python3 example.py`  (0) 2022.12.29
[aws] zeppelin restart  (0) 2022.12.29
댓글