티스토리 뷰

공부

[orc] print schema

승가비 2022. 12. 15. 19:13
728x90
val df = spark.read.option("header","true").orc("/DATA/UNIVERSITY/DEPT/STUDENT/part-00000.orc")

df.printSchema()

https://stackoverflow.com/questions/58288941/how-to-get-the-schema-columns-and-their-types-of-orc-files-stored-in-hdfs

 

How to get the schema (columns and their types) of ORC files stored in HDFS?

I have ORC files stored in different folders on HDFS as follows: /DATA/UNIVERSITY/DEPT/STUDENT/part-00000.orc /DATA/UNIVERSITY/DEPT/CREDIT/part-00000.orc I do not know how many columns are presen...

stackoverflow.com

 

728x90
저작자표시 비영리

'공부' 카테고리의 다른 글

[sh] cmd -> echo & eval  (0) 2022.12.15
[hive] INSERT OVERWRITE TABLE target PARTITION (YEAR, MONTH)SELECT A, B, C, YEAR, MONTHFROM temp  (0) 2022.12.15
[sql] User class threw exception: org.apache.spark.sql.AnalysisException: Function {custom_function} already exists  (0) 2022.12.15
[leetcode] 91. Decode Ways  (0) 2022.12.12
Kafka with AVRO vs., Kafka with Protobuf vs., Kafka with JSON Schema  (0) 2022.12.11
댓글