更新时间:2022-10-14 19:15:53
您可以通过实现HiveSerDe将JSON导入到Hive中。 b
$ b
这个链接是一个样本实现。
https://github.com/rcongiu/Hive-JSON-Serde
您也可以参考这些链接
A little spoon feeding required, how to import complex json into hive. Json file in the format of:{"some-headers":"", "dump":[{"item-id":"item-1"},{"item-id":"item-2"},...]}
.
Hive to have fields given under dump
. Json file size, as now ,is not exceeding 200MB, but since its a dump, it will reach GBs very soon. Any other possible methods shall be greatly appreciated.
You can import JSON into Hive by implementing the HiveSerDe.
This link serves as a sample implementation.
https://github.com/rcongiu/Hive-JSON-Serde
You can also refer to these links