且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

将复杂的Json数据导入配置单元

更新时间:2022-10-14 19:15:53

您可以通过实现HiveSerDe将JSON导入到Hive中。 b
$ b

这个链接是一个样本实现。



https://github.com/rcongiu/Hive-JSON-Serde



您也可以参考这些链接

你如何使用JSON数据制作HIVE表?


A little spoon feeding required, how to import complex json into hive. Json file in the format of:{"some-headers":"", "dump":[{"item-id":"item-1"},{"item-id":"item-2"},...]}. Hive to have fields given under dump. Json file size, as now ,is not exceeding 200MB, but since its a dump, it will reach GBs very soon. Any other possible methods shall be greatly appreciated.

You can import JSON into Hive by implementing the HiveSerDe.

This link serves as a sample implementation.

https://github.com/rcongiu/Hive-JSON-Serde

You can also refer to these links

How do you make a HIVE table out of JSON data?