且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

在Spark数据框中爆炸嵌套的Struct

更新时间:2023-11-18 20:55:10

您可以使用类似的方法:

You could use something like that:

var explodeDF = explodeDF.withColumn("id", explodeDF("department.id"))
explodeDeptDF = explodeDeptDF.withColumn("name", explodeDeptDF("department.name"))

您帮助我解决了以下问题:

which you helped me into and these questions:

  • Flattening Rows in Spark
  • Spark 1.4.1 DataFrame explode list of JSON objects