且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

将Spark DataFrame转换为Pandas DF

更新时间:2022-06-04 04:32:22

以下步骤应该有效

some_df = sc.parallelize([
 ("A", "no"),
 ("B", "yes"),
 ("B", "yes"),
 ("B", "no")]
 ).toDF(["user_id", "phone_number"])
pandas_df = some_df.toPandas()