且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

错误:未找到:值lit / when - spark scala

更新时间:2022-06-05 10:03:43

让我们考虑以下背景:

val spark : SparkSession = _ // or val sqlContext: SQLContext = new SQLContext(sc) for 1.x
val list: DataFrame = ???

在和 c>点亮,您需要导入正确的函数:

To use when and lit, you'll need to import the proper functions :

import org.apache.spark.sql.functions.{col, lit, when}

现在你可以按照以下方式使用它们:

Now you can use them as followed :

list.select(when(col("column_name").isNotNull, lit(1)))

现在您也可以在代码中点亮:

Now you can use lit also in your code :

val score = list.withColumn("scr", lit(0))