更新时间:2022-06-05 10:03:43
让我们考虑以下背景:
val spark : SparkSession = _ // or val sqlContext: SQLContext = new SQLContext(sc) for 1.x
val list: DataFrame = ???
在和 c>点亮,您需要导入正确的函数:
To use when
and lit
, you'll need to import the proper functions :
import org.apache.spark.sql.functions.{col, lit, when}
现在你可以按照以下方式使用它们:
Now you can use them as followed :
list.select(when(col("column_name").isNotNull, lit(1)))
现在您也可以在代码中点亮:
Now you can use lit also in your code :
val score = list.withColumn("scr", lit(0))