相关疑难解决方法(0)

在Spark中将日期转换为月末

我有一个Spark DataFrame,如下所示:

#Create DataFrame    
df <- data.frame(name = c("Thomas", "William", "Bill", "John"),
      dates = c('2017-01-05', '2017-02-23', '2017-03-16', '2017-04-08'))
df <- createDataFrame(df)

#Make sure df$dates column is in 'date' format    
df <- withColumn(df, 'dates', cast(df$dates, 'date'))

name    | dates
--------------------
Thomas  |2017-01-05
William |2017-02-23
Bill    |2017-03-16
John    |2017-04-08
Run Code Online (Sandbox Code Playgroud)

我想更改dates为月末日期,因此它们看起来如下所示.我该怎么做呢?SparkR或PySpark代码都可以.

name    | dates
--------------------
Thomas  |2017-01-31
William |2017-02-28
Bill    |2017-03-31
John    |2017-04-30
Run Code Online (Sandbox Code Playgroud)

pyspark sparkr spark-dataframe

4
推荐指数
1
解决办法
4554
查看次数

标签 统计

pyspark ×1

spark-dataframe ×1

sparkr ×1