gar*_*ong 4 dictionary scala apache-spark apache-spark-sql
m是如下地图:
scala> m
res119: scala.collection.mutable.Map[Any,Any] = Map(A-> 0.11164610291904906, B-> 0.11856755943424617, C -> 0.1023171832681312)
Run Code Online (Sandbox Code Playgroud)
我想得到:
name score
A 0.11164610291904906
B 0.11856755943424617
C 0.1023171832681312
Run Code Online (Sandbox Code Playgroud)
如何获得最终的数据帧?
Sha*_*ica 13
首先将其转换为a Seq,然后就可以使用该toDF()功能了.
val spark = SparkSession.builder.getOrCreate()
import spark.implicits._
val m = Map("A"-> 0.11164610291904906, "B"-> 0.11856755943424617, "C" -> 0.1023171832681312)
val df = m.toSeq.toDF("name", "score")
df.show
Run Code Online (Sandbox Code Playgroud)
会给你:
+----+-------------------+
|name| score|
+----+-------------------+
| A|0.11164610291904906|
| B|0.11856755943424617|
| C| 0.1023171832681312|
+----+-------------------+
Run Code Online (Sandbox Code Playgroud)