我是Spark/Scala的初学者.我想从数据集中选择的数组中提取一个值(Double).简化的主要步骤如下所示.如何在最后一个val wpA中提取每个值[Double]?像val p1 = wpA(1)之类的东西.我没能通过wpA.toArray将它转换为普通数组.
预先感谢您的帮助.
case class Event(eventId: Int, n_track: Int, px:ArrayBuffer[Double],py: ArrayBuffer[Double], pz: ArrayBuffer[Double],ch: ArrayBuffer[Int], en: ArrayBuffer[Double])
---
val rawRdd = sc.textFile("expdata/rawdata.bel").map(_.split("\n"))
val eventRdd = rawRdd.map(x => buildEvent(x(0).toString))
val dataset = sqlContext.createDataset[Event](eventRdd)
dataset.printSchema()
root
|-- eventId: integer (nullable = false)
|-- n_track: integer (nullable = false)
|-- px: array (nullable = true)
| |-- element: double (containsNull = false)
|-- py: array (nullable = true)
| |-- element: double (containsNull = false)
|-- pz: array (nullable = true) …Run Code Online (Sandbox Code Playgroud)