Scala Flatmap on Array里面的值部分

Question

我有RDD喜欢(a,b,数组(p1,p2,p3),c),我想在数值里面的数值应用flatmap来得到下面的输出.(a,b,p1,c)(a,b,p2,c)(a,b,p3,c)

Answer 1

码:

val arr = Array(("a1", "b1", Array("1", "2", "3")),("a1", "b1", Array("1", "2", "3")))
val rdd: RDD[(String, String, Array[String])] = sc.parallelize(arr)
val result = rdd.flatMap {
  case (first, second, third) => {
    third.map(x => (first, second, x))
}}

println("Results: " + result.collect.mkString("|"))

结果:

Results: (a1,b1,1)|(a1,b1,2)|(a1,b1,3)|(a1,b1,1)|(a1,b1,2)|(a1,b1,3)