Spark ml和PMML导出

Question

我知道这是可能的模型导出为PMML用Spark-MLlib,但怎么样Spark-ML？

是否有可能转换LinearRegressionModel从org.apache.spark.ml.regression到LinearRegressionModel从org.apache.spark.mllib.regression到能够调用的toPMML()方法？

Answer 1

您可以使用JPMML-SparkML库将Spark ML管道转换为PMML :

StructType schema = dataFrame.schema()
PipelineModel pipelineModel = pipeline.fit(dataFrame);
org.dmg.pmml.PMML pmml = org.jpmml.sparkml.ConverterUtil.toPMML(schema, pipelineModel);
JAXBUtil.marshalPMML(pmml, new StreamResult(System.out));