如何在预测结果中添加一些自定义字段(即用户ID)？

List localTesting = ... ;//

// I want to add some identifier to each LabeledPoint

DataFrame localTestDF = jsql.createDataFrame(jsc.parallelize(studyData.localTesting), LabeledPoint.class);

DataFrame predictions = model.transform(localTestDF);

Row[] collect = predictions.select("label", "probability", "prediction").collect();

for (Row r : collect) {

// and want to return identifier here.

// so do I save I to database.

int userNo = Integer.parseInt(r.get(0).toString());

double prob = Double.parseDouble(r.get(1).toString());

int prediction = Integer.parseInt(r.get(2).toString());

log.debug(userNo + "," + prob + ", " + prediction);

}

但是当我使用这个类进行localTesting而不是LabeledPoint时,

class NoLabeledPoint extends LabeledPoint implements Serializable {

private static final long serialVersionUID = -2488661810406135403L;

int userNo;

public NoLabeledPoint(double label, Vector features) {

super(label, features);

}

public int getUserNo() {

return userNo;

}

public void setUserNo(int userNo) {

this.userNo = userNo;

}

}

List localTesting = ... ;// set every user'no to the field userNo

// I want to add some identifier to each LabeledPoint

DataFrame localTestDF = jsql.createDataFrame(jsc.parallelize(studyData.localTesting), LabeledPoint.class);

DataFrame predictions = model.transform(localTestDF);

Row[] collect = predictions.select("userNo", "probability", "prediction").collect();

for (Row r : collect) {

// and want to return identifier here.

// so do I save I to database.

int userNo = Integer.parseInt(r.get(0).toString());

double prob = Double.parseDouble(r.get(1).toString());

int prediction = Integer.parseInt(r.get(2).toString());

log.debug(userNo + "," + prob + ", " + prediction);

}

异常抛出

org.apache.spark.sql.AnalysisException: cannot resolve 'userNo' given input columns rawPrediction, probability, features, label, prediction;

at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42)

at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:63)

at org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1$$anonfun$apply$2.applyOrElse(CheckAnalysis.scala:52)

at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformUp$1.apply(TreeNode.scala:286)

at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformUp$1.apply(TreeNode.scala:286)

at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:51)

我的意思是我不仅要获得预测数据(功能,标签,概率……),还要获得我想要的一些自定义字段.例如userNo,user_id等

从结果：predictions.select(“……”)

更新

解决了.一行应该是固定的

从

DataFrame localTestDF = jsql.createDataFrame(jsc.parallelize(studyData.localTesting), LabeledPoint.class);

至

DataFrame localTestDF = jsql.createDataFrame(jsc.parallelize(studyData.localTesting), NoLabeledPoint.class);