xgboost使用自定义的loss function

下面给一个官方demo代码：

参考：https://github.com/dmlc/xgboost/blob/master/demo/guide-python/custom_objective.py

#!/usr/bin/python
import numpy as np
import xgboost as xgb
###
# advanced: customized loss function
#
print('start running example to used customized objective function')dtrain = xgb.DMatrix('../data/agaricus.txt.train')
dtest = xgb.DMatrix('../data/agaricus.txt.test')# note: for customized objective function, we leave objective as default
# note: what we are getting is margin value in prediction
# you must know what you are doing
param = {'max_depth': 2, 'eta': 1, 'silent': 1}
watchlist = [(dtest, 'eval'), (dtrain, 'train')]
num_round = 2# user define objective function, given prediction, return gradient and second order gradient
# this is log likelihood loss
def logregobj(preds, dtrain):labels = dtrain.get_label()preds = 1.0 / (1.0 + np.exp(-preds))grad = preds - labelshess = preds * (1.0 - preds)return grad, hess# user defined evaluation function, return a pair metric_name, result
# NOTE: when you do customized loss function, the default prediction value is margin
# this may make builtin evaluation metric not function properly
# for example, we are doing logistic loss, the prediction is score before logistic transformation
# the builtin evaluation error assumes input is after logistic transformation
# Take this in mind when you use the customization, and maybe you need write customized evaluation function
def evalerror(preds, dtrain):labels = dtrain.get_label()# return a pair metric_name, result# since preds are margin(before logistic transformation, cutoff at 0)return 'error', float(sum(labels != (preds > 0.0))) / len(labels)# training with customized objective, we can also do step by step training
# simply look at xgboost.py's implementation of train
bst = xgb.train(param, dtrain, num_round, watchlist, logregobj, evalerror)

xgboost使用自定义的loss function相关推荐

R语言构建xgboost模型：自定义损失函数（目标函数、loss function、object function）、评估函数（evaluation function）
R语言构建xgboost模型:自定义损失函数(目标函数.loss function.object function).评估函数(evaluation function) 目录
R语言构建xgboost模型使用早停法训练模型（early stopping）：自定义损失函数（目标函数,loss function）、评估函数（evaluation function）
R语言构建xgboost模型使用早停法训练模型(early stopping):自定义损失函数(目标函数.loss function.object function).评估函数(evaluation ...
Keras自定义损失函数出现：ValueError: Unknown loss function: focal_loss
Keras自定义损失函数出现:ValueError: Unknown loss function: focal_loss 1.软件环境 2.问题描述 3.解决方法 4.结果预览 1.软件环境 Wind ...
xgboost中自定义损失函数的使用方法
起初以为在param里定义了就行,但屡屡报错,后来终于找到了方法. 首先是metric的写法: def maxRecall(preds,dtrain): #preds是结果(概率值),dtrain是个 ...
TensorFlow损失函数（loss function） 2017-08-14 11:32 125人阅读评论(0) 收藏举报分类：深度学习及TensorFlow实现（10）版权声明：
TensorFlow损失函数(loss function) 2017-08-14 11:32 125人阅读评论(0) 收藏举报分类: 深度学习及TensorFlow实现(10) 版权声明:本 ...
机器学习_LGB自定义huber loss函数
很多时候为了达到更好的训练效果我们需要改变损失函数,以加速数据的拟合. 一.huber函数的近似函数众所周知我们rmse会对异常值的损失关注度特别高,mae对异常会没有那么敏感.将两者进行结合就可以 ...
Semantic Instance Segmentation with a Discriminative Loss Function【论文详解】
PAPER:https://arxiv.org/abs/1708.02551 CODE:https://github.com/DavyNeven/fastSceneUnderstanding 一.整体 ...
神经网络中，设计loss function有哪些技巧?
点击上方"小白学视觉",选择加"星标"或"置顶" 重磅干货,第一时间送达本文转自:视学算法神经网络中,设计loss function有哪 ...
损失函数(Loss Function) -1
http://www.ics.uci.edu/~dramanan/teaching/ics273a_winter08/lectures/lecture14.pdf Loss Function 损失函数 ...

xgboost使用自定义的loss function

xgboost使用自定义的loss function相关推荐

最新文章

热门文章