Google WideDeep Model

谷歌的GooglePlay的推荐模型Wide and Deep Learning 模型，目前已经提供了tensorflow的开源版本。

本文使用keras完成：

#coding: utf-8
'''
用keras写的google Wide&&Deep model
'''

import pandas as pd
from keras.models import Sequential
from keras.layers import Dense, Merge
from sklearn.preprocessing import MinMaxScaler

#所有的数据列
COLUMNS = [
    "age", "workclass", "fnlwgt", "education", "education_num", "marital_status",
    "occupation", "relationship", "race", "gender", "capital_gain", "capital_loss",
    "hours_per_week", "native_country", "income_bracket"
]

#标签列
LABEL_COLUMN = "label"

#类别型特征变量
CATEGORICAL_COLUMNS = [
"workclass", "education", "marital_status", "occupation", "relationship",
"race", "gender", "native_country"
]

#连续值特征变量
CONTINUOUS_COLUMNS = [
"age", "education_num", "capital_gain", "capital_loss", "hours_per_week"
]

#加载文件
def load(filename):
    with open(filename, 'r') as f:
        skiprows = 1 if 'test' in filename else 0
        df = pd.read_csv(
            f, names=COLUMNS, skipinitialspace=True, skiprows=skiprows, engine='python'
        )
        #缺省值处理
        df = df.dropna(how='any', axis=0)
    return df

#预处理
def preprocess(df):
    df[LABEL_COLUMN] = df['income_bracket'].apply(lambda x: ">50K" in x).astype(int)
    df.pop("income_bracket")
    y = df[LABEL_COLUMN].values
    df.pop(LABEL_COLUMN)

    df = pd.get_dummies(df, columns=[x for x in CATEGORICAL_COLUMNS])

# TODO: 对特征进行选择，使得网络更高效

    # TODO: 特征工程，比如加入交叉与组合特征
    # from sklearn.preprocessing import PolynomialFeatures
    # X = PolynomialFeatures(degree=2, interaction_only=True, include_bias=False).fit_transform(X)

    df = pd.DataFrame(MinMaxScaler().fit_transform(df), columns=df.columns)

X = df.values
return X, y

def main():
    df_train = load('E:\\adult.data')
    df_test = load('E:\\adult.test')
    df = pd.concat([df_train, df_test])
    train_len = len(df_train)

    X, y = preprocess(df)
    X_train = X[:train_len]
    y_train = y[:train_len]
    X_test = X[train_len:]
    y_test = y[train_len:]

    #Wide部分
    wide = Sequential()
    wide.add(Dense(1, input_dim=X_train.shape[1]))

    #Deep部分
    deep = Sequential()
    # TODO: 添加embedding层
    deep.add(Dense(input_dim=X_train.shape[1], output_dim=100, activation='relu'))
    #deep.add(Dense(100, activation='relu'))
    deep.add(Dense(input_dim=100, output_dim=32, activation='relu'))
    #deep.add(Dense(50, activation='relu'))
    deep.add(Dense(input_dim=32, output_dim=8))
    deep.add(Dense(1, activation='sigmoid'))

    #Wide和Deep拼接
    model = Sequential()
    model.add(Merge([wide, deep], mode='concat', concat_axis=1))
    model.add(Dense(1, activation='sigmoid'))

    #编译模型
    model.compile(
        optimizer='rmsprop',
        loss='binary_crossentropy',
        metrics=['accuracy']
    )

    #模型训练
    model.fit([X_train, X_train], y_train, nb_epoch=10, batch_size=32)

    #loss与准确率评估
    loss, accuracy = model.evaluate([X_test, X_test], y_test)
    print('\n', 'test accuracy:', accuracy)

if __name__ == '__main__':
    main()

Google WideDeep Model相关推荐

WideDeep Model、Wide Model（LR）、Deep Model、DeepFm Model、NFM Model复现笔记
声明:本模型复现笔记记录自己学习过程,如果有错误请各位老师批评指正. 本周复现了Wide&Deep Model.Wide Model.Deep Model.DeepFm Model.NFM M ...
深度学习02——Softmax、DNN、WideDeep Model
说明:本系列是七月算法深度学习课程的学习笔记 1 背景介绍深度学习在图片上的应用:功能上讲:图像分类和物体识别:应用上:可以用来分类图片:白菜形状的玉器摆件.白菜.大白菜:图片搜索:给照片打标签:识 ...
Softmax, DNN, WideDeep Model
推荐系统入门（四）：WideDeep（附代码）
推荐系统入门(四):Wide&Deep(附代码) 目录推荐系统入门(四):Wide&Deep(附代码) 引言点击率预估简介 FM它不香吗 1.Wide&Deep模型 2. ...
Model Search，了解一下？
选自 googleblog 作者:Hanna Mazzawi等机器之心编译编辑:魔王.杜伟为了帮助研究者自动.高效地开发最佳机器学习模型,谷歌开源了一个不针对特定领域的 AutoML 平台.该平 ...
AutoML大提速，谷歌开源自动化寻找最优ML模型新平台Model Search
作者|魔王.杜伟来源|机器之心为了帮助研究者自动.高效地开发最佳机器学习模型,谷歌开源了一个不针对特定领域的 AutoML 平台.该平台基于 TensorFlow 构建,非常灵活,既可以找出最适合 ...
Alex Hanna博士：Google道德AI小组研究员
Alex Hanna博士是社会学家和研究科学家,致力于Google的机器学习公平性和道德AI. (Dr. Alex Hanna is a sociologist and research scient ...
用AutoML找到更小、更快、更好的模型，谷歌开源Model Search
本文转载自机器之心. 作者:Hanna Mazzawi等编辑:魔王.杜伟为了帮助研究者自动.高效地开发最佳机器学习模型,谷歌开源了一个不针对特定领域的 AutoML 平台.该平台基于 Tensor ...
推荐系统组队学习——WideDeep
文章目录一.点击率预估简介二.Wide&Deep原理三.代码实现四.深度学习推荐系统以后的发展一.点击率预估简介点击率预估是对每次广告点击情况作出预测,可以输出点击或者不点击,也可 ...

Google WideDeep Model

Google WideDeep Model相关推荐

最新文章

热门文章