Elasticsearch生产实战（ik分词器、拼音分词、自动补全、自动纠错）

一.IK分词器

1.IK分词器介绍

2.安装

3.使用

4.自定义词库

二.拼音分词器

1.拼音分词器介绍

2.安装

三.自动补全

1.效果演示

2.实战

四.自动纠错

1.场景描述

2.DSL实现

3.java实现

五.仿京东实战

一.IK分词器

1.IK分词器介绍

默认的中文分词是将每个字看成一个词，这显然是不符合要求的，所以我们需要安装中
文分词器来解决这个问题。

IK分词是一款国人开发的相对简单的中文分词器。虽然开发者自2012年之后就不在维护
了，但在工程应用中IK算是比较流行的一款！我们今天就介绍一下IK中文分词器的使用。

2.安装

ik分词器下载地址
https://github.com/medcl/elasticsearch-analysis-ik/releases

链接：https://pan.baidu.com/s/1z49plwtgCzxprTibFviLlw
提取码：c8xg

（1）先将其解压，将解压后的elasticsearch文件夹重命名文件夹为ik

（2）将ik文件夹拷贝到elasticsearch/plugins 目录下

（3）重新启动es，即可加载IK分词器

3.使用

下面看下效果吧~，如果没有IK分词器会将所有的字都拆分当成词语

postman请求测试【最小切分】：http://127.0.0.1:9200/testindex/_analyze

post请求，参数为：{"analyzer": "ik_smart", "text": "北京天安门" }

postman请求测试【最小切分】： http://127.0.0.1:9200/testindex/_analyze

post请求参数为：{"analyzer": "ik_max_word", "text": "北京天安门" }

4.自定义词库

现在测试ik分词器中没有配置过的特殊词语时，还是会对所有字分词，这时候需要自定义词库

如下：

http://127.0.0.1:9200/testindex/_analyze

{"analyzer": "ik_max_word", "text": "你个老6" }

（1）进入elasticsearch/plugins/ik/config目录

（2）新建一个my.dic文件，编辑内容：你个老6

修改IKAnalyzer.cfg.xml（在ik/config目录下）

重新启动elasticsearch，测试分词效果

二.拼音分词器

1.拼音分词器介绍

pinyin 分词器可以让用户输入拼音，就能查找到相关的关键词。比如在某个商城搜索中，输入 shuihu，就能匹配到水壶。这样的体验还是非常好的。

2.安装

拼音分词器安装地址：

Releases · medcl/elasticsearch-analysis-pinyin · GitHub

从github上下载对应es版本的拼音分词器，解压到plugins目录下，重命名为pinyin，重启es即可生效

测试

创建索引

#创建索引
PUT /medcl/
{"settings" : {"analysis" : {"analyzer" : {"pinyin_analyzer" : {"tokenizer" : "my_pinyin"}},"tokenizer" : {"my_pinyin" : {"type" : "pinyin","keep_separate_first_letter" : false,"keep_full_pinyin" : true,"keep_original" : true,"limit_first_letter_length" : 16,"lowercase" : true,"remove_duplicated_term" : true}}}}
}

#查看分词效果
GET /medcl/_analyze
{"text": ["汤兵兵"],"analyzer": "pinyin_analyzer"
}

{"tokens" : [{"token" : "tang","start_offset" : 0,"end_offset" : 0,"type" : "word","position" : 0},{"token" : "汤兵兵","start_offset" : 0,"end_offset" : 0,"type" : "word","position" : 0},{"token" : "tbb","start_offset" : 0,"end_offset" : 0,"type" : "word","position" : 0},{"token" : "bing","start_offset" : 0,"end_offset" : 0,"type" : "word","position" : 1}]
}

创建映射

#创建映射
POST /medcl/_mapping
{"properties": {"name": {"type": "keyword","fields": {"pinyin": {"type": "text","store": false,"term_vector": "with_offsets","analyzer": "pinyin_analyzer","boost": 10}}}}
}

批量添加数据

#批量添加数据
POST /medcl/_bulk
{"index": {"_index": "medcl","_id": "1"}}
{"name":"汤兵兵"}
{"index": {"_index": "medcl","_id": "2"}}
{"name":"阚阳阳"}
{"index": {"_index": "medcl","_id": "3"}}
{"name":"汤一辰"}
{"index": {"_index": "medcl","_id": "4"}}
{"name":"汤得明"}
{"index": {"_index": "medcl","_id": "5"}}
{"name":"张继琴"}
{"index": {"_index": "medcl","_id": "6"}}
{"name":"阚佳武"}
{"index": {"_index": "medcl","_id": "7"}}
{"name":"施玉芬"}
{"index": {"_index": "medcl","_id": "8"}}
{"name":"陆毅"}
{"index": {"_index": "medcl","_id": "9"}}
{"name":"刘德华"}

测试拼音搜索


#拼音分词搜索
GET /medcl/_search
{"query": {"match": {"name.pinyin": "tbb"}}
}

拼音分词器可选参数配置

** 可选参数 **keep_first_letter ： 启用此选项时，例如：刘德华 > ldh，默认值：true
keep_separate_first_letter ： 启用该选项时，将保留第一个字母分开，例如：刘德华 > l，d，h，默认：假的，注意：查询结果也许是太模糊，由于长期过频
limit_first_letter_length ： 设置 first_letter 结果的最大长度，默认值：16
keep_full_pinyin ： 当启用该选项，例如：刘德华 > [liu，de，hua]，默认值：true
keep_joined_full_pinyin ： 启用此选项时，例如：刘德华 > [liudehua]，默认值：false
keep_none_chinese ： 在结果中保留非中文字母或数字，默认值：true
keep_none_chinese_together ： 保持非中国信一起，默认值：true，如：DJ 音乐家 - > DJ，yin，yue，jia，当设置为 false，例如：DJ 音乐家 - > D，J，yin，yue，jia，注意：keep_none_chinese 必须先启动
keep_none_chinese_in_first_letter ： 第一个字母不能是中文，例如：刘德华 AT2016- > ldhat2016，default：true
keep_none_chinese_in_joined_full_pinyin ： 保持非中文字母加入完整拼音，例如：刘德华 2016- > liudehua2016，默认：false
none_chinese_pinyin_tokenize ： 打破非中国信成单独的拼音项，如果他们拼音，默认值：true，如：liudehuaalibaba13zhuanghan- > liu，de，hua，a，li，ba，ba，13，zhuang，han，注意： keep_none_chinese 和 keep_none_chinese_together 应首先启用
keep_original ： 当启用此选项时，也将保留原始输入，默认值：false
lowercase ： 小写非中文字母，默认值：true
trim_whitespace ： 默认值：true
remove_duplicated_term ： 当启用此选项时，将删除重复项以保存索引，例如：de 的 > de，默认值：false 注意：位置相关查询可能受影响

三.自动补全

1.效果演示

汉字自动补全

拼音自动补全

拼音首字母自动补全

2.实战

（1）数据准备

#创建索引
PUT /product_completion_index/
{"settings": {"number_of_shards": 1,"number_of_replicas": 2,"analysis": {"analyzer": {"ik_pinyin_analyzer": {"type": "custom","tokenizer": "ik_smart","filter": "pinyin_filter"}},"filter": {"pinyin_filter": {"type": "pinyin","keep_first_letter": true,"keep_separate_first_letter": false,"keep_full_pinyin": true,"keep_original": true,"limit_first_letter_length": 16,"lowercase": true,"remove_duplicated_term": true}}}}
}
#创建映射
POST /product_completion_index/_mapping
{"properties": {"name": {"type": "keyword"},"searchkey": {"type": "completion","analyzer": "ik_pinyin_analyzer"}}
}#批量新增数据
POST /product_completion_index/_bulk
{"index":{"_index":"product_completion_index","_id":"1"}}
{"name":"小米(MI)","searchkey":"小米手机"}
{"index":{"_index":"product_completion_index","_id":"2"}}
{"searchkey":"小米10","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"3"}}
{"searchkey":"小米电视","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"4"}}
{"searchkey":"小米路由器","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"5"}}
{"searchkey":"小米9","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"6"}}
{"searchkey":"小米手机","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"7"}}
{"searchkey":"小米耳环","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"8"}}
{"searchkey":"小米8","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"9"}}
{"searchkey":"小米10Pro","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"10"}}
{"searchkey":"小米笔记本","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"11"}}
{"searchkey":"小米摄像头","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"12"}}
{"searchkey":"小米电饭煲","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"13"}}
{"searchkey":"小米充电宝","name":"小米(MI)"}
{"index":{"_index":"product_completion_index","_id":"14"}}
{"searchkey":"adidas男鞋","name":"adidas男鞋"}
{"index":{"_index":"product_completion_index","_id":"15"}}
{"searchkey":"adidas女鞋","name":"adidas女鞋"}
{"index":{"_index":"product_completion_index","_id":"16"}}
{"searchkey":"adidas外套","name":"adidas外套"}
{"index":{"_index":"product_completion_index","_id":"17"}}
{"searchkey":"adidas裤子","name":"adidas裤子"}
{"index":{"_index":"product_completion_index","_id":"18"}}
{"searchkey":"adidas官方旗舰店","name":"adidas官方旗舰店"}
{"index":{"_index":"product_completion_index","_id":"19"}}
{"searchkey":"阿迪达斯袜子","name":"阿迪达斯袜子"}
{"index":{"_index":"product_completion_index","_id":"20"}}
{"searchkey":"阿迪达斯外套","name":"阿迪达斯外套"}
{"index":{"_index":"product_completion_index","_id":"21"}}
{"searchkey":"阿迪达斯运动鞋","name":"阿迪达斯运动鞋"}
{"index":{"_index":"product_completion_index","_id":"22"}}
{"searchkey":"耐克外套","name":"耐克外套"}
{"index":{"_index":"product_completion_index","_id":"23"}}
{"searchkey":"耐克运动鞋","name":"耐克运动鞋"}

（2）测试

#汉字自动补全
GET product_completion_index/_search
{
"from": 0,
"size": 100,
"suggest": {"czbk-suggest": {"prefix": "小米","completion": {"field": "searchkey","size": 20,"skip_duplicates": true}}
}
}
// 结果
{"took" : 2,"timed_out" : false,"_shards" : {"total" : 1,"successful" : 1,"skipped" : 0,"failed" : 0},"hits" : {"total" : {"value" : 0,"relation" : "eq"},"max_score" : null,"hits" : [ ]},"suggest" : {"czbk-suggest" : [{"text" : "xm","offset" : 0,"length" : 2,"options" : [{"text" : "小米10","_index" : "product_completion_index","_type" : "_doc","_id" : "2","_score" : 1.0,"_source" : {"searchkey" : "小米10","name" : "小米(MI)"}},{"text" : "小米10Pro","_index" : "product_completion_index","_type" : "_doc","_id" : "9","_score" : 1.0,"_source" : {"searchkey" : "小米10Pro","name" : "小米(MI)"}},{"text" : "小米8","_index" : "product_completion_index","_type" : "_doc","_id" : "8","_score" : 1.0,"_source" : {"searchkey" : "小米8","name" : "小米(MI)"}},{"text" : "小米9","_index" : "product_completion_index","_type" : "_doc","_id" : "5","_score" : 1.0,"_source" : {"searchkey" : "小米9","name" : "小米(MI)"}},{"text" : "小米充电宝","_index" : "product_completion_index","_type" : "_doc","_id" : "13","_score" : 1.0,"_source" : {"searchkey" : "小米充电宝","name" : "小米(MI)"}},{"text" : "小米手机","_index" : "product_completion_index","_type" : "_doc","_id" : "1","_score" : 1.0,"_source" : {"name" : "小米(MI)","searchkey" : "小米手机"}},{"text" : "小米摄像头","_index" : "product_completion_index","_type" : "_doc","_id" : "11","_score" : 1.0,"_source" : {"searchkey" : "小米摄像头","name" : "小米(MI)"}},{"text" : "小米电视","_index" : "product_completion_index","_type" : "_doc","_id" : "3","_score" : 1.0,"_source" : {"searchkey" : "小米电视","name" : "小米(MI)"}},{"text" : "小米电饭煲","_index" : "product_completion_index","_type" : "_doc","_id" : "12","_score" : 1.0,"_source" : {"searchkey" : "小米电饭煲","name" : "小米(MI)"}},{"text" : "小米笔记本","_index" : "product_completion_index","_type" : "_doc","_id" : "10","_score" : 1.0,"_source" : {"searchkey" : "小米笔记本","name" : "小米(MI)"}},{"text" : "小米耳环","_index" : "product_completion_index","_type" : "_doc","_id" : "7","_score" : 1.0,"_source" : {"searchkey" : "小米耳环","name" : "小米(MI)"}},{"text" : "小米路由器","_index" : "product_completion_index","_type" : "_doc","_id" : "4","_score" : 1.0,"_source" : {"searchkey" : "小米路由器","name" : "小米(MI)"}}]}]}
}

#拼音自动补全
GET product_completion_index/_search
{
"from": 0,
"size": 100,
"suggest": {"czbk-suggest": {"prefix": "xiaomi","completion": {"field": "searchkey","size": 20,"skip_duplicates": true}}
}
}// 结果
{"took" : 1,"timed_out" : false,"_shards" : {"total" : 1,"successful" : 1,"skipped" : 0,"failed" : 0},"hits" : {"total" : {"value" : 0,"relation" : "eq"},"max_score" : null,"hits" : [ ]},"suggest" : {"czbk-suggest" : [{"text" : "xiaomi","offset" : 0,"length" : 6,"options" : [{"text" : "小米10","_index" : "product_completion_index","_type" : "_doc","_id" : "2","_score" : 1.0,"_source" : {"searchkey" : "小米10","name" : "小米(MI)"}},{"text" : "小米10Pro","_index" : "product_completion_index","_type" : "_doc","_id" : "9","_score" : 1.0,"_source" : {"searchkey" : "小米10Pro","name" : "小米(MI)"}},{"text" : "小米8","_index" : "product_completion_index","_type" : "_doc","_id" : "8","_score" : 1.0,"_source" : {"searchkey" : "小米8","name" : "小米(MI)"}},{"text" : "小米9","_index" : "product_completion_index","_type" : "_doc","_id" : "5","_score" : 1.0,"_source" : {"searchkey" : "小米9","name" : "小米(MI)"}},{"text" : "小米充电宝","_index" : "product_completion_index","_type" : "_doc","_id" : "13","_score" : 1.0,"_source" : {"searchkey" : "小米充电宝","name" : "小米(MI)"}},{"text" : "小米手机","_index" : "product_completion_index","_type" : "_doc","_id" : "1","_score" : 1.0,"_source" : {"name" : "小米(MI)","searchkey" : "小米手机"}},{"text" : "小米摄像头","_index" : "product_completion_index","_type" : "_doc","_id" : "11","_score" : 1.0,"_source" : {"searchkey" : "小米摄像头","name" : "小米(MI)"}},{"text" : "小米电视","_index" : "product_completion_index","_type" : "_doc","_id" : "3","_score" : 1.0,"_source" : {"searchkey" : "小米电视","name" : "小米(MI)"}},{"text" : "小米电饭煲","_index" : "product_completion_index","_type" : "_doc","_id" : "12","_score" : 1.0,"_source" : {"searchkey" : "小米电饭煲","name" : "小米(MI)"}},{"text" : "小米笔记本","_index" : "product_completion_index","_type" : "_doc","_id" : "10","_score" : 1.0,"_source" : {"searchkey" : "小米笔记本","name" : "小米(MI)"}},{"text" : "小米耳环","_index" : "product_completion_index","_type" : "_doc","_id" : "7","_score" : 1.0,"_source" : {"searchkey" : "小米耳环","name" : "小米(MI)"}},{"text" : "小米路由器","_index" : "product_completion_index","_type" : "_doc","_id" : "4","_score" : 1.0,"_source" : {"searchkey" : "小米路由器","name" : "小米(MI)"}}]}]}
}

#首字母自动补全
GET product_completion_index/_search
{
"from": 0,
"size": 100,
"suggest": {"czbk-suggest": {"prefix": "xm","completion": {"field": "searchkey","size": 20,"skip_duplicates": true}}
}
}//结果
{"took" : 1,"timed_out" : false,"_shards" : {"total" : 1,"successful" : 1,"skipped" : 0,"failed" : 0},"hits" : {"total" : {"value" : 0,"relation" : "eq"},"max_score" : null,"hits" : [ ]},"suggest" : {"czbk-suggest" : [{"text" : "xm","offset" : 0,"length" : 2,"options" : [{"text" : "小米10","_index" : "product_completion_index","_type" : "_doc","_id" : "2","_score" : 1.0,"_source" : {"searchkey" : "小米10","name" : "小米(MI)"}},{"text" : "小米10Pro","_index" : "product_completion_index","_type" : "_doc","_id" : "9","_score" : 1.0,"_source" : {"searchkey" : "小米10Pro","name" : "小米(MI)"}},{"text" : "小米8","_index" : "product_completion_index","_type" : "_doc","_id" : "8","_score" : 1.0,"_source" : {"searchkey" : "小米8","name" : "小米(MI)"}},{"text" : "小米9","_index" : "product_completion_index","_type" : "_doc","_id" : "5","_score" : 1.0,"_source" : {"searchkey" : "小米9","name" : "小米(MI)"}},{"text" : "小米充电宝","_index" : "product_completion_index","_type" : "_doc","_id" : "13","_score" : 1.0,"_source" : {"searchkey" : "小米充电宝","name" : "小米(MI)"}},{"text" : "小米手机","_index" : "product_completion_index","_type" : "_doc","_id" : "1","_score" : 1.0,"_source" : {"name" : "小米(MI)","searchkey" : "小米手机"}},{"text" : "小米摄像头","_index" : "product_completion_index","_type" : "_doc","_id" : "11","_score" : 1.0,"_source" : {"searchkey" : "小米摄像头","name" : "小米(MI)"}},{"text" : "小米电视","_index" : "product_completion_index","_type" : "_doc","_id" : "3","_score" : 1.0,"_source" : {"searchkey" : "小米电视","name" : "小米(MI)"}},{"text" : "小米电饭煲","_index" : "product_completion_index","_type" : "_doc","_id" : "12","_score" : 1.0,"_source" : {"searchkey" : "小米电饭煲","name" : "小米(MI)"}},{"text" : "小米笔记本","_index" : "product_completion_index","_type" : "_doc","_id" : "10","_score" : 1.0,"_source" : {"searchkey" : "小米笔记本","name" : "小米(MI)"}},{"text" : "小米耳环","_index" : "product_completion_index","_type" : "_doc","_id" : "7","_score" : 1.0,"_source" : {"searchkey" : "小米耳环","name" : "小米(MI)"}},{"text" : "小米路由器","_index" : "product_completion_index","_type" : "_doc","_id" : "4","_score" : 1.0,"_source" : {"searchkey" : "小米路由器","name" : "小米(MI)"}}]}]}
}

（3）代码实现

返回数据封装

package com.tangbb.elasticsearch.pojo;//import com.fasterxml.jackson.annotation.JsonInclude;import com.alibaba.fastjson.annotation.JSONField;
import com.alibaba.fastjson.serializer.SerializerFeature;
import com.fasterxml.jackson.annotation.JsonInclude;
import com.tangbb.elasticsearch.pojo.ResultEnum;import java.io.Serializable;/*** @Class: ResponseData* @Package com.itheima.commons.result* @Description: 数据返回封装类* @Company: http://www.itheima.com/*/
//如果加该注解的字段为null,那么就不序列化
@JsonInclude(JsonInclude.Include.NON_NULL)
public class ResponseData<T> implements Serializable {//返回码private String code;//返回信息private String desc;//返回的数据private T data;//返回数据总数private Integer count;public Integer getCount() {return count;}public void setCount(Integer count) {this.count = count;}public String getCode() {return code;}public void setCode(String code) {this.code = code;}public String getDesc() {return desc;}public T getData() {return data;}public ResponseData(T data, ResultEnum resultEnum) {this.code = resultEnum.getCode();this.desc = resultEnum.getDecs();this.data = data;}public ResponseData(ResultEnum resultEnum) {this.code = resultEnum.getCode();this.desc = resultEnum.getDecs();}public ResponseData(String code, String desc) {this.code = code;this.desc = desc;}public ResponseData setResultEnum(ResultEnum result) {this.code = result.getCode();this.desc = result.getDecs();return this;}public ResponseData setResultEnum(T data, ResultEnum resultEnum, Integer count) {this.code = resultEnum.getCode();this.desc = resultEnum.getDecs();this.data = data;this.count = count;return this;}public ResponseData(T data, ResultEnum resultEnum, Integer count) {this.code = resultEnum.getCode();this.desc = resultEnum.getDecs();this.data = data;this.count = count;}public ResponseData() {}public ResponseData setResultEnum(String code, String desc) {this.code = code;this.desc = desc;return this;}
}

枚举类

package com.tangbb.elasticsearch.pojo;/*** @Class: ResultEnum* @Package com.itheima.commons.enums* @Description: 操作提示枚举类* @Company: http://www.itheima.com/*/
public enum ResultEnum {success("200", "操作成功！"),param_isnull("-400", "参数为空"),error("-402", "操作失败！"),server_error("-500", "服务异常"),data_existent("-504", "数据不存在"),result_empty("-000", "查询内容为空"),NOT_SYSTEM_API("404", "不是系统指定api"),REPEAT("666", "数据已存在"),HTTP_ERROR("-405", "请求异常");private String code;private String decs;public String getCode() {return code;}public String getDecs() {return decs;}ResultEnum(String code, String decs) {this.code = code;this.decs = decs;}}

日志类

package com.tangbb.elasticsearch.pojo;/*** @Class: ResultEnum* @Package com.itheima.commons.enums* @Description: 应用层操作提示* @Company: http://www.itheima.com/*/
public enum TipsEnum {create_index_success("创建索引成功！"),create_index_fail("创建索引失败！"),delete_index_success("删除索引成功！"),delete_index_fail("删除索引失败！"),open_index_success("打开索引成功！"),open_index_fail("打开索引失败！"),close_index_success("关闭索引成功！"),close_index_fail("关闭索引失败！"),alias_index_success("索引别名设置成功！"),alias_index_fail("索引别名设置失败！"),exists_index_success("索引是否存在查询成功！"),exists_index_fail("引是否存在查询失败！"),create_doc_success("创建文档成功！"),create_doc_fail("创建文档失败！"),batch_create_doc_success("批量创建文档成功！"),batch_create_doc_fail("批量创建文档失败！"),update_doc_success("修改文档成功！"),update_doc_fail("修改文档失败！"),get_doc_success("查询文档成功！"),batch_get_doc_fail("批量查询文档失败！"),batch_get_doc_success("批量查询文档成功！"),get_doc_fail("查询文档失败！"),delete_doc_success("删除文档成功！"),delete_doc_fail("删除文档失败！"),csuggest_get_doc_fail("自动补全获取失败！"),csuggest_get_doc_success("自动补全获取成功！"),psuggest_get_doc_fail("拼写纠错获取失败！"),psuggest_get_doc_success("拼写纠错获取成功！"),tsuggest_get_doc_fail("搜索推荐获取失败！"),tsuggest_get_doc_success("搜索推荐获取成功！"),hotwords_get_doc_fail("搜索热词获取失败！"),hotwords_get_doc_success("搜索热词获取成功！"),metricagg_get_doc_fail("指标聚合处理失败！"),metricagg_get_doc_success("指标聚合处理成功！"),bucketagg_get_doc_fail("桶聚合处理失败！"),bucketagg_get_doc_success("桶聚合处理成功！"),index_default("索引创建失败！");private String message;public String getMessage() {return message;}TipsEnum(String message) {this.message = message;}}

实体类

package com.tangbb.elasticsearch.pojo;import com.fasterxml.jackson.annotation.JsonInclude;import java.io.Serializable;
import java.util.List;
import java.util.Map;/*** @Class: CommonEntity* @Package com.itheima.commons.pojo* @Description: 公共实体类* @Company: http://www.itheima.com/*/
//如果加该注解的字段为null,那么就不序列化
@JsonInclude(JsonInclude.Include.NON_NULL)
public class CommonEntity implements Serializable {//页码private int pageNumber;//每页数据条数private int pageSize;//索引名称private String indexName;//高亮列private String highlight;//排序 DESC  ASCprivate String sortOrder;//排序列private String sortField;//自动补全建议列private String suggestFileld;//自动补全建议值private String suggestValue;//自动补全返回个数private Integer suggestCount;//动态查询参数封装Map<String, Object> map;//批量增加listprivate List<Map<String, Object>> list;public int getPageNumber() {return pageNumber;}public void setPageNumber(int pageNumber) {this.pageNumber = pageNumber;}public int getPageSize() {return pageSize;}public void setPageSize(int pageSize) {this.pageSize = pageSize;}public String getIndexName() {return indexName;}public void setIndexName(String indexName) {this.indexName = indexName;}public String getHighlight() {return highlight;}public void setHighlight(String highlight) {this.highlight = highlight;}public String getSortOrder() {return sortOrder;}public void setSortOrder(String sortOrder) {this.sortOrder = sortOrder;}public String getSortField() {return sortField;}public void setSortField(String sortField) {this.sortField = sortField;}public String getSuggestFileld() {return suggestFileld;}public void setSuggestFileld(String suggestFileld) {this.suggestFileld = suggestFileld;}public String getSuggestValue() {return suggestValue;}public void setSuggestValue(String suggestValue) {this.suggestValue = suggestValue;}public Integer getSuggestCount() {return suggestCount;}public void setSuggestCount(Integer suggestCount) {this.suggestCount = suggestCount;}public Map<String, Object> getMap() {return map;}public void setMap(Map<String, Object> map) {this.map = map;}public List<Map<String, Object>> getList() {return list;}public void setList(List<Map<String, Object>> list) {this.list = list;}
}

控制层

 /** @Description 自动补全* @Method: suggester* @Param: [commonEntity]* @Update:* @since: 1.0.0* @Return: com.oldlu.commons.result.ResponseData**/@GetMapping(value = "/csuggest")public ResponseData cSuggest(@RequestBody CommonEntity commonEntity) {// 构造返回数据ResponseData rData = new ResponseData();if (StringUtils.isEmpty(commonEntity.getIndexName()) ||StringUtils.isEmpty(commonEntity.getSuggestFileld()) ||StringUtils.isEmpty(commonEntity.getSuggestValue())) {rData.setResultEnum(ResultEnum.param_isnull);return rData;}//批量查询返回结果List<String> result = null;try {//通过高阶API调用批量新增操作方法result = contentService.cSuggest(commonEntity);//通过类型推断自动装箱（多个参数取交集）rData.setResultEnum(result, ResultEnum.success, result.size());//日志记录logger.info(TipsEnum.get_doc_success.getMessage());} catch (Exception e) {//日志记录logger.error(TipsEnum.get_doc_fail.getMessage(), e);//构建错误返回信息rData.setResultEnum(ResultEnum.error);}return rData;}

服务层

//自动补全/** @Description: 自动补全 根据用户的输入联想到可能的词或者短语* @Method: suggester* @Param: [commonEntity]* @Update:* @since: 1.0.0* @Return: org.elasticsearch.action.search.SearchResponse**/public List<String> cSuggest(CommonEntity commonEntity) throws Exception {//定义返回List<String> suggestList = new ArrayList<>();//构建查询请求SearchRequest searchRequest = newSearchRequest(commonEntity.getIndexName());//通过查询构建器定义评分排序SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();searchSourceBuilder.sort(new ScoreSortBuilder().order(SortOrder.DESC));//构造搜索建议语句,搜索条件字段CompletionSuggestionBuilder completionSuggestionBuilder =newCompletionSuggestionBuilder(commonEntity.getSuggestFileld());//搜索关键字completionSuggestionBuilder.prefix(commonEntity.getSuggestValue());//去除重复completionSuggestionBuilder.skipDuplicates(true);//匹配数量completionSuggestionBuilder.size(commonEntity.getSuggestCount());searchSourceBuilder.suggest(new SuggestBuilder().addSuggestion("czbk-suggest", completionSuggestionBuilder));//czbk-suggest为返回的字段，所有返回将在czbk-suggest里面，可写死,sort按照评分排序searchRequest.source(searchSourceBuilder);//定义查找响应SearchResponse suggestResponse = restHighLevelClient.search(searchRequest,RequestOptions.DEFAULT);//定义完成建议对象CompletionSuggestion completionSuggestion =suggestResponse.getSuggest().getSuggestion("czbk-suggest");List<CompletionSuggestion.Entry.Option> optionsList =completionSuggestion.getEntries().get(0).getOptions();//从optionsList取出结果if (!CollectionUtils.isEmpty(optionsList)) {optionsList.forEach(item ->suggestList.add(item.getText().toString()));}return suggestList;}

测试结果

http://localhost:9090/csuggest

四.自动纠错

1.场景描述

例如：错误输入"【adidaas官方旗舰店】 ”能够纠错为【adidas官方旗舰店】

2.DSL实现

#自动纠错
GET product_completion_index/_search
{
"suggest": {"czbk-suggestion": {"text": "adidaas官方旗舰店","phrase": {"field": "name","size": 13}}
}
}

3.java实现

控制层

/** @Description: 拼写纠错* @Method: suggester2* @Param: [commonEntity]* @Update:* @since: 1.0.0* @Return: com.oldlu.commons.result.ResponseData**/@GetMapping(value = "/psuggest")public ResponseData pSuggest(@RequestBody CommonEntity commonEntity) {// 构造返回数据ResponseData rData = new ResponseData();if (StringUtils.isEmpty(commonEntity.getIndexName()) ||StringUtils.isEmpty(commonEntity.getSuggestFileld()) ||StringUtils.isEmpty(commonEntity.getSuggestValue())) {rData.setResultEnum(ResultEnum.param_isnull);return rData;}//批量查询返回结果String result = null;try {//通过高阶API调用批量新增操作方法result = contentService.pSuggest(commonEntity);//通过类型推断自动装箱（多个参数取交集）rData.setResultEnum(result, ResultEnum.success, null);//日志记录logger.info(TipsEnum.get_doc_success.getMessage());} catch (Exception e) {//日志记录logger.error(TipsEnum.batch_get_doc_fail.getMessage(), e);//构建错误返回信息rData.setResultEnum(ResultEnum.error);}return rData;}

服务层

/** @Description: 拼写纠错* @Method: psuggest* @Param: [commonEntity]* @Update:* @since: 1.0.0* @Return: java.util.List<java.lang.String>**/public String pSuggest(CommonEntity commonEntity) throws Exception {//定义返回String pSuggestString = new String();//定义查询请求SearchRequest searchRequest = newSearchRequest(commonEntity.getIndexName());//定义查询条件构建器SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();//定义排序器searchSourceBuilder.sort(new ScoreSortBuilder().order(SortOrder.DESC));//构造短语建议器对象（参数为匹配列）PhraseSuggestionBuilder pSuggestionBuilder = newPhraseSuggestionBuilder(commonEntity.getSuggestFileld());//搜索关键字（被纠错的值）pSuggestionBuilder.text(commonEntity.getSuggestValue());//匹配数量pSuggestionBuilder.size(1);searchSourceBuilder.suggest(new SuggestBuilder().addSuggestion("czbk-suggest", pSuggestionBuilder));searchRequest.source(searchSourceBuilder);//定义查找响应SearchResponse suggestResponse = restHighLevelClient.search(searchRequest,RequestOptions.DEFAULT);//定义短语建议对象PhraseSuggestion phraseSuggestion =suggestResponse.getSuggest().getSuggestion("czbk-suggest");//获取返回数据List<PhraseSuggestion.Entry.Option> optionsList =phraseSuggestion.getEntries().get(0).getOptions();//从optionsList取出结果if (!CollectionUtils.isEmpty(optionsList)&&optionsList.get(0).getText()!=null) {pSuggestString = optionsList.get(0).getText().string().replaceAll(" ","");}return pSuggestString;}

测试

http://localhost:9090/psuggest

五.仿京东实战

仿京东实战完整代码详见我的gitee，代码地址如下

https://gitee.com/EkkoBoy/elasticsearch.git