springboot集成Elasticsearch实现各种搜索功能

springboot集成Elasticsearch各类搜索功能实现

springboot集成Elasticsearch使用completion suggest实现自动关键字补全
- 建立学生的索引和映射：
- 开始测试：
- 接下来是实现获取suggest的代码：
- 前端代码
实现Fuzzy模糊查询
- es中的Fuzzy查询语句示例
- Java实现Fuzzy和高亮返回
数组元素查询
Elasticsearch许可证过期

环境准备：
Elasticsearch服务器
ik中文分词器
Kibana服务
一个集成了ES的springboot项目

博主环境：
es:6.2.2 Kibana:6.2.2 springboot:2.1.2

springboot集成Elasticsearch使用completion suggest实现自动关键字补全

定义成completion的字段无法应用highlight返回。

实现目标：建立学生数据索引，以学生姓名为搜索自动补全字段。
学生实体类：

@Document(indexName = "student_index",type="student")
public class Student implements Serializable {@Id@Field(type= FieldType.Auto)private String studentId;

@Override
public String toString() {return "Student{" +"studentId='" + studentId + '\'' +", name='" + name + '\'' +", age=" + age +", scores=" + scores +'}';
}public Student(String studentId, String name, Integer age, List&lt;Double&gt; scores) {this.studentId = studentId;this.name = name;this.age = age;this.scores = scores;
}public Student() {}public String getStudentId() {return studentId;
}public void setStudentId(String studentId) {this.studentId = studentId;
}public String getName() {return name;
}public void setName(String name) {this.name = name;
}public Integer getAge() {return age;
}public void setAge(Integer age) {this.age = age;
}public List&lt;Double&gt; getScores() {return scores;
}public void setScores(List&lt;Double&gt; scores) {this.scores = scores;
}@Field(type=FieldType.Auto)
private String name;@Field(type=FieldType.Auto)
private Integer age;@Field(type=FieldType.Auto)
private List&lt;Double&gt; scores;
}

建立学生的索引和映射：

待搜索的字段需要设置为Completion类型

PUT /student_index
{"mappings": {"student" : {"properties" : {"name" : {"type" :    "completion","analyzer": "ik_smart"},"age" : {"type" :   "integer"},      "studentId" : {"type" :   "text"},        "scores":{"type" :  "float"         }       }}}
}

整点数据测试一下：

学生索引Repository类：

@Repository
public interface StudentRepository extends ElasticsearchCrudRepository<Student,String>{
}

开始测试：

在程序里插入一些数据；

@Autowiredprivate ElasticsearchTemplate elasticsearchTemplate;@Testpublic void contextLoads() {List scores= new ArrayList<>();scores.add(67.2);scores.add(27.2);scores.add(56.2);
/*      studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "张三", 21, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "李四", 35, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "王二", 45, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "张大林", 23, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "王大力", 51, scores ));*/studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "刘伯", 21, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "刘思想", 35, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "王皮皮", 45, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "王二丫", 23, scores ));studentIndexRepository.save(new Student(UUID.randomUUID().toString(), "王铁蛋", 51, scores ));}

在Kibana测试

POST /student_index/completion/_search
{ "size": 0,"suggest": {"name-suggest": {"prefix": "王二","completion": {"field": "name"}}}
}

结果正确：

接下来是实现获取suggest的代码：

测试方法

 @Testpublic void testSuggestCompletionProc() {String suggestField="name";//指定在哪个字段搜索String suggestValue="王二";//输入的信息Integer suggestMaxCount=10;//获得最大suggest条数

  CompletionSuggestionBuilder suggestionBuilderDistrict = new CompletionSuggestionBuilder(suggestField).prefix(suggestValue).size(suggestMaxCount);SuggestBuilder suggestBuilder = new SuggestBuilder();suggestBuilder.addSuggestion("student_suggest", suggestionBuilderDistrict);//添加suggest//设置查询builder的index,type,以及建议SearchRequestBuilder requestBuilder = this.elasticsearchTemplate.getClient().prepareSearch("student_index").setTypes("student").suggest(suggestBuilder);System.out.println(requestBuilder.toString());SearchResponse response = requestBuilder.get();Suggest suggest = response.getSuggest();//suggest实体Set&lt;String&gt; suggestSet = new HashSet&lt;&gt;();//setint maxSuggest = 0;if (suggest != null) {Suggest.Suggestion result = suggest.getSuggestion("student_suggest");//获取suggest,name任意stringfor (Object term : result.getEntries()) {if (term instanceof CompletionSuggestion.Entry) {CompletionSuggestion.Entry item = (CompletionSuggestion.Entry) term;if (!item.getOptions().isEmpty()) {//若item的option不为空,循环遍历for (CompletionSuggestion.Entry.Option option : item.getOptions()) {String tip = option.getText().toString();if (!suggestSet.contains(tip)) {suggestSet.add(tip);++maxSuggest;}}}}if (maxSuggest &gt;= suggestMaxCount) {break;}}}List&lt;String&gt; suggests = Arrays.asList(suggestSet.toArray(new String[]{}));suggests.forEach((s)-&gt;{System.out.println(s);});//      return   suggests;}

输出结果正确：

封装的工具方法

    /*** completion suggest* @param suggestField* @param suggestValue* @param suggestMaxCount* @param index_* @param indexType_* @param elasticsearchTemplate__* @return*/public List<String> listSuggestCompletion(String suggestField, String suggestValue, Integer suggestMaxCount,String index_,String indexType_,ElasticsearchTemplate elasticsearchTemplate__) {/* String suggestField="name";//指定在哪个字段搜索String suggestValue="王二";//输入的信息Integer suggestMaxCount=10;//获得最大suggest条数*/CompletionSuggestionBuilder suggestionBuilderDistrict = new CompletionSuggestionBuilder(suggestField).prefix(suggestValue).size(suggestMaxCount);SuggestBuilder suggestBuilder = new SuggestBuilder();suggestBuilder.addSuggestion("student_suggest", suggestionBuilderDistrict);//添加suggest//设置查询builder的index,type,以及建议if(elasticsearchTemplate__==null)System.out.println( "this is Template null  ***************************************************");SearchRequestBuilder requestBuilder = elasticsearchTemplate__.getClient().prepareSearch(index_).setTypes(indexType_).suggest(suggestBuilder);System.out.println(requestBuilder.toString());SearchResponse response = requestBuilder.get();Suggest suggest = response.getSuggest();//suggest实体Set<String> suggestSet = new HashSet<>();//setint maxSuggest = 0;if (suggest != null) {Suggest.Suggestion result = suggest.getSuggestion("student_suggest");//获取suggest,name任意stringfor (Object term : result.getEntries()) {if (term instanceof CompletionSuggestion.Entry) {CompletionSuggestion.Entry item = (CompletionSuggestion.Entry) term;if (!item.getOptions().isEmpty()) {//若item的option不为空,循环遍历for (CompletionSuggestion.Entry.Option option : item.getOptions()) {String tip = option.getText().toString();if (!suggestSet.contains(tip)) {suggestSet.add(tip);++maxSuggest;}}}}if (maxSuggest >= suggestMaxCount) {break;}}}List<String> suggests = Arrays.asList(suggestSet.toArray(new String[]{}));suggests.forEach((s)->{System.out.println(s);});return     suggests;}

前端代码

前端自动补全用JqueryUI的autocomplete组件。

<script>var availableTags = new Array();$(function() {$("#tags").autocomplete({source: availableTags});});$(document).ready(function() {$("#tags").bind("input propertychange", function () {$("#valuetext").html($(this).val());$.get("searchSuggest?value="+$(this).val(), function (data, status) {var results=data;for(var i=0;i<results.length;i++){availableTags[i]=results[i].texts;}$("#tags").autocomplete({source: availableTags});});});})
</script>

<input type=“search” id=“tags” name=“searchvalue” class=“form-control” style=“border-radius: 50px 0 0 50px;” placeholder=“请搜索…”>

实现Fuzzy模糊查询

Fuzzy有纠错功能
应用Fuzzy查询的字段需要是 text 类型的。

es中的Fuzzy查询语句示例

GET /indextest/testmapping/_search/
{"query": {"fuzzy": {"namePinyin": {"value": "zhonghuarenmingonghegu"} } } ,"highlight" :{"fields": {"namePinyin" :{}}}
}

Java实现Fuzzy和高亮返回

    /*** 拼音Fuzzy查询* @param field* @param value* @param highlightField* @param preTag* @param postTag* @param index* @param indexType* @param elasticsearchTemplate* @return*/public List<String> listSearchByPinyin(String field,String value,String highlightField ,String preTag,String postTag,String index, String indexType , ElasticsearchTemplate elasticsearchTemplate){List<String> result = new LinkedList<>();FuzzyQueryBuilder queryBuilder = QueryBuilders.fuzzyQuery(field, value).fuzziness(Fuzziness.TWO).prefixLength(0).maxExpansions(10);HighlightBuilder highlightBuilder = new HighlightBuilder();highlightBuilder.field(highlightField);highlightBuilder.preTags(preTag);highlightBuilder.postTags(postTag);SearchRequestBuilder requestBuilder = elasticsearchTemplate.getClient().prepareSearch(index).setTypes(indexType).setQuery(queryBuilder).highlighter(highlightBuilder);SearchResponse response = requestBuilder.get();System.out.println(response.getClusters().toString());System.out.println(requestBuilder.toString());SearchHits searchHits = response.getHits();searchHits.forEach(i->{System.out.println(i.getIndex());System.out.println(i.getId());System.out.println(i.getSourceAsString());Text highlightFragment = i.getHighlightFields().get(highlightField).getFragments()[0];result.add(highlightFragment.toString());System.out.println();});return result;}

数组元素查询

这个可以用作标签查询、定位。

Elasticsearch许可证过期

elasticsearch报日志：

org.elasticsearch.ElasticsearchSecurityException: current license is
non-compliant for [security]

替换许可证

到elastic**官网**https://register.elastic.co/注册一下账号，注册邮箱会收到许可证文件

将许可证放到服务器下，用的docker要进入到es容器内，重命名许可证文件名为：license.json

# curl -XPUT -u elastic:yourregistername 'http://133.3.269.211:9200/_xpack/license?acknowledge=true' -H "Content-Type: application/json" -d @license.json

这样就ok了。