日韩av黄I国产麻豆传媒I国产91av视频在线观看I日韩一区二区三区在线看I美女国产在线I麻豆视频国产在线观看I成人黄色短片

歡迎訪問(wèn) 生活随笔!

生活随笔

當(dāng)前位置: 首頁(yè) >

ElasticSearch搜索实例含高亮显示及搜索的特殊字符过滤

發(fā)布時(shí)間:2025/1/21 93 豆豆
生活随笔 收集整理的這篇文章主要介紹了 ElasticSearch搜索实例含高亮显示及搜索的特殊字符过滤 小編覺(jué)得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.

?

應(yīng)用說(shuō)明見(jiàn)代碼注解。

1.簡(jiǎn)單搜索實(shí)例展示:

public void search() throws IOException {// 自定義集群結(jié)點(diǎn)名稱String clusterName = "elasticsearch_pudongping";// 獲取客戶端Client client = ESClient.initClient(clusterName);// 創(chuàng)建查詢索引,參數(shù)productindex表示要查詢的索引庫(kù)為productindexSearchRequestBuilder searchRequestBuilder = client.prepareSearch("productindex");// 設(shè)置查詢索引類型,setTypes("productType1", "productType2","productType3");// 用來(lái)設(shè)定在多個(gè)類型中搜索searchRequestBuilder.setTypes("productIndex");// 設(shè)置查詢類型 1.SearchType.DFS_QUERY_THEN_FETCH = 精確查詢 2.SearchType.SCAN =// 掃描查詢,無(wú)序searchRequestBuilder.setSearchType(SearchType.DFS_QUERY_THEN_FETCH);// 設(shè)置查詢關(guān)鍵詞searchRequestBuilder.setQuery(QueryBuilders.fieldQuery("title", "Acer"));// 查詢過(guò)濾器過(guò)濾價(jià)格在4000-5000內(nèi) 這里范圍為[4000,5000]區(qū)間閉包含,搜索結(jié)果包含價(jià)格為4000和價(jià)格為5000的數(shù)據(jù)searchRequestBuilder.setFilter(FilterBuilders.rangeFilter("price").from(4000).to(5000));// 分頁(yè)應(yīng)用searchRequestBuilder.setFrom(0).setSize(60);// 設(shè)置是否按查詢匹配度排序searchRequestBuilder.setExplain(true);// 執(zhí)行搜索,返回搜索響應(yīng)信息SearchResponse response = searchRequestBuilder.execute().actionGet();SearchHits searchHits = response.getHits();SearchHit[] hits = searchHits.getHits();for (int i = 0; i < hits.length; i++) {SearchHit hit = hits[i];Map<String, Object> result = hit.getSource();// 打印map集合:{id=26, onSale=true, title=宏基Acer樂(lè)3, price=4009.0,// description=null, createDate=1380530123140, type=2}System.out.println(result);}System.out.println("search success ..");}

說(shuō)明:

client.prepareSearch用來(lái)創(chuàng)建一個(gè)SearchRequestBuilder,搜索即由SearchRequestBuilder執(zhí)行。

client.prepareSearch方法有參數(shù)為一個(gè)或多個(gè)index,表現(xiàn)在數(shù)據(jù)庫(kù)中,即零個(gè)或多個(gè)數(shù)據(jù)庫(kù)名,你既可以使用(下面兩個(gè)都可以表示在多個(gè)索引庫(kù)中查找):

client.prepareSearch().setIndices("index1","index2","index3","index4");

或者:

client.prepareSearch("index1","index2","index3","index4");


SearchRequestBuilder常用方法說(shuō)明:

(1) setIndices(String... indices):上文中描述過(guò),參數(shù)可為一個(gè)或多個(gè)字符串,表示要進(jìn)行檢索的index;(2) setTypes(String... types):參數(shù)可為一個(gè)或多個(gè)字符串,表示要進(jìn)行檢索的type,當(dāng)參數(shù)為0個(gè)或者不調(diào)用此方法時(shí),表示查詢所有的type;setSearchType(SearchType searchType):執(zhí)行檢索的類別,值為org.elasticsearch.action.search.SearchType的元素,SearchType是一個(gè)枚舉類型的類,其值如下所示:QUERY_THEN_FETCH:查詢是針對(duì)所有的塊執(zhí)行的,但返回的是足夠的信息,而不是文檔內(nèi)容(Document)。結(jié)果會(huì)被排序和分級(jí),基于此,只有相關(guān)的塊的文檔對(duì)象會(huì)被返回。由于被取到的僅僅是這些,故而返回的hit的大小正好等于指定的size。這對(duì)于有許多塊的index來(lái)說(shuō)是很便利的(返回結(jié)果不會(huì)有重復(fù)的,因?yàn)閴K被分組了)QUERY_AND_FETCH:最原始(也可能是最快的)實(shí)現(xiàn)就是簡(jiǎn)單的在所有相關(guān)的shard上執(zhí)行檢索并返回結(jié)果。每個(gè)shard返回一定尺寸的結(jié)果。由于每個(gè)shard已經(jīng)返回了一定尺寸的hit,這種類型實(shí)際上是返回多個(gè)shard的一定尺寸的結(jié)果給調(diào)用者。DFS_QUERY_THEN_FETCH:與QUERY_THEN_FETCH相同,預(yù)期一個(gè)初始的散射相伴用來(lái)為更準(zhǔn)確的score計(jì)算分配了的term頻率。DFS_QUERY_AND_FETCH:與QUERY_AND_FETCH相同,預(yù)期一個(gè)初始的散射相伴用來(lái)為更準(zhǔn)確的score計(jì)算分配了的term頻率。SCAN:在執(zhí)行了沒(méi)有進(jìn)行任何排序的檢索時(shí)執(zhí)行瀏覽。此時(shí)將會(huì)自動(dòng)的開(kāi)始滾動(dòng)結(jié)果集。COUNT:只計(jì)算結(jié)果的數(shù)量,也會(huì)執(zhí)行facet。(4) setSearchType(String searchType),與setSearchType(SearchType searchType)類似,區(qū)別在于其值為字符串型的SearchType,值可為dfs_query_then_fetch、dfsQueryThenFetch、dfs_query_and_fetch、dfsQueryAndFetch、query_then_fetch、queryThenFetch、query_and_fetch或queryAndFetch;(5) setScroll(Scroll scroll)、setScroll(TimeValue keepAlive)和setScroll(String keepAlive),設(shè)置滾動(dòng),參數(shù)為Scroll時(shí),直接用new Scroll(TimeValue)構(gòu)造一個(gè)Scroll,為TimeValue或String時(shí)需要將TimeValue和String轉(zhuǎn)化為Scroll;(6) setTimeout(TimeValue timeout)和setTimeout(String timeout),設(shè)置搜索的超時(shí)時(shí)間;(7) setQuery,設(shè)置查詢使用的Query;(8) setFilter,設(shè)置過(guò)濾器;(9) setMinScore,設(shè)置Score的最小數(shù)量;(10) setFrom,從哪一個(gè)Score開(kāi)始查;(11) setSize,需要查詢出多少條結(jié)果;

檢索出結(jié)果后,通過(guò)response.getHits()可以得到所有的SearchHit,得到Hit后,便可迭代Hit取到對(duì)應(yīng)的Document,轉(zhuǎn)化成為需要的實(shí)體。

2.搜索高亮顯示

spring-boot-starter-data-elasticsearch高亮顯示場(chǎng)景的一個(gè)Demo


org.springframework.data.elasticsearch.core.query.NativeSearchQueryBuilder
org.springframework.data.elasticsearch.core.SearchResultMapper
org.springframework.data.domain.PageImpl
org.elasticsearch.action.search.SearchResponse
org.elasticsearch.search.SearchHit
org.elasticsearch.search.highlight.HighlightField

String preTag = "<font color='#dd4b39'>";//google的色值String postTag = "</font>";SearchQuery searchQuery = new NativeSearchQueryBuilder().withQuery(queryBuilder).withFilter(QueryBuilders.termQuery("status", CommConstants.ItemStatus.Normal)).withSort(SortBuilders.fieldSort("modifiedTime").order(SortOrder.DESC)).withPageable(pageable).withHighlightFields(new HighlightBuilder.Field("name").preTags(preTag).postTags(postTag), new HighlightBuilder.Field("memo").preTags(preTag).postTags(postTag)).build();return elasticsearchTemplate.queryForPage(searchQuery, UserDocument.class, new SearchResultMapper() {@Overridepublic <T> Page<T> mapResults(SearchResponse response, Class<T> clazz, Pageable pageable) {List<UserDocument> chunk = new ArrayList<>();for (SearchHit searchHit : response.getHits()) {if (response.getHits().getHits().length <= 0) {return null;}UserDocument user = new UserDocument();user.setId(Long.valueOf(searchHit.getId()));//name or memoeHighlightField name = searchHit.getHighlightFields().get("name");if (name != null) {user.setName(name.fragments()[0].toString());}HighlightField memo = searchHit.getHighlightFields().get("memo");if (memo != null) {user.setMemo(memo.fragments()[0].toString());}chunk.add(user);}if (chunk.size() > 0) {return new PageImpl<T>((List<T>) chunk);}return null;}});

?

?

@Test public void shouldReturnHighlightedFieldsForGivenQueryAndFields() {//givenString documentId = randomNumeric(5);String actualMessage = "some test message";String highlightedMessage = "some <em>test</em> message";SampleEntity sampleEntity = SampleEntity.builder().id(documentId).message(actualMessage).version(System.currentTimeMillis()).build();IndexQuery indexQuery = getIndexQuery(sampleEntity);elasticsearchTemplate.index(indexQuery);elasticsearchTemplate.refresh(SampleEntity.class);SearchQuery searchQuery = new NativeSearchQueryBuilder().withQuery(termQuery("message", "test")).withHighlightFields(new HighlightBuilder.Field("message")).build();Page<SampleEntity> sampleEntities = elasticsearchTemplate.queryForPage(searchQuery, SampleEntity.class, new SearchResultMapper() {@Overridepublic <T> Page<T> mapResults(SearchResponse response, Class<T> clazz, Pageable pageable) {List<SampleEntity> chunk = new ArrayList<SampleEntity>();for (SearchHit searchHit : response.getHits()) {if (response.getHits().getHits().length <= 0) {return null;}SampleEntity user = new SampleEntity();user.setId(searchHit.getId());user.setMessage((String) searchHit.getSource().get("message"));user.setHighlightedMessage(searchHit.getHighlightFields().get("message").fragments()[0].toString());chunk.add(user);}if (chunk.size() > 0) {return new PageImpl<T>((List<T>) chunk);}return null;}});assertThat(sampleEntities.getContent().get(0).getHighlightedMessage(), is(highlightedMessage)); }

http://stackoverflow.com/questions/37049764/how-to-provide-highlighting-with-spring-data-elasticsearch



SearchRequestBuilder中的addHighlightedField()方法可以定制在哪個(gè)域值的檢索結(jié)果的關(guān)鍵字上增加高亮

public void search() throws IOException {// 自定義集群結(jié)點(diǎn)名稱String clusterName = "elasticsearch_pudongping";// 獲取客戶端Client client = ESClient.initClient(clusterName); // 創(chuàng)建查詢索引,參數(shù)productindex表示要查詢的索引庫(kù)為productindexSearchRequestBuilder searchRequestBuilder = client.prepareSearch("productindex");// 設(shè)置查詢索引類型,setTypes("productType1", "productType2","productType3");// 用來(lái)設(shè)定在多個(gè)類型中搜索searchRequestBuilder.setTypes("productIndex");// 設(shè)置查詢類型 1.SearchType.DFS_QUERY_THEN_FETCH = 精確查詢 2.SearchType.SCAN = 掃描查詢,無(wú)序searchRequestBuilder.setSearchType(SearchType.DFS_QUERY_THEN_FETCH);// 設(shè)置查詢關(guān)鍵詞searchRequestBuilder.setQuery(QueryBuilders.fieldQuery("title", "Acer"));// 查詢過(guò)濾器過(guò)濾價(jià)格在4000-5000內(nèi) 這里范圍為[4000,5000]區(qū)間閉包含,搜索結(jié)果包含價(jià)格為4000和價(jià)格為5000的數(shù)據(jù)searchRequestBuilder.setFilter(FilterBuilders.rangeFilter("price").from(4000).to(5000));// 分頁(yè)應(yīng)用searchRequestBuilder.setFrom(0).setSize(60);// 設(shè)置是否按查詢匹配度排序searchRequestBuilder.setExplain(true);//設(shè)置高亮顯示searchRequestBuilder.addHighlightedField("title");searchRequestBuilder.setHighlighterPreTags("<span style=\"color:red\">");searchRequestBuilder.setHighlighterPostTags("</span>");// 執(zhí)行搜索,返回搜索響應(yīng)信息SearchResponse response = searchRequestBuilder.execute().actionGet();//獲取搜索的文檔結(jié)果SearchHits searchHits = response.getHits();SearchHit[] hits = searchHits.getHits();ObjectMapper mapper = new ObjectMapper();for (int i = 0; i < hits.length; i++) {SearchHit hit = hits[i];//將文檔中的每一個(gè)對(duì)象轉(zhuǎn)換json串值String json = hit.getSourceAsString();//將json串值轉(zhuǎn)換成對(duì)應(yīng)的實(shí)體對(duì)象Product product = mapper.readValue(json, Product.class); //獲取對(duì)應(yīng)的高亮域Map<String, HighlightField> result = hit.highlightFields(); //從設(shè)定的高亮域中取得指定域HighlightField titleField = result.get("title"); //取得定義的高亮標(biāo)簽Text[] titleTexts = titleField.fragments(); //為title串值增加自定義的高亮標(biāo)簽String title = ""; for(Text text : titleTexts){ title += text; }//將追加了高亮標(biāo)簽的串值重新填充到對(duì)應(yīng)的對(duì)象product.setTitle(title);//打印高亮標(biāo)簽追加完成后的實(shí)體對(duì)象System.out.println(product);}System.out.println("search success ..");}

?

?

程序運(yùn)行結(jié)果:

[id=8,title=宏基<span style="color:red">Acer</span>,description=宏基Acer蜂鳥(niǎo)系列,price=5000.0,onSale=true,type=1,createDate=Mon Sep 30 13:46:41 CST 2013] [id=21,title=宏基<span style="color:red">Acer</span>,description=宏基Acer蜂鳥(niǎo)系列,price=5000.0,onSale=true,type=1,createDate=Mon Sep 30 13:48:17 CST 2013] [id=7,title=宏基<span style="color:red">Acer</span>,description=宏基Acer蜂鳥(niǎo)系列,price=5000.0,onSale=true,type=1,createDate=Mon Sep 30 11:38:50 CST 2013] [id=5,title=宏基<span style="color:red">Acer</span>樂(lè)0,description=<null>,price=4000.0,onSale=true,type=1,createDate=Mon Sep 30 16:35:23 CST 2013] [id=12,title=宏基<span style="color:red">Acer</span>樂(lè)1,description=<null>,price=4003.0,onSale=false,type=2,createDate=Mon Sep 30 16:35:23 CST 2013] [id=19,title=宏基<span style="color:red">Acer</span>樂(lè)2,description=<null>,price=4006.0,onSale=false,type=1,createDate=Mon Sep 30 16:35:23 CST 2013] [id=26,title=宏基<span style="color:red">Acer</span>樂(lè)3,description=<null>,price=4009.0,onSale=true,type=2,createDate=Mon Sep 30 16:35:23 CST 2013] [id=33,title=宏基<span style="color:red">Acer</span>樂(lè)4,description=<null>,price=4012.0,onSale=false,type=1,createDate=Mon Sep 30 16:35:23 CST 2013]

從程序執(zhí)行結(jié)果中我們可以看到,我們定義的高亮標(biāo)簽已經(jīng)追加到指定的域上了.

當(dāng)搜索索引的時(shí)候,你搜索關(guān)鍵字包含了特殊字符,那么程序就會(huì)報(bào)錯(cuò)

// fieldQuery 這個(gè)必須是你的索引字段哦,不然查不到數(shù)據(jù),這里我只設(shè)置兩個(gè)字段 id ,title String title = "title+-&&||!(){}[]^\"~*?:\\"; title = QueryParser.escape(title);// 主要就是這一句把特殊字符都轉(zhuǎn)義,那么lucene就可以識(shí)別 searchRequestBuilder.setQuery(QueryBuilders.fieldQuery("title", title));


轉(zhuǎn)載請(qǐng)注明出處:[http://www.cnblogs.com/dennisit/p/3363851.html]

?

轉(zhuǎn)載于:https://www.cnblogs.com/softidea/p/6119329.html

總結(jié)

以上是生活随笔為你收集整理的ElasticSearch搜索实例含高亮显示及搜索的特殊字符过滤的全部?jī)?nèi)容,希望文章能夠幫你解決所遇到的問(wèn)題。

如果覺(jué)得生活随笔網(wǎng)站內(nèi)容還不錯(cuò),歡迎將生活随笔推薦給好友。