分词后数据查询问题

Question

老师您好，有个问题请教下，感谢：
文本值"新建文件夹"，采用ik_smart分词器后，会被分成 新建、文件夹 两个单词，，用户输入"新建文”单词搜索不到，采用的match查询也无效，索引结构及查询语句如下：

{
	"settings": {
		"number_of_shards": 3,
		"number_of_replicas": 2
	},
	"mappings": {
		"_doc": {
			"properties": {
				"id": {
					"type": "keyword"
				},
				"documentId": {
					"type": "integer"
				},
				"name": {
					"type": "text",
					"analyzer": "ik_smart"
				},
				"content": {
					"type": "text",
					"analyzer": "ik_smart"
				},
				"labelName": {
					"type": "text"
				},
				"ownerName": {
					"type": "text"
				},
				"lastBrowseUser": {
					"type": "text"
				},
				"createTime": {
					"type": "date"
				},
				"updateTime": {
					"type": "date"
				},
				"lastBrowseTime": {
					"type": "date"
				},
				"type": {
					"type": "keyword"
				}
			}
		}
	}
}

{
	"bool": {
		"must": [
			{
				"multi_match": {
					"query": "新建文",
					"fields": [
						"name^1.0"
					],
					"type": "best_fields",
					"operator": "OR",
					"slop": 0,
					"prefix_length": 0,
					"max_expansions": 50,
					"zero_terms_query": "NONE",
					"auto_generate_synonyms_phrase_query": true,
					"fuzzy_transpositions": true,
					"boost": 1.0
				}
			}
		],
		"adjust_pure_negative": true,
		"boost": 1.0
	}
}

Answer 1

rockybean 2020-12-18 11:18:42

你可以看下 新建文 的分词结果，通过  _analyze 接口查看下

GET _analyze

{

  "analyzer": "ik_smart",

  "text": ["新建文"]

}

结果如下:

{

  "tokens" : [

    {

      "token" : "新",

      "start_offset" : 0,

      "end_offset" : 1,

      "type" : "CN_CHAR",

      "position" : 0

    },

    {

      "token" : "建文",

      "start_offset" : 1,

      "end_offset" : 3,

      "type" : "CN_WORD",

      "position" : 1

    }

  ]

}

这样一看，没搜到就很正常了

• 提问者 simons_fan #1

  老师，https://coding.imooc.com/learn/questiondetail/199069.html，，我在这里看到您的答复用match查询是可以实现类似于mysql的like用法的，，换句话说，上面问题，有啥好的解决方案吗？感谢

• rockybean 回复 提问者 simons_fan #2

  出现这个问题的核心原因四分词不准确导致的。ik_smart 的分词结果比较少，你可以换用 ik_max_word
  
  GET _analyze
  {
    "analyzer": "ik_max_word",
    "text": ["新建文"]
  }
  
  {
    "tokens" : [
      {
        "token" : "新建",
        "start_offset" : 0,
        "end_offset" : 2,
        "type" : "CN_WORD",
        "position" : 0
      },
      {
        "token" : "建文",
        "start_offset" : 1,
        "end_offset" : 3,
        "type" : "CN_WORD",
        "position" : 1
      }
    ]
  }
  
  
  
  GET _analyze
  {
    "analyzer": "ik_max_word",
    "text": ["新建文件夹"]
  }
  
  {
    "tokens" : [
      {
        "token" : "新建",
        "start_offset" : 0,
        "end_offset" : 2,
        "type" : "CN_WORD",
        "position" : 0
      },
      {
        "token" : "建文",
        "start_offset" : 1,
        "end_offset" : 3,
        "type" : "CN_WORD",
        "position" : 1
      },
      {
        "token" : "文件夹",
        "start_offset" : 2,
        "end_offset" : 5,
        "type" : "CN_WORD",
        "position" : 2
      },
      {
        "token" : "文件",
        "start_offset" : 2,
        "end_offset" : 4,
        "type" : "CN_WORD",
        "position" : 3
      },
      {
        "token" : "夹",
        "start_offset" : 4,
        "end_offset" : 5,
        "type" : "CN_CHAR",
        "position" : 4
      }
    ]
  }

• 提问者 simons_fan #3

  非常感谢！