Skip to content

opensearch: Search breaks with large documents #2491

@aduffeck

Description

@aduffeck

The search service fails to produce search results when the result set contains large documents resulting in errors like this:

{illegal_argument_exception The length of [Content] field of [39] doc of [opencloud-resource] index has exceeded [1000000] - maximum allowed to be analyzed for highlighting. This maximum can be set by changing the [index.highlight.max_analyzed_offset] index level setting. For large texts, indexing with offsets or term vectors is recommended!  }

Increasing max_analyzed_offset does solve the problem but compiling the results and highlights becomes pretty slow.

Maybe we should consider changing the index to include offsets instead, e.g.

     "Content": {
      "type": "text",
      "index_options": "offsets"
    }

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions