Advanced Parser - Cognigy Documentation

Documentation Index

Fetch the complete documentation index at: /llms.txt

Use this file to discover all available pages before exploring further.

The Advanced Parser is Knowledge AI’s default content parser. When you upload a file as a Knowledge Source, the Advanced Parser splits the file content semantically into Knowledge Chunks and converts them into Markdown format. This parsing method results in more accurate answers compared to the Basic Parser.

Key Features

• Improved quality of responses. Breaking down the text into Knowledge Chunks allows AI Agents to understand the context and provide more accurate responses.
• Recognition of a wide range of text elements. The Advanced Parser recognizes plain text and more complex text elements, such as tables, titles, and footers as well as images, by using Optical character recognition (OCR).
• Effective use of Markdown. The Advanced Parser converts the text into Markdown format and in Knowledge Chunks. AI Agents can process Markdown and recognize text elements, for example, tables and images, and distinguish them from plain text. This approach gives AI Agents more context and helps them better understand how information is organized in the text.
• Improved ability to reference the source. Adding page numbers of the source file to Knowledge Sources as Chunk metadata helps track an information source in large documents.

Prerequisites

• Cognigy.AI 4.71 or later.

Limitations

• The parser may not always preserve hyperlinks correctly when processing PDF files.

Supported Formats

Availability

The Advanced Parser is available in all Cognigy.AI installations. For the on-premises installation, you need to activate the Advanced Parser.

Activate the Advanced Parser for On-Premises

Activating the Advanced Parser varies depending on which version you use:

• Cognigy.AI 4.80 or later
• Cognigy.AI 4.79 or earlier

Cognigy.AI 4.80 or Later

To activate the Advanced Parser, add the following parameters to the knowledgeSearch section in the cognigy-ai-values.yaml file:

knowledgeSearch:
  enabled: true

globalAzureDocumentIntelligenceConfig:
    enabled: true
    apiKey: API_KEY
    endpointUrl: ENDPOINT_URL

Replace API_KEY with your Azure AI Document Intelligence API key and ENDPOINT_URL with your Azure AI Document Intelligence endpoint URL.

Cognigy.AI 4.79 or Earlier

To activate the Advanced Parser for all or specific organizations in your Cognigy.AI installation, set the following environment variables in the cognigy-ai-values.yaml file:

• FEATURE_ENABLE_AZURE_DOCUMENT_INTELLIGENCE_ORG_WHITELIST:

• For all organizations, set to *.

  • For specific organizations, enter the organization IDs separated by a comma, for example, 63bda3d4tlp3c95977bb8604,63babf6e92asd791923e17b7,670k1273fx492448dc288b36.

• AZURE_DOCUMENT_INTELLIGENCE_ENDPOINT

1: TXT files are internally handled by the Basic Parser.