∞ Image Text Parser

Documentation

• Class name: LLMImageTextReader
• Category: SALT/Language Toolkit/Readers
• Output node: False

The LLMImageTextReader node is designed to read and process images, extracting text and additional information based on user-defined parameters. It leverages underlying image processing and text extraction technologies to facilitate the analysis and interpretation of image content.

Input types

Required

• path
  • Specifies the file path of the image to be processed. This is a crucial parameter as it determines the source image for text extraction and further processing.
  • Comfy dtype: STRING
  • Python dtype: str

Optional

• parse_text
  • A boolean flag indicating whether text should be extracted from the image. This affects whether the node will perform text parsing operations on the image.
  • Comfy dtype: COMBO[BOOLEAN]
  • Python dtype: bool
• extra_info
  • A string containing extra information in JSON format that can be used to provide additional context or instructions for processing the image.
  • Comfy dtype: STRING
  • Python dtype: str

Output types

• documents
  • Comfy dtype: DOCUMENT
  • The output is a document containing the results of the image processing and text extraction, structured in a format that can be further analyzed or displayed.
  • Python dtype: tuple

Usage tips

• Infra type: CPU
• Common nodes: unknown

Source code

class LLMImageTextReader(ImageReader):
    """
    @NOTE: Not sure what this does yet
    @Source: https://github.com/run-llama/llama_index/blob/main/llama-index-integrations/readers/llama-index-readers-file/llama_index/readers/file/image/base.py
    @Documentation: https://docs.llamaindex.ai/en/latest/api_reference/readers/file/#llama_index.readers.file.ImageReader
    """

    def __init__(self):
        super().__init__()

    @classmethod
    def INPUT_TYPES(cls):
        return {
            "required": {
                "path": ("STRING", {"default": ""}),
            },
            "optional": {
    #           "keep_image": ([False, True], {"default": False}),
                "parse_text": ([False, True], {"default": False}),
                "extra_info": ("STRING", {"multiline": True, "dynamicPrompts": False, "default": "{}"}),
            }
        }

    RETURN_TYPES = ("DOCUMENT", )
    RETURN_NAMES = ("documents",)

    FUNCTION = "execute"
    CATEGORY = f"{MENU_NAME}/{SUB_MENU_NAME}/Readers"

    def execute(self, path:str, parse_text:bool, extra_info:str, keep_image:bool=False, fs = None):
        get_full_path(1, path)
        if not os.path.exists(path):
            raise FileNotFoundError(f"No file available at: {path}")
        path = Path(path)
    #   self._keep_image = keep_image
        self._parse_text = parse_text
        extra_info = read_extra_info(extra_info)
        data = self.load_data(path, extra_info)
        return (data, )