haive.agents.document_loader.web.agent

Web-specific Document Loader Agent.

This module provides a specialized document loader agent for loading documents from web URLs.

Classes

WebLoaderAgent

Specialized document loader agent for loading documents from web URLs.

Module Contents

class haive.agents.document_loader.web.agent.WebLoaderAgent

Bases: haive.agents.document_loader.base.agent.DocumentLoaderAgent

Specialized document loader agent for loading documents from web URLs.

This agent is pre-configured for loading from web sources and provides additional web-specific options.

name

Name of the agent

url

URL to load

dynamic_loading

Whether to use a dynamic loading strategy (e.g., Playwright)

recursive

Whether to recursively crawl links

max_depth

Maximum depth for recursive crawling

headers

Custom headers to use for requests

setup_agent()

Set up the agent with a web loader engine.

Return type:

None