API ReferenceΒΆ Contracts URL FetchRequest BatchFetchRequest FetchResponse StreamChunk BatchItemResponse BatchFetchResponse RetryPolicy TimeoutPolicy PoolPolicy StreamPolicy WebResource WebPage MediaResource Headers BrowserProfile get_profile() list_profiles() get_best_browser_headers() BrowserHeaderProvider RotatingHeaderProvider StaticHeaderProvider random_user_agent() random_profile() user_agents_for_browser() HeaderProvider Fetch FetchService get_default_fetch_service() fetch() afetch() afetch_many() astream() build_batch_request() collect_bytes() collect_stream_bytes() Transports Base Protocols HTTPX Aiohttp curl_cffi Cloudscraper Scrape select() select_one() extract_text() extract_attrs() extract_table() LinkInfo extract_links() FormField FormData extract_forms() RobotsRules parse_robots_txt() is_allowed() SitemapEntry parse_sitemap() extract_readable_text() Metadata extract_basic_html_metadata() extract_open_graph_metadata() extract_extruct_metadata() FaviconLink OpenGraphMetadata PageMetadata Download DownloadService Rate Limiting RateLimitPolicy DomainRateLimiter Crawler Frontier SpiderResult Router Spider normalize_url() url_hash() URLDeduplicator PolitenessEnforcer FeedEntry FeedPollResult parse_feed() compute_entry_hash() calculate_poll_interval() discover_sitemaps_from_robots() discover_urls_from_sitemap() build_seed_urls() Pipeline Extractors extract_article_text() html_to_markdown() html_to_plaintext() ArticleMeta extract_article_metadata() extract_media_metadata() Downloaders MediaInfo DownloadResult DownloadProgress DownloaderProtocol YtdlpDownloader GalleryDlDownloader DirectDownloader Object Store ObjectStoreClient Events EventListener Channels Configuration PyfetcherConfig MCP Server API FetchResult ScrapeResult LinkInfo LinksResult MetadataResult FormInfo FormsResult TableResult RobotsResult SitemapResult HeadersResult ProfileInfo ArticleResult DownloadResult