dataflow.importers.litellm_importer¶

Fixed LiteLLM Importer Module.

This module imports LLM and embedding models from LiteLLM data and other sources into Supabase, properly handling all models without limits.

Attributes¶

Functions¶

add_import_log(→ None)

Add an import log entry to the audit.import_logs table.

get_or_create_provider(→ dict[str, Any] | None)

Get or create a provider and return its data.

get_or_create_provider_type(→ str | None)

Get or create a provider type and return its ID.

import_embedding_models(→ int)

Import embedding models.

import_from_env(→ list[dict[str, Any]])

Extract embedding models from environment variables.

import_llm_models(→ int)

Import LLM models from LiteLLM.

main()

Main function to run the import.

Module Contents¶

dataflow.importers.litellm_importer.add_import_log(entity_name: str, entity_type: str, status: str, message: str) None¶

Add an import log entry to the audit.import_logs table.

dataflow.importers.litellm_importer.get_or_create_provider(provider_name: str, provider_type: str) dict[str, Any] | None¶

Get or create a provider and return its data.

dataflow.importers.litellm_importer.get_or_create_provider_type(type_name: str, display_name: str) str | None¶

Get or create a provider type and return its ID.

dataflow.importers.litellm_importer.import_embedding_models() int¶

Import embedding models.

Returns the number of models imported.

dataflow.importers.litellm_importer.import_from_env() list[dict[str, Any]]¶

Extract embedding models from environment variables.

Look for vars like OPENAI_EMBEDDING_MODEL, AZURE_EMBEDDING_MODEL, etc.

dataflow.importers.litellm_importer.import_llm_models() int¶

Import LLM models from LiteLLM.

Returns the number of models imported.

dataflow.importers.litellm_importer.main()¶

Main function to run the import.

dataflow.importers.litellm_importer.LITELLM_URL = 'https://raw.githubusercontent.com/BerriAI/litellm/main/model_prices_and_context_window.json'¶
dataflow.importers.litellm_importer.logger¶
dataflow.importers.litellm_importer.parser¶
dataflow.importers.litellm_importer.supabase¶