dataflow.importers.litellm_importer¶
Fixed LiteLLM Importer Module.
This module imports LLM and embedding models from LiteLLM data and other sources into Supabase, properly handling all models without limits.
Attributes¶
Functions¶
|
Add an import log entry to the audit.import_logs table. |
|
Get or create a provider and return its data. |
|
Get or create a provider type and return its ID. |
|
Import embedding models. |
|
Extract embedding models from environment variables. |
|
Import LLM models from LiteLLM. |
|
Main function to run the import. |
Module Contents¶
- dataflow.importers.litellm_importer.add_import_log(entity_name: str, entity_type: str, status: str, message: str) None¶
Add an import log entry to the audit.import_logs table.
- dataflow.importers.litellm_importer.get_or_create_provider(provider_name: str, provider_type: str) dict[str, Any] | None¶
Get or create a provider and return its data.
- dataflow.importers.litellm_importer.get_or_create_provider_type(type_name: str, display_name: str) str | None¶
Get or create a provider type and return its ID.
- dataflow.importers.litellm_importer.import_embedding_models() int¶
Import embedding models.
Returns the number of models imported.
- dataflow.importers.litellm_importer.import_from_env() list[dict[str, Any]]¶
Extract embedding models from environment variables.
Look for vars like OPENAI_EMBEDDING_MODEL, AZURE_EMBEDDING_MODEL, etc.
- dataflow.importers.litellm_importer.import_llm_models() int¶
Import LLM models from LiteLLM.
Returns the number of models imported.
- dataflow.importers.litellm_importer.main()¶
Main function to run the import.
- dataflow.importers.litellm_importer.LITELLM_URL = 'https://raw.githubusercontent.com/BerriAI/litellm/main/model_prices_and_context_window.json'¶
- dataflow.importers.litellm_importer.logger¶
- dataflow.importers.litellm_importer.parser¶
- dataflow.importers.litellm_importer.supabase¶