Request for Custom LLM Integration for Better API Management
Request: Custom API keys & endpoints The company I work at uses LiteLLM to manage all API keys. Our OpenAI keys pass through Azure, which have a different format and endpoint than OpenAI. It's tough not being able to use our fine-tuned models because of this limitation. Edit/Addition: In it's extent, we use Hubspot App Tokens to access our CRM with specific scopes and to track usage. Currently we can't build an AppToken connection to Clay (I'm aware of the HTTP call function). Question: Would it be possible to add a "Custom LLM" integration, (edit/addition:) and in the broader sense a custom API authentication 'database'? Inspired by n8n's "Credentials" tab. This would be extremely useful for better output control and cost management. Thanks!
.png)