Concerns About Token Usage in OpenAI Integration with Example Data

Philip S.

·

Hey! Im using Open AI Integration "Give examples of how the AI should respond" - My examples have an extensive amout of data that have no values. Can please someone in your team have a look into it? I think this generates huge amount of tokens per prompt, which prevents me from using clays managed open ai acc, exceeding the limit of 15k tokens real fast. What could be the reason?

2 comments

Channeled
APP
·
·
I understand your concern about the OpenAI Integration and the token usage. Let's address your specific issue:1. Regarding the examples with extensive data that have no values: This could indeed lead to high token usage. It's best to keep your examples concise and relevant to reduce unnecessary token consumption. 2. For the token limit issue: Different Clay features have specific token per minute (TPM) requirements: • ChatGPT columns require 30,000 TPM • Claygent requires 450,000 TPMIf you're experiencing issues with token limits, you may need to upgrade your OpenAI API key usage to a tier 2 API key. You can check your current usage limits and upgrade your plan at OpenAI's API Usage Limits page.To address your specific situation and provide more tailored advice, we'd need to take a closer look at your setup. If you need further assistance, please request to talk to a person by clicking on "Talk to a person". A member of our team can then review your integration and provide more specific guidance on optimizing your token usage.
Channeled
APP
·
·
Hi Philip S.! This thread was recently closed by our Support team. If you have a moment, please share your feedback: