Issue with OpenAI API Key Rate Limits for AI Enrichment Columns | Clay

Issue with OpenAI API Key Rate Limits for AI Enrichment Columns

Hello, I am unable to run AI enrichment columns with my OpenAI API key, even though my OpenAI usage tier is tier 3. still getting this error: "The rate limits associated with this OpenAI API key are insufficient for this field. Search "OpenAI Increase Limits" or visit https://platform.openai.com/settings/organization/limits to increase your API key limits." What usage tier is needed to run enrichments via API key? Link to table: https://app.clay.com/workspaces/590277/workbooks/wb_0svwz70wSARsNR8YtgX/tables/t_0svwz70PoKnuoNbUdgG/views/gv_0svwz71R5dDEYS2bqxd

10 comments

Channeled
APP
·
·
For ChatGPT Generate Text columns, you need an OpenAI API key with at least 30, 000 TPM (tokens per minute), which works with any paid tier as long as your API key has access to GPT-4 or GPT-4 Turbo. For ClayGent Web Research, you need Tier 2 or higher (≥450, 000 TPM). Despite being on Tier 3, you might be experiencing this error because different AI features in Clay have different TPM requirements. You can verify your current limits at OpenAI Limits and check if your specific usage pattern exceeds your allocation.
Source: AI Tokens | Documentation | Clay University
Dustin S.
·
·
https://app.clay.com/workspaces/590277/workbooks/wb_0svwz70wSARsNR8YtgX/tables/t_0svwz70PoKnuoNbUdgG/views/gv_0svwz71R5dDEYS2bqxd
Dustin S.
·
·
I've noticed now that one column started working (AI Qualifier) but the others still will not run
Channeled
APP
·
·
Hello Dustin! Thanks for reaching out and being super patient while I figured this out. Here’s what you need for using your API key with the integrations: Claude You need to be on Tier 4 or higher to run Claygent with Claude. We’re working on lowering the requirement to Tier 3, but for now, Tier 4 is the minimum. OpenAI You’ll need at least 450,000 Tokens Per Minute (TPM) to run the Claygent Text Generation If you’re just generating text with existing data in Clay, you only need 30,000 TPM.That said, Clay credits will work for these tasks, so upgrading your OpenAI tier might not be necessary depending on your needs. You can check your current tier, as well as your usage and limits, in the OpenAI API dashboard here: • Usage • Limits • Usage Tiers Or Claude Console: https://console.anthropic.com/ Curious to know- what do you mean by the other columns are not running? i just re ran one of the AI columns and it seems to be working. Let me know and I can guide you accordingly!
Dustin S.
·
·
Hello! To clarify, we are using the OpenAI API. We have usage tier 3, which is well over 450,000 TPM. Ex. on the "Find Companies" table, the "Find Recent Positive News Article" column will not run, while the "AI Qualifier" column will. Both are using 4.1 with the same API key
Dustin S.
·
·
(Our rate limit for 4.1 is 800,000 TPM)
Channeled
APP
·
·
Hey Dustin! I duplicated the "Find Recent Positive News Article" and it seems to be working now. Would suggest duplicating them and continuing the run.
Channeled
APP
·
·
(382 kB)
Dustin S.
·
·
For anyone who might be experiencing this in the future - I found another solution that won't mess up all of your formulas and column dependencies. Just create a new OpenAI API key and replace each column with the new key
Channeled
APP
·
·
Hello Dustin! Glad I could help and the suggestion you mentioned is super helpful too! I am going to go ahead and close out this ticket for now. Do reach out if you need further help!