Join the Community

Understanding Clay's Private API Key Integration Limits and Usage

·

Hello! Just started using Clay (pro version) and I am trying to understand a bit more how the limits and usage of the Private API Key Integration with Clay works. From a previous support post from 8 months ago, it says, that the required TPM rates to use ChatGPT to generate text and Claygent are 30,000 TPM and 450,000 TPM respectively. I was wondering if these values have changed over time or have they stayed the same? I would also like to know if these rates are the same for any of LLMs (OpenAI, Gemini, Anthropic...). I have been doing some research on Anthropic since it the one that seems to be pretty solid in terms of logic and actual results (especially Claude 3.5 Sonnet and 3.7 Sonnet). In the official website from Anthropic if you check the Tiers (Tier 3 up to 160,000TPM Claude 3.5 Sonnet & Tier 4 up to 400,000TPM Claude 3.5 Sonnet; Input TPM, for Output is 32,000 & 80,000 respectively). It seems if you want to go higher than this you would need an enterprise plan. My final question is would you need an enterprise plan with Anthropic to properly use the API integration with Clay for the model of Claude 3.5 Sonnet or 3.7 Sonnet? I know that with OpenAI from Tier 2 you can already use the API integration as mentioned on the support post. Thanks for your help in advance!

7 comments

Channeled
APP
·
·
Based on our documentation, the required TPM rates for using Clay with OpenAI are 30, 000 TPM for ChatGPT columns and 450, 000 TPM for Claygent. These requirements are specifically mentioned for OpenAI's API. While we support integration with Claude (Anthropic) and Gemini models in our Use AI feature, our documentation doesn't specify TPM requirements for these alternative providers. For the most accurate information about TPM requirements for non-OpenAI models, you may want to request human assistance.
Sources: Use AI | Documentation | Clay University Use AI | Documentation | Clay University
Bo (.
·
·
Hey! No, you don’t need an enterprise plan to use the API integration with Clay for Claude 3.5 or 3.7 Sonnet. As long as your Anthropic tier supports the TPM requirements for your use case, you’re good to go. Let me know if you have more questions.
1
Miguel M.
·
·
Do you know which tier this would be for Anthropic?
Bo (.
·
·
Hey, thanks for reaching out! 😊 Yes - Claude You need to be on Tier 4 or higher to run Claygent with Claude. We’re working on lowering the requirement to Tier 3, but for now, Tier 4 is the minimum. OpenAI You’ll need at least 450,000 Tokens Per Minute (TPM) to run the Claygent Text Generation If you’re just generating text with existing data in Clay, you only need 30,000 TPM. That said, Clay credits will work for these tasks, so upgrading your OpenAI tier might not be necessary depending on your needs. You can check your current tier, as well as your usage and limits, in the OpenAI API dashboard here: • Usage • Limits • Usage Tiers Or Claude Console: https://console.anthropic.com/ We’ve seen users successfully add a pre-paid tier amount to their OpenAI account and resolve the issue. However, since this is outside our control, we recommend troubleshooting directly with OpenAI’s team. Let me know if you need any further assistance! 😊
Miguel M.
·
·
Awesome! Yeah for OpenAI with Tier 2 it should already work since you have the 450,000 TPM. Does the TPM take into account input and output tokens or just the input ones? Since for Claude the max input on Tier 4 would be 400,000 TPM
Bo (.
·
·
Tier 2 applies to OpenAI and Tier 4 applies to Claude. For OpenAI, the 450,000 TPM — it’s total TPM usage, not just input. See attached example:
(74 kB)
Let me know if you have more questions.
Miguel M.
·
·
Perfect, that solves all my questions. Thanks a lot for your time!!