Troubleshooting Claygent Column for 40K Rows in ChatGPT API

Antonio M. · 2024-09-26 14:15:53.697965+00

Hey, loving Clay so far - great tool. I have a two tables with ~40k rows. They only have one Claygent column that needs to run (via ChatGPT api) and I’ve tried running it since late on Tuesday night - to no avail. A lot of the cells that have populated are greyed out. Otherwise it simply won’t run all 40k rows. Pls could you help getting the Claygent column to run all 40k rows?

Troubleshooting Claygent Column for 40K Rows in ChatGPT API | Clay

13 comments

· Sorted by Oldest

Channeled
APP
·
·
👋 Hey there! Our support team has got your message - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in this thread so that we can help you as quickly as possible!
Antonio M.
·
·
Here are the two tables in the worksheet: https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_hdpmyqxRccNu/views/gv_ipV2hqtHPexo https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_6GWxCZxtQcM6/views/gv_t2Um2Qt6h7h2
Bruno R.
·
·
Hi Antonio, thanks for reaching out. Looks like you're using your personal API key here. You may be running into some performance issues related to the number of tokens per minute, or words per minute, that your API tier can process. We now require 30,000 TPM (tokens per minute) for ChatGPT columns and 450,000 TPM for Claygent. If you’re trying to use Claygent with a model lower than Tier 2, it won’t work. However, ChatGPT will still work fine in these cases. You can check your ChatGPT usage or limits at the following links: • Usage • Limits • Usage Tiers Their support team will always grant you the request if you have prepaid the minimum amount required and they’ll be quick to assist if you need to increase your limits or troubleshoot any issues.
Antonio M.
·
·
Thanks Bruno. I’ll check to see what our TPM is. For now, the Claygent can run about 1k rows at a time before getting stuck. Is the 30,000 TPM needed for all tasks or just large ones? If it’s needed for all tasks would that still explain why this issue is occurring?
Antonio M.
·
·
Aston C. could you pls check to see what our acc’s TPM rate is.
Bruno R.
·
·
Hi Antonio, thanks for following up on this! Tokens per minute (TMP) measure the peak load of tokens at any given time. To ensure optimal performance with Claygent, we generally recommend maintaining a minimum TMP limit of 30,000. This applies to all tasks, though larger tasks may occasionally exceed this limit. You should be able to find your usage limits here: https://platform.openai.com/settings/organization/limits. I hope this was helpful. If there's anything else I can assist you with, please let me know!
Antonio M.
·
·
Hey Bruno, OpenAI only offer this for ChatGPT4 (pic attached). We’ve gone ahead, selected this and bumped ChatGPT4 to 30k TPM - but the issue persists. Do you know if Clay discerns between 4 and 4o mini?
Loading attachments
Antonio M.
·
·
Hi Bruno R. we upgraded to 30,000 TPM and the issue is persisting.
Loading attachments
LuisArturo
·
·
Hey there Antonio thanks for reaching out, jumping in for Bruno here. Apologies for some confusion here, even though we have OpenAI power both our ChatGPT and Claygent integrations, they both require different TPM rates. While 30,000 TPM will work for the ChatGPT columns, our Claygent Columns requires at least 450,000 TPM in order to work. Will also mention that Clay does discern between 4 and 4o mini as well.
Antonio M.
·
·
Hey LuisArturo, thanks for jumping in. To clarify, we need to get our subscription up to 45,000 TPM in order for the Claygent to run all 40k rows?? Could you pls take a look at the sheet to double check? The Claygent can run 100-1000 rows at a time right now. Will the upgrade really make the difference needed to run the rest of the sheet(s)?
Owen C.
·
·
Hey Antonio! No worries at all. Based on the previous image, if your OpenAI account has a GPT-4o Mini with a TPM of 150 million, your subscription should already meet the 450,000 TPM requirement for Claygent. Unfortunately, the link you provided isn’t working on my end. Could you please resend it? I’d be happy to take a look and confirm this for you! 😊
Channeled
APP
·
·
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in Clay Support.
Antonio M.
·
·
Hi Owen C., thanks for following up. Here are the links to the two sheets in the workbook: https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_6GWxCZxtQcM6/views/gv_t2Um2Qt6h7h2 https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_hdpmyqxRccNu/views/gv_ipV2hqtHPexo

Channeled
APP
·
·
👋 Hey there! Our support team has got your message - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in this thread so that we can help you as quickly as possible!
Antonio M.
·
·
Here are the two tables in the worksheet: https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_hdpmyqxRccNu/views/gv_ipV2hqtHPexo https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_6GWxCZxtQcM6/views/gv_t2Um2Qt6h7h2
Bruno R.
·
·
Hi Antonio, thanks for reaching out. Looks like you're using your personal API key here. You may be running into some performance issues related to the number of tokens per minute, or words per minute, that your API tier can process. We now require 30,000 TPM (tokens per minute) for ChatGPT columns and 450,000 TPM for Claygent. If you’re trying to use Claygent with a model lower than Tier 2, it won’t work. However, ChatGPT will still work fine in these cases. You can check your ChatGPT usage or limits at the following links: • Usage • Limits • Usage Tiers Their support team will always grant you the request if you have prepaid the minimum amount required and they’ll be quick to assist if you need to increase your limits or troubleshoot any issues.
Antonio M.
·
·
Thanks Bruno. I’ll check to see what our TPM is. For now, the Claygent can run about 1k rows at a time before getting stuck. Is the 30,000 TPM needed for all tasks or just large ones? If it’s needed for all tasks would that still explain why this issue is occurring?
Antonio M.
·
·
Aston C. could you pls check to see what our acc’s TPM rate is.
Bruno R.
·
·
Hi Antonio, thanks for following up on this! Tokens per minute (TMP) measure the peak load of tokens at any given time. To ensure optimal performance with Claygent, we generally recommend maintaining a minimum TMP limit of 30,000. This applies to all tasks, though larger tasks may occasionally exceed this limit. You should be able to find your usage limits here: https://platform.openai.com/settings/organization/limits. I hope this was helpful. If there's anything else I can assist you with, please let me know!
Antonio M.
·
·
Hey Bruno, OpenAI only offer this for ChatGPT4 (pic attached). We’ve gone ahead, selected this and bumped ChatGPT4 to 30k TPM - but the issue persists. Do you know if Clay discerns between 4 and 4o mini?
Loading attachments
Antonio M.
·
·
Hi Bruno R. we upgraded to 30,000 TPM and the issue is persisting.
Loading attachments
LuisArturo
·
·
Hey there Antonio thanks for reaching out, jumping in for Bruno here. Apologies for some confusion here, even though we have OpenAI power both our ChatGPT and Claygent integrations, they both require different TPM rates. While 30,000 TPM will work for the ChatGPT columns, our Claygent Columns requires at least 450,000 TPM in order to work. Will also mention that Clay does discern between 4 and 4o mini as well.
Antonio M.
·
·
Hey LuisArturo, thanks for jumping in. To clarify, we need to get our subscription up to 45,000 TPM in order for the Claygent to run all 40k rows?? Could you pls take a look at the sheet to double check? The Claygent can run 100-1000 rows at a time right now. Will the upgrade really make the difference needed to run the rest of the sheet(s)?
Owen C.
·
·
Hey Antonio! No worries at all. Based on the previous image, if your OpenAI account has a GPT-4o Mini with a TPM of 150 million, your subscription should already meet the 450,000 TPM requirement for Claygent. Unfortunately, the link you provided isn’t working on my end. Could you please resend it? I’d be happy to take a look and confirm this for you! 😊
Channeled
APP
·
·
This thread was picked up by our in-app web widget and will no longer sync to Slack. If you are the original poster, you can continue this conversation by logging into https://app.clay.com and clicking "Support" in the sidebar. If you're not the original poster and require help from support, please post in Clay Support.
Antonio M.
·
·
Hi Owen C., thanks for following up. Here are the links to the two sheets in the workbook: https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_6GWxCZxtQcM6/views/gv_t2Um2Qt6h7h2 https://app.clay.com/workspaces/272181/workbooks/wb_v687ogEtVxrh/tables/t_hdpmyqxRccNu/views/gv_ipV2hqtHPexo