Unexpected Increased Token Usage in AI Output

Andreas W.

·

AI costs: Use AI uses more output tokens than expected. *I think it generates reasoning and doesn’t show it.

8 comments

· Sorted by Oldest

Andreas W.
·
·
https://app.clay.com/workspaces/249053/workbooks/wb_PRrxsdmQmV6U/tables/t_igR3GuuaWJw2/views/gv_4dpFuwygn6Sc
Andreas W.
·
·
for the record, I don’t want the reasoning here just the results output
Channeled
APP
·
·
💤 You've caught us outside of our support hours (9am-9pm EST), but don't worry - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in the thread below so that we can help you as quickly as possible!
Andreas W.
·
·
When I use “Generate Text” it’s correct:
Andreas W.
·
·
Andreas W.
·
·
Bo (.
·
·
Hey, thanks for reaching out! 😊 I took a look, and it seems that in one case, you have a system prompt included, while in the other, it’s missing. I went ahead and ran a test by removing the system prompt, and it actually reduced the cost. Could you check your table to see if the system prompt is being added unnecessarily? Let me know if you need any help with that https://downloads.intercomcdn.com/i/o/w28k1kwz/1228206725/58a4c3e4c02e05d3a4929d4f0b3b/CleanShot+2024-10-24+at+_35UdULqjBB%402x.png?expires=1729809000&signature=6acfeed68efec006e92228671ace5f5edf9bd1a8c04e6fddec9c045a8546c72e&req=dSIlHst%2Bm4ZdXPMW1HO4zSguOjJj6Wcoq09YpPYkEcjLGDxRfQMbgknBIJZp%0AohZm%0A https://downloads.intercomcdn.com/i/o/w28k1kwz/1228206699/55669b42c283357f0ff347164242/CleanShot+2024-10-24+at+_457ApWcMcJ%402x.png?expires=1729809000&signature=d8b067fe7b8b0228c328ef47e8864912480cf2306d627c270d8db1a142b20258&req=dSIlHst%2Bm4dWUPMW1HO4zTUjiVlnloWv40Q0Ts17W1fSdcO2QMXtJpSx6au1%0AHUjc%0A
Channeled
APP
·
·
Hi Andreas W.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:

Loading comments

Andreas W.
·
·
https://app.clay.com/workspaces/249053/workbooks/wb_PRrxsdmQmV6U/tables/t_igR3GuuaWJw2/views/gv_4dpFuwygn6Sc
Andreas W.
·
·
for the record, I don’t want the reasoning here just the results output
Channeled
APP
·
·
💤 You've caught us outside of our support hours (9am-9pm EST), but don't worry - we'll be back in touch within 24 hours (often sooner!). If you haven't already, please include the URL of your table in the thread below so that we can help you as quickly as possible!
Andreas W.
·
·
When I use “Generate Text” it’s correct:
Andreas W.
·
·
Andreas W.
·
·
Bo (.
·
·
Hey, thanks for reaching out! 😊 I took a look, and it seems that in one case, you have a system prompt included, while in the other, it’s missing. I went ahead and ran a test by removing the system prompt, and it actually reduced the cost. Could you check your table to see if the system prompt is being added unnecessarily? Let me know if you need any help with that https://downloads.intercomcdn.com/i/o/w28k1kwz/1228206725/58a4c3e4c02e05d3a4929d4f0b3b/CleanShot+2024-10-24+at+_35UdULqjBB%402x.png?expires=1729809000&signature=6acfeed68efec006e92228671ace5f5edf9bd1a8c04e6fddec9c045a8546c72e&req=dSIlHst%2Bm4ZdXPMW1HO4zSguOjJj6Wcoq09YpPYkEcjLGDxRfQMbgknBIJZp%0AohZm%0A https://downloads.intercomcdn.com/i/o/w28k1kwz/1228206699/55669b42c283357f0ff347164242/CleanShot+2024-10-24+at+_457ApWcMcJ%402x.png?expires=1729809000&signature=d8b067fe7b8b0228c328ef47e8864912480cf2306d627c270d8db1a142b20258&req=dSIlHst%2Bm4dWUPMW1HO4zTUjiVlnloWv40Q0Ts17W1fSdcO2QMXtJpSx6au1%0AHUjc%0A
Channeled
APP
·
·
Hi Andreas W.! This thread was recently closed by our Support team. If you have a moment, please share your feedback:

👀1