Hi Team, sometimes when running Claygent with GPT models, it returns the wrong output, even when it knows the right output according to it's reasoning. IE, If it should return either "Yes" or "No", it could return "No", even though it actually comes up with the right determination that it should be "Yes". Any idea why this could be? Example would be the column titled "CHU - Incorrect" in this table - https://app.clay.com/workspaces/223473/workbooks/wb_0t58zs6Fdsku4T6gC5k/tables/t_0t58zt2HyboAysDdKDz/views/gv_0t58zt2iTp3ziXpAnix
This is a common AI prompt issue where the reasoning is correct but the final output format doesn't match expectations. [1]
Quick fixes to try:
• Add specific output instructions - Include explicit formatting like "Always respond with exactly 'Yes' or 'No' - no other text"
• Use structured JSON schemas - Define exact output format to constrain AI responses
• Click "Output is Wrong" - Use the red button in the formula generator to iterate on your prompts [2]
The issue often stems from the AI not following strict output formatting despite correct reasoning. Adding specific instructions for handling edge cases usually resolves this.
You can also click into the specific cells showing incorrect outputs to see more error details.
Is that what you were looking for?
Looking at your cell details, the AI has "very high" confidence but still produced the wrong output format. This is a classic prompt structure issue. [1]
Quick fixes:
• Add explicit output constraints - Include "Always respond with exactly 'Yes' or 'No' - no other text" in your prompt
• Use JSON schemas - Define exact output format to constrain AI responses and prevent reasoning text bleeding into final output
• Click "Output is Wrong" - Use the red button in the formula generator to iterate on your prompts [2]
The issue stems from the AI not following strict output formatting despite correct reasoning. Adding specific edge case instructions usually resolves this.
Was that helpful?
If you still need help resolving the output formatting issue with Claygent, I’m here to assist. Would you like to provide more details about what you’re trying to achieve or any other challenges you’re facing?
