Clay Icon

Effective Strategies for Version Control of AI Prompts

ยท
ยท

How do people "version control" AI prompts? As in, if I'm trying to refine a prompt, and I want to test it on many cells (with different inputs). It works on most inputs and then is bad at others, so I refine it, and then its gets better at some parts and worse in earlier. But since I'm constantly changing the same AI column, I'm not able to effectively keep track of what changes I've made. Also, since I re-run the cells, I lose the previous output, so I can't "compare" the output of one AI prompt vs another.

  • Avatar of kushagra
    kushagra
    ยท
    ยท

    Yeah it's def is a struggle. Currently if there's a major update to the prompt I end up duplicating the column and run a few rows to compare. Then eventually delete the ones I am not going to use. Following this thread to see if folks have a better way of keeping a track. I do have a dedicated project in chatgpt where all my clay prompts are so I don't lose track of the prompts and iterations (because mostly I am asking chatgpt to make the changes too). However the impact of it on the outputs is def lost.

  • Avatar of Bharat D.
    Bharat D.
    ยท
    ยท

    I'm not is this helps - Nathan Lippi uploaded a video yesterday with Joe. They were talking about having the frequently used prompts in a different table and use that with lookup function in multiple tables. I'm assuming that this method could somehow work for your use case.