· Amit Kothari · Continuous Improvement
We tried letting AI improve its own prompts
Pointing an AI at its own prompts sounds like free improvement. In practice the rewrite happens blind, nothing proves the output stayed the same, the old wording is gone, and somebody babysits the loop forever. Even DSPy, the open source tooling for this, requires you to supply the metric yourself.