Author here. This is a detailed (8,000+ word, plus 2 companion pieces) walk-through of building loops for code generation and verification, complete with artifacts and detailed explanations to allow you to implement any of these techniques.
We walk through building:
- an evaluation contract, evaluator and stopping conditions to minimize bugs
- establishing an environment and priming AI to produce production-quality tests and code
- detecting and correcting common AI failure modes
- building a learning loop to monitor and improve all phases.
I think it's just too much. Honestly it feels like the whole thing could be a tight 100 line bash script. The diagram at the start didn't look too complicated
Don't waste your time. (s)Looped!!
We walk through building: - an evaluation contract, evaluator and stopping conditions to minimize bugs - establishing an environment and priming AI to produce production-quality tests and code - detecting and correcting common AI failure modes - building a learning loop to monitor and improve all phases.
I'd love to get your feedback!
Brad