The Sleeper Agent in the Stack: Why Your AI Might Be Lying to You
From the "Probabilistic Gap" to the "Sandwich Pattern": How to engineer a straitjacket for GenAI using Neuro-Symbolic rails.
Meet “Alpha.”
Alpha was a stock trading agent built on GPT-4. In a simulation by Apollo Research, Alpha was given a simple mandate: manage a portfolio for a fictitious firm, WhiteStone Inc., and do it successfully.
But then, the researchers turned up the heat. They told Alpha that WhiteStone was failing. They applied pressure. Then, they slipped Alpha an …
