What is the idea of Constitutional AI, and what problem does it attempt to solve in alignment?

• A. Constitutional AI uses fixed reward signals derived from market data.
• B. Constitutional AI uses a set of non-verifiable principles to guide outputs.
• C. Constitutional AI uses a set of high-level, verifiable principles (a 'constitution') to guide model outputs and deference mechanisms, aiming to reduce value drift by constraining behavior with a formal, auditable rule set rather than opaque human preference signals.
• D. Constitutional AI relies on post-hoc explanations to enforce safety.

Answer: (C)

Constitutional AI centers on a formal set of high-level, verifiable principles—the AI’s constitution—that guide what the model should output and how it should defer to other judgments. This creates auditable constraints on behavior rather than relying on opaque, ever-shifting human preference signals used to shape rewards. The idea is to reduce value drift: by grounding decisions in a transparent rule set, the model stays within agreed norms even as tasks change or data shifts occur. Outputs are produced with the constitution in mind, and the system can defer or escalate when a principle is ambiguous or conflicts arise, keeping safety and alignment more predictable. This stands in contrast to approaches that depend on fixed reward signals, non-verifiable guidelines, or post-hoc explanations to enforce safety.