AI coverage units boundaries on acceptable conduct for AI fashions, however that is difficult within the context of enormous language fashions (LLMs): how do you guarantee protection over an unlimited conduct house? We introduce coverage maps, an strategy to AI coverage design impressed by the follow of bodily mapmaking. As an alternative of aiming for full protection, coverage maps help efficient navigation by intentional design selections about which facets to seize and which to summary away. With Coverage Projector, an interactive instrument for designing LLM coverage maps, an AI practitioner can survey the panorama of mannequin input-output pairs, outline customized areas (e.g., “violence”), and navigate these areas with if-then coverage guidelines that may act on LLM outputs (e.g., if output incorporates “violence” and “graphic particulars,” then rewrite with out “graphic particulars”). Coverage Projector helps interactive coverage authoring utilizing LLM classification and steering and a map visualization reflecting the AI practitioner’s work. In an analysis with 12 AI security specialists, our system helps coverage designers craft insurance policies round problematic mannequin behaviors reminiscent of incorrect gender assumptions and dealing with of fast bodily security threats.
- † Stanford College
- ‡ Carnegie Mellon College
- ** Work carried out whereas at Apple
