PyRIT

PyRIT (Python Risk Identification Tool for generative AI) is an open-source automation framework developed by the Microsoft AI Red Team. It helps security teams find risks in AI systems across multiple conversation turns.

Automating complex, multi-turn conversational attacks against chat agents and multimodal foundation models.

• +Supports multi-turn attack strategies (such as the Crescendo technique).
• +Modular components for attack orchestration, payload conversion, and scoring.
• +Memory storage system for tracking attack runs and reproducing findings.

• +Steeper learning curve requiring Python scripting to build custom pipelines.
• +LLM-based scorers call model APIs, which can add usage costs.

Stress-testing AI chat agents against gradual social engineering and context manipulation attacks.