Topics
Browse posts by category and tag — every topic we cover, with the latest pieces under each.
Tags
- #llm-security 3
- #open-source 3
- #red-team 3
- #ai-security 2
- #ci-cd 2
- #prompt-injection 2
- #arize-phoenix 1
- #enterprise 1
- #framework 1
- #garak 1
- #guardrails-ai 1
- #hallucination-detection 1
- #lakera 1
- #llm-monitoring 1
- #llm-safety 1
- #llm-scanner 1
- #meta 1
- #microsoft 1
- #observability 1
- #output-validation 1
- #procurement 1
- #product-review 1
- #production 1
- #pyrit 1
- #rebuff 1
- #self-hosted 1
- #structured-output 1
- #tool-evaluation 1
- #validators 1
- #vendor-evaluation 1
- #vulnerability-scanning 1
Categories
reviews 6 posts
- PyRIT: Microsoft's AI Red Teaming Tool in Security WorkflowsPyRIT is Microsoft's open-source AI red teaming framework. Built for enterprise security teams, it has better CI/CD integration than research-first tools. The tradeoff is probe breadth.
- Guardrails AI: Output Validation That Doesn't Require RetrainingGuardrails AI provides a validation layer for LLM outputs — checking format, structure, and content without touching the model. The validator library is extensive. The performance overhead is manageable with the right configuration.
- Arize Phoenix: LLM Observability That's Actually FreeArize Phoenix is an open-source LLM observability platform that's evolved well beyond its origins as a drift detector. The security-relevant features — hallucination detection, retrieval quality, prompt monitoring — are production-ready.
- Rebuff: Open-Source Prompt Injection Defense in ProductionRebuff is a self-hosted prompt injection defense with a multi-layer architecture. The heuristics layer is fast; the LLM-based detection adds coverage. Here's the production configuration that made it viable.
- Garak LLM Scanner: Production-Grade Red Teaming or Research Tool?Garak is the most comprehensive open-source LLM vulnerability scanner. It was designed for research. Deploying it in CI/CD requires understanding what it's good at and what it's not.
- Lakera Guard: Prompt Injection Detection in PracticeLakera Guard is purpose-built for prompt injection detection rather than general content moderation. After four months in production, here's where it earns its cost and where it doesn't.