LLM Safeguards: Security, Privacy, Compliance, Anti-Hallucination
AI Engineer World's Fair 2024 · 34:10
AI Security and Governance
Prediction Guard builds an AI control plane that lets enterprises govern models, tools and agents inside their own infrastructure. Its platform combines prompt injection filtering, personal information redaction, factual consistency checks and policy enforcement. Agent Forge lets users create interactive or autonomous agents through APIs or natural language prompts and connect systems through MCP. For AI and platform engineers, OpenAI- and Anthropic-compatible APIs support existing development tools across self-hosted models and cloud endpoints.
Founded in 2023, Prediction Guard is led by founder and CEO Daniel Whitenack, a data scientist with experience deploying machine learning at scale. Its engineering approach combines private model hosting with input filters and output validation. In 2024, its team optimized Intel Gaudi 2 inference through dynamic request batching, load balancing across model replicas and prompt padding to maintain consistent input shapes.
By 2024, the company reported supporting over 4,500 users across three hackathons. Its enterprise customers included Purdue University, Cultura and Modaxo in 2025. That year, a $3.7 million seed funding round led by Sovereign’s Capital was intended to fund hiring and platform development. In 2026, an active distribution partnership with Carahsoft and an AWS Marketplace offering expanded procurement access, including government channels; customers were already subscribing through the marketplace.
AI Engineer World's Fair 2024 · 34:10
Affiliations reflect their AIE appearances, not necessarily current employment.
Audience questions extended the discussion to RAG data permissions, organizational data classification, and dry-run workflows with human review.
Affiliations reflect each recorded session, not necessarily current employment.