AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals
Clear

20 tools match

Active Self hosted Clear all

  • AI-Infra-Guard

    Tencent

    AI Security

    Open source scanner that fingerprints self hosted AI infrastructure components and matches them against known vulnerabilities, with an MCP server analysis mode.

    Open source
    Emerging

  • Akto

    Akto

    AI Security

    API security platform that builds an API inventory from mirrored traffic and runs automated tests for authorization, injection and data exposure flaws.

    Commercial, free tier
    Growing

  • Arize AI

    Arize AI

    AI Security

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial
    Established

  • Arthur AI

    Arthur

    AI Security

    Model monitoring and guardrail platform that evaluates LLM inputs and outputs inline for injection, sensitive data and unsupported claims.

    Open source and commercial
    Growing

  • CalypsoAI

    CalypsoAI

    AI Security

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial
    Growing

  • Cerbos

    Cerbos

    AI Security

    Decoupled authorization engine that evaluates YAML policies over a principal, resource and action and returns an allow or deny decision over an API.

    Open source and commercial
    Established

  • Galileo AI

    Galileo

    AI Security

    Evaluation and observability platform for LLM and agent applications, with purpose built scoring models and an inline guardrail path.

    Commercial
    Growing

  • Garak

    NVIDIA

    AI Security

    Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.

    Open source
    Growing

  • Giskard

    Giskard

    AI Security

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium
    Growing

  • Guardrails AI

    Guardrails AI

    AI Security

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial
    Growing

  • AI-Infra-Guard

    Tencent

    Open source scanner that fingerprints self hosted AI infrastructure components and matches them against known vulnerabilities, with an MCP server analysis mode.

    Open source Emerging
    AI Security

  • Akto

    Akto

    API security platform that builds an API inventory from mirrored traffic and runs automated tests for authorization, injection and data exposure flaws.

    Commercial, free tier Growing
    AI Security

  • Arize AI

    Arize AI

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial Established
    AI Security

  • Arthur AI

    Arthur

    Model monitoring and guardrail platform that evaluates LLM inputs and outputs inline for injection, sensitive data and unsupported claims.

    Open source and commercial Growing
    AI Security

  • CalypsoAI

    CalypsoAI

    Commercial platform that proxies enterprise LLM traffic through policy scanners and runs automated red teaming against models and applications.

    Commercial Growing
    AI Security

  • Cerbos

    Cerbos

    Decoupled authorization engine that evaluates YAML policies over a principal, resource and action and returns an allow or deny decision over an API.

    Open source and commercial Established
    AI Security

  • Galileo AI

    Galileo

    Evaluation and observability platform for LLM and agent applications, with purpose built scoring models and an inline guardrail path.

    Commercial Growing
    AI Security

  • Garak

    NVIDIA

    Command line LLM vulnerability scanner that fires a library of attack probes at a model endpoint and scores the responses with matched detectors.

    Open source Growing
    AI Security

  • Giskard

    Giskard

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium Growing
    AI Security

  • Guardrails AI

    Guardrails AI

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial Growing
    AI Security

  • HiddenLayer AISec

    HiddenLayer

    AI Security

    Commercial platform that scans serialized model files for embedded code and watches inference traffic for extraction and evasion behavior.

    Commercial
    Growing

  • Lakera Guard

    Lakera

    AI Security

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier
    Growing

  • LLM Guard

    Protect AI

    AI Security

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source
    Growing

  • NeuralTrust

    NeuralTrust

    AI Security

    AI gateway that inspects and enforces policy on LLM traffic, paired with adversarial testing and conversation observability.

    Commercial
    Emerging

  • NVIDIA NeMo Guardrails

    NVIDIA

    AI Security

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source
    Growing

  • Prompt Security

    Prompt Security

    AI Security

    Inspects GenAI traffic across employee tools, homegrown applications and AI coding assistants, applying redaction and blocking policy inline.

    Commercial
    Growing

  • Promptfoo

    Promptfoo

    AI Security

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial
    Growing

  • Protect AI Guardian

    Protect AI

    AI Security

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial
    Growing

  • WhyLabs

    WhyLabs

    AI Security

    Observability platform for ML and LLM systems built on lightweight statistical profiles, with drift monitoring and text quality and safety metrics.

    Open source and commercial
    Established

  • Xage Security

    Xage Security

    AI Security

    Distributed zero trust access platform for operational and industrial environments, extended to control what machine and AI agent identities may do.

    Commercial
    Established

  • HiddenLayer AISec

    HiddenLayer

    Commercial platform that scans serialized model files for embedded code and watches inference traffic for extraction and evasion behavior.

    Commercial Growing
    AI Security

  • Lakera Guard

    Lakera

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier Growing
    AI Security

  • LLM Guard

    Protect AI

    Python library of composable input and output scanners that sanitize prompts and validate model responses entirely within your own environment.

    Open source Growing
    AI Security

  • NeuralTrust

    NeuralTrust

    AI gateway that inspects and enforces policy on LLM traffic, paired with adversarial testing and conversation observability.

    Commercial Emerging
    AI Security

  • NVIDIA NeMo Guardrails

    NVIDIA

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source Growing
    AI Security

  • Prompt Security

    Prompt Security

    Inspects GenAI traffic across employee tools, homegrown applications and AI coding assistants, applying redaction and blocking policy inline.

    Commercial Growing
    AI Security

  • Promptfoo

    Promptfoo

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial Growing
    AI Security

  • Protect AI Guardian

    Protect AI

    Scanning gateway for machine learning model files that inspects serialized artifacts for executable payloads and enforces policy on what may be pulled.

    Commercial Growing
    AI Security

  • WhyLabs

    WhyLabs

    Observability platform for ML and LLM systems built on lightweight statistical profiles, with drift monitoring and text quality and safety metrics.

    Open source and commercial Established
    AI Security

  • Xage Security

    Xage Security

    Distributed zero trust access platform for operational and industrial environments, extended to control what machine and AI agent identities may do.

    Commercial Established
    AI Security
Tick up to 4 tools above.