AppSecNews

AI Security

AI and LLM Security

Test and defend models, prompts, agents and the infrastructure around them.

45 tools profiled

How it differs Tests and guards models, LLM applications and agents against prompt injection, jailbreaks and data leakage. Scanning an AI app's own code is still SAST or SCA.

License
Subcategory
Deployment
Languages
Integrations
Maturity
Signals
Clear

9 tools match

Active Langchain Clear all

  • Arize AI

    Arize AI

    AI Security

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial
    Established

  • Galileo AI

    Galileo

    AI Security

    Evaluation and observability platform for LLM and agent applications, with purpose built scoring models and an inline guardrail path.

    Commercial
    Growing

  • Giskard

    Giskard

    AI Security

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium
    Growing

  • Guardrails AI

    Guardrails AI

    AI Security

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial
    Growing

  • Lakera Guard

    Lakera

    AI Security

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier
    Growing

  • Arize AI

    Arize AI

    LLM and ML observability platform that captures application traces and runs evaluations over them, with an open source tracing and evaluation component.

    Open source and commercial Established
    AI Security

  • Galileo AI

    Galileo

    Evaluation and observability platform for LLM and agent applications, with purpose built scoring models and an inline guardrail path.

    Commercial Growing
    AI Security

  • Giskard

    Giskard

    Python testing library that scans models and LLM applications for security and quality failures, then turns findings into a reusable test suite.

    Freemium Growing
    AI Security

  • Guardrails AI

    Guardrails AI

    Python framework that wraps LLM calls in composable validators and decides what to do when a prompt or a response fails one.

    Open source and commercial Growing
    AI Security

  • Lakera Guard

    Lakera

    Detection API that classifies prompts and model outputs for injection, jailbreak attempts, sensitive data and policy violations before they land.

    Commercial, free tier Growing
    AI Security

  • NVIDIA NeMo Guardrails

    NVIDIA

    AI Security

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source
    Growing

  • Promptfoo

    Promptfoo

    AI Security

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial
    Growing

  • Vectara

    Vectara

    AI Security

    Managed retrieval augmented generation platform whose security relevance is grounding, citation and a hallucination evaluation model applied to responses.

    Commercial
    Established

  • WhyLabs

    WhyLabs

    AI Security

    Observability platform for ML and LLM systems built on lightweight statistical profiles, with drift monitoring and text quality and safety metrics.

    Open source and commercial
    Established

  • NVIDIA NeMo Guardrails

    NVIDIA

    Toolkit for defining rails on an LLM conversation using a dedicated modeling language, controlling input, output, topic, retrieval and tool execution.

    Open source Growing
    AI Security

  • Promptfoo

    Promptfoo

    Config driven test and red team harness for LLM applications, running assertions and generated adversarial probes against prompts, models and agents.

    Open source and commercial Growing
    AI Security

  • Vectara

    Vectara

    Managed retrieval augmented generation platform whose security relevance is grounding, citation and a hallucination evaluation model applied to responses.

    Commercial Established
    AI Security

  • WhyLabs

    WhyLabs

    Observability platform for ML and LLM systems built on lightweight statistical profiles, with drift monitoring and text quality and safety metrics.

    Open source and commercial Established
    AI Security
Tick up to 4 tools above.