#LLM-security

6bookmarks tagged with "LLM-security"

across 1 category: Information Security

• Buttercup: Open-Source AI-Driven Cyber Reasoning System

  GitHub • Aug 9, 2025 • Information Security

  Trail of Bits' second-place winning CRS from DARPA's AI Cyber Challenge - an automated system for discovering and patching vulnerabilities in open-source software using AI-augmented fuzzing and multi-agent patch generation.

  [crs][cyber-reasoning-system][vulnerability-discovery][automated-patching][fuzzing][ai-security][darpa][aixcc][trail-of-bits][oss-fuzz][libfuzzer][jazzer][static-analysis][security-automation][open-source-security][vulnerability-research][multi-agent-systems][llm-security][code-analysis]

• Prompt injection and the lethal trifecta - Bay Area AI Security Meetup

  simonwillison.net • Aug 9, 2025 • Information Security

  Transcript of Simon Willison's talk at the Bay Area AI Security Meetup explaining prompt injection vulnerabilities and demonstrating various attack methods across platforms like GitHub and ChatGPT.

  [ai-security][prompt-injection][llm-security][bay-area-ai][security-talks][ai-vulnerabilities][simon-willison][def-con][2025]

• CaMeL offers a promising new direction for mitigating prompt injection attacks

  simonwillison.net • Aug 9, 2025 • Information Security

  Analysis of CaMeL (Context-Aware Mitigation for LLMs), a new approach for defending against prompt injection attacks in language models.

  [ai-security][prompt-injection][llm-security][camel][mitigation-techniques][ai-defense][security-research][simon-willison][2025]

• The lethal trifecta for AI agents: private data, untrusted content, and external communication

  simonwillison.net • Aug 9, 2025 • Information Security

  Simon Willison identifies three dangerous capabilities that create critical security vulnerabilities when combined in AI systems: access to private data, exposure to untrusted content, and ability to communicate externally.

  [ai-security][prompt-injection][llm-security][data-exfiltration][ai-agents][security-vulnerabilities][simon-willison][2025]

• Design Patterns for Securing LLM Agents against Prompt Injections

  simonwillison.net • Aug 9, 2025 • Information Security

  Practical design patterns and architectural approaches for building more secure AI agents that are resistant to prompt injection attacks.

  [ai-security][prompt-injection][llm-security][design-patterns][security-architecture][ai-agents][mitigation-strategies][simon-willison][2025]

• Lessons From Red Teaming 100 Generative AI Products

  simonwillison.net • Aug 9, 2025 • Information Security

  Insights and patterns discovered from security testing 100 different generative AI products, revealing common vulnerabilities and defense strategies.

  [ai-security][red-teaming][prompt-injection][llm-security][security-testing][vulnerability-assessment][generative-ai][simon-willison][2025]