#AI-security
12bookmarks tagged with "AI-security"
across 1 category: Information Security
42-b3yond-6ug - AIxCC Finalist CRS
aicyberchallenge.com • Aug 9, 2025 • Information Security
Collaborative university team led by Northwestern with University of Waterloo, Utah, Colorado Boulder, and New Hampshire. Notable for innovative 'super patches' that fix multiple unrelated bugs with single patches.
AIxCC Other Finalist Teams - Lacrosse & all_you_need_is_a_fuzzing_brain
aicyberchallenge.com • Aug 9, 2025 • Information Security
Two additional teams that qualified for AIxCC finals at DEF CON 33, each winning $2M for reaching the final round. Both teams built systems using fuzzing, static analysis, and LLM enhancements.
Buttercup: Open-Source AI-Driven Cyber Reasoning System
GitHub • Aug 9, 2025 • Information Security
Trail of Bits' second-place winning CRS from DARPA's AI Cyber Challenge - an automated system for discovering and patching vulnerabilities in open-source software using AI-augmented fuzzing and multi-agent patch generation.
DARPA AI Cyber Challenge (AIxCC)
aicyberchallenge.com • Aug 9, 2025 • Information Security
Two-year competition challenging teams to build AI-powered Cyber Reasoning Systems that autonomously find and patch vulnerabilities in critical infrastructure software. $18.5M total prize pool with finals at DEF CON 33.
Shellphish ARTIPHISHELL - AIxCC Finalist CRS
shellphish.net • Aug 9, 2025 • Information Security
UC Santa Barbara-led team's LLM-based Cyber Reasoning System with 60+ AI agents collaborating to autonomously find and patch vulnerabilities. Evolution of their 2016 CGC Mechanical Phish system.
Prompt injection and the lethal trifecta - Bay Area AI Security Meetup
simonwillison.net • Aug 9, 2025 • Information Security
Transcript of Simon Willison's talk at the Bay Area AI Security Meetup explaining prompt injection vulnerabilities and demonstrating various attack methods across platforms like GitHub and ChatGPT.
CaMeL offers a promising new direction for mitigating prompt injection attacks
simonwillison.net • Aug 9, 2025 • Information Security
Analysis of CaMeL (Context-Aware Mitigation for LLMs), a new approach for defending against prompt injection attacks in language models.
The lethal trifecta for AI agents: private data, untrusted content, and external communication
simonwillison.net • Aug 9, 2025 • Information Security
Simon Willison identifies three dangerous capabilities that create critical security vulnerabilities when combined in AI systems: access to private data, exposure to untrusted content, and ability to communicate externally.
Design Patterns for Securing LLM Agents against Prompt Injections
simonwillison.net • Aug 9, 2025 • Information Security
Practical design patterns and architectural approaches for building more secure AI agents that are resistant to prompt injection attacks.
Lessons From Red Teaming 100 Generative AI Products
simonwillison.net • Aug 9, 2025 • Information Security
Insights and patterns discovered from security testing 100 different generative AI products, revealing common vulnerabilities and defense strategies.
Team Atlanta - AIxCC First Place Winner
team-atlanta.github.io • Aug 9, 2025 • Information Security
Georgia Tech-led team with Samsung Research, KAIST, and POSTECH that won DARPA AIxCC with their Atlantis CRS. Multi-language bug-finding and fixing system that patches vulnerabilities without human intervention.
Theori Robo Duck - AIxCC Third Place CRS
GitHub • Aug 9, 2025 • Information Security
Third-place winning Cyber Reasoning System from Theori, AI researchers and security professionals with 8 DEF CON CTF wins. Won semifinals with most bug classes found, finished third in finals.