Applied GAI in Security

Sign in Subscribe

Brandon Dixon

Brandon Dixon

Brandon is a cybersecurity expert currently leading Security Copilot at Microsoft. He is known for creating PassiveTotal, Blockade.io, NinjaJobs, PDF X-Ray, and other opensource tools

Last Week in GAI Security Research - 10/21/24

Last Week in GAI Security Research - 10/21/24

Highlights from Last Week * 🤔 Cognitive Overload Attack:Prompt Injection for Long Context * 💂‍♂ On Calibration of LLM-based Guard Models for Reliable Content Moderation * 🕷 When LLMs Go Online: The Emerging Threat of Web-Enabled LLMs * 🧌 Can LLMs be Scammed? A Baseline Measurement Study * 🌱 Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue

Hire an AI Strategist in Security

Hire an AI Strategist in Security

The current AI boom is unlike any other, moving at an unprecedented pace. It has been nearly two years since the launch of ChatGPT, and new advancements, features, and research papers continue to emerge almost daily. Many people I speak with—individuals and organizations—often feel overwhelmed by the amount

Last Week in GAI Security Research - 10/14/24

Last Week in GAI Security Research - 10/14/24

Highlights from Last Week * 🪱 Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systems * ⚠️ AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents * 🪝 APOLLO: A GPT-based tool to detect phishing emails and generate explanations that warn users * 🎶 Coevolving with the Other You: Fine-Tuning LLM with Sequential Cooperative Multi-Agent Reinforcement Learning * 🐞 RealVul: Can

Last Week in GAI Security Research - 10/07/24

Last Week in GAI Security Research - 10/07/24

Highlights from Last Week * 🫥 The Perfect Blend: Redefining RLHF with Mixture of Judges * 🔏 Confidential Prompting: Protecting User Prompts from Cloud LLM Providers * 🦺 Overriding Safety protections of Open-source Models * 🤖 Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents * 🧠 Undesirable Memorization in Large Language Models: A Survey * 🚧 The

Last Week in GAI Security Research - 09/30/24

Last Week in GAI Security Research - 09/30/24

Highlights from Last Week * 💂‍♂ MoJE: Mixture of Jailbreak Experts, Naive Tabular Classifiers as Guard for Prompt Attacks * 📚 Unit Test Generation for Vulnerability Exploitation in Java Third-Party Libraries * 🔗 LLMs are One-Shot URL Classifiers and Explainers * 🛻 Enhancing LLM-based Autonomous Driving Agents to Mitigate Perception Attacks * ⛔ Holistic Automated Red Teaming for Large Language

Last Week in GAI Security Research - 09/23/24

Last Week in GAI Security Research - 09/23/24

Highlights from Last Week * 🧮 Jailbreaking Large Language Models with Symbolic Mathematics * ❇ AutoSafeCoder: A Multi-Agent Framework for Securing LLM Code Generation through Static Analysis and Fuzz Testing * 📨 Towards Novel Malicious Packet Recognition: A Few-Shot Learning Approach * 🧑‍💻 Hacking, The Lazy Way: LLM Augmented Pentesting * 📝 CoCA: Regaining Safety-awareness of Multimodal Large Language Models

Last Week in GAI Security Research - 09/16/24

Last Week in GAI Security Research - 09/16/24

Highlights from Last Week * 🍯 LLM Honeypot: Leveraging Large Language Models as Advanced Interactive Honeypot Systems * 🔎 Exploring LLMs for Malware Detection: Review, Framework Design, and Countermeasure Approaches * ⛑️ LLM-Enhanced Software Patch Localization * 🔒 A First Look At Efficient And Secure On-Device LLM Inference Against KV Leakage * 📒 Using Large Language Models for Template Detection