Applied GAI in Security

Sign in Subscribe

Brandon Dixon

Brandon Dixon

Brandon is a cybersecurity expert currently leading Security Copilot at Microsoft. He is known for creating PassiveTotal, Blockade.io, NinjaJobs, PDF X-Ray, and other opensource tools

Last Week in GAI Security Research - 07/22/24

Last Week in GAI Security Research - 07/22/24

🎰 Blackhat 2024 is coming up on August 3-8th! If you intend to be in Las Vegas for the annual security conference and want to discuss generative AI applied to security use cases, send me an email. I will be speaking on one of the panels in the AI Summit and

Last Week in GAI Security Research - 07/15/24

Last Week in GAI Security Research - 07/15/24

Highlights from Last Week * 😎 A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends * 🛍 On the (In)Security of LLM App Stores * 🦠 Tactics, Techniques, and Procedures (TTPs) in Interpreted Malware: A Zero-Shot Generation with Large Language Models * ⚠️ eyeballvul: a future-proof benchmark for vulnerability detection in the wild

Last Week in GAI Security Research - 07/08/24

Last Week in GAI Security Research - 07/08/24

Highlights from Last Week * 🪤 JailbreakHunter: A Visual Analytics Approach for Jailbreak Prompts Discovery from Large-Scale Human-LLM Conversational Datasets * 🦙 Badllama 3: removing safety finetuning from Llama 3 in minutes * 🖇 Actionable Cyber Threat Intelligence using Knowledge Graphs and Large Language Models * 🧑‍💻 Enhancing the Capability and Robustness of Large Language Models through Reinforcement

Last Week in GAI Security Research - 07/01/24

Last Week in GAI Security Research - 07/01/24

Highlights from Last Week * 🪱 Synthetic Cancer – Augmenting Worms with LLMs * 🔗 Large Language Models for Link Stealing Attacks Against Graph Neural Networks * 🧑‍💻 Assessing the Effectiveness of LLMs in Android Application Vulnerability Analysis * 🦠 MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarization * 🦜 Poisoned LangChain: Jailbreak LLMs by LangChain

Last Week in GAI Security Research - 06/24/24

Last Week in GAI Security Research - 06/24/24

Highlights from Last Week * 🥷🏿 AgentDojo: A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents * 🐵 From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking * 💰 Jailbreaking as a Reward Misspecification Problem * 🏹 "Not Aligned" is Not "Malicious": Being Careful about Hallucinations of Large Language Models'

Last Week in GAI Security Research - 06/17/24

Last Week in GAI Security Research - 06/17/24

Highlights from Last Week * 🛍 Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs * 🕵‍♀ Security Vulnerability Detection with Multitask Self-Instructed Fine-Tuning of Large Language Models * 🚪 A Survey of Backdoor Attacks and Defenses on Large Language Models: Implications for Security Measures * 🤖 Machine Against the RAG: Jamming Retrieval-Augmented Generation with Blocker Documents * ⛳ Dataset

Last Week in GAI Security Research - 06/10/24

Last Week in GAI Security Research - 06/10/24

Highlights from Last Week * 💉Exfiltration of personal information from ChatGPT via prompt injection * 🦥 Are you still on track!? Catching LLM Task Drift with Activations * 🕵 Ranking Manipulation for Conversational Search Engines * 💔 BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models * 🎼 Transforming Computer Security and Public Trust Through the Exploration