AI Red Teamer, Cybersecurity (Remote) at Handshake · LumiJobs

Responsibilities

As a Cybersecurity Red Teamer, you will evaluate whether AI models can be manipulated into generating functional malware, viable exploit code, attack tooling, or step-by-step operational guidance that could give a threat actor meaningful assistance in carrying out cyberattacks.
Your job is to find the gaps between what a model’s safety guardrails are intended to block and what a skilled adversary can actually extract.
This role requires you to think like an attacker who has access to a highly capable AI assistant. You will craft adversarial prompts and multi-turn interaction chains that simulate how real threat actors, ranging from inexperienced attackers to advanced persistent threat operators, might use LLMs to accelerate reconnaissance, weaponization, exploitation, lateral movement, persistence, and exfiltration.
Deep cybersecurity expertise is essential. Your value will come from being able to examine a model-generated payload, exploit chain, or attack plan and determine whether it would actually work, how much refinement it would require, and what type of attacker it could meaningfully assist.
This position may be performed from our Seattle location or remotely within the United States. Seattle-based and remote team members will collaborate closely through shared evaluation workflows, regular feedback, and virtual working sessions.
Design technically grounded adversarial prompts that test whether models provide meaningful assistance across the cyber kill chain, from reconnaissance through exfiltration and impact
Evaluate model-generated code and technical output for functional correctness, determining whether outputs represent real exploits, plausible attack tooling, or nonfunctional noise
Test model behavior across offensive categories, including malware generation, vulnerability exploitation, social engineering, credential harvesting, privilege escalation, command-and-control infrastructure, and data exfiltration
Probe dual-use boundaries by testing how models respond to queries that combine legitimate security research, penetration testing, and defensive operations with offensive applications
Simulate attacker personas at varying skill levels, including opportunistic, intermediate, and advanced or APT-level actors
Test multi-step and multi-turn attack chains, including scenarios in which early turns establish benign context before pivoting to malicious requests
Score model responses using structured harm taxonomies and severity rubrics calibrated to real-world exploitability

AI Red Teamer, Cybersecurity (Remote)

Responsibilities

Qualification

Required

Preferred

Company

Handshake

More roles at Handshake