Engineering Manager – Software Security & AI Benchmark Delivery

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking an experienced Engineering Manager – Software Security to lead the development and delivery of security-focused training and evaluation tasks for frontier AI coding models. You will oversee multiple engineering pods, taking ownership of delivery performance, technical quality, team capacity, and client alignment.

The project focuses on transforming real-world software vulnerabilities into rigorous, reproducible tasks that evaluate whether AI models can identify, understand, reproduce, and securely remediate vulnerabilities across different programming languages and software ecosystems.

As the final quality gate, you will ensure that all delivered tasks meet the client’s expectations for technical accuracy, difficulty, reproducibility, and evaluation robustness. This position combines software security expertise, multi-team leadership, operational management, and data-driven decision-making, with direct responsibility for delivering against Google’s project expectations.

Engagement Type: Contractor assignment
Duration: 3 months
Start Date: Expected to start next week
Commitment: 40 hours per week
Work Arrangement: Fully remote
Time Zone Requirement: Minimum 4 hours of overlap with PST
Project Focus: Software security, AI coding model evaluation, engineering team management, and benchmark delivery.

Key Responsibilities

  • Multi-Pod Leadership: Own delivery, quality, and capacity across multiple engineering pods, coordinating Pod Leads and ensuring consistent execution.

  • Delivery Planning: Plan task batches, assign work to Pod Leads, and monitor daily throughput against phase-specific targets.

  • Performance Management: Ensure batches meet Google’s expectations for task volume, technical difficulty, quality standards, and delivery timelines.

  • Client Communication: Lead weekly client reporting, communicate progress, provide delivery forecasts, and raise risks or dependencies proactively.

  • Risk Management: Identify and escalate tooling issues, rate limits, safety blocks, staffing constraints, and other delivery risks.

  • Scope Alignment: Work directly with Google to clarify requirements and align on task scope, timelines, task volume, and difficulty changes.

  • Final Quality Assurance: Conduct final reviews of security tasks before delivery, ensuring technical accuracy, reproducibility, and resistance to gaming or superficial solutions.

  • Technical Calibration: Train and calibrate Pod Leads on CWE classification, verifier robustness, task difficulty, technical quality, and acceptance criteria.

  • Recruitment & Hiring: Conduct interviews and make hiring decisions based on approved role requirements and project capacity needs.

  • Talent Development: Identify high-performing Trainers and support their development and promotion into Pod Lead positions.

  • Capacity Forecasting: Use throughput, workload, and quality data to forecast headcount requirements across project phases.

  • Workforce Planning: Initiate hiring waves approximately three weeks ahead of projected capacity requirements.

  • Operational Reporting: Use dashboards, performance indicators, and operational metrics to guide delivery decisions and staffing plans.

Requirements

  • 10+ years of overall professional software engineering experience, with a strong background in software security.

  • Proven experience leading technical teams against measurable delivery, quality, and schedule targets.

  • Strong understanding of CWE, CVE, and OWASP Top 10 across multiple programming languages and software ecosystems.

  • Demonstrated experience reproducing software vulnerabilities, reviewing security patches, and evaluating proof-of-vulnerability tests.

  • Experience designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments.

  • Strong proficiency in at least one major programming language, such as:

    • Python

    • JavaScript / TypeScript

    • Java

    • C / C++

    • C#

    • Go

    • Rust

    • Ruby

    • PHP

    • Kotlin

    • Swift

  • Experience with Git, Linux, Bash, Docker, and common software security tooling.

  • Ability to use dashboards, throughput metrics, quality data, and operational reports to make delivery and staffing decisions.

  • Experience managing or mentoring technical teams, including assigning work, reviewing output, providing feedback, and developing team leads.

  • Excellent written and verbal communication skills, including the ability to explain technical risks and project status to clients and internal stakeholders.

  • Strong organizational and prioritization skills, with the ability to manage multiple pods, competing priorities, and delivery phases simultaneously.

Apply for this job

Source: Gramian Consulting Group job board (Workable (all companies)).

Report this job

Wrongly listed? Tell us why.