Job description
Join Aya Healthcare, winner of multiple Top Workplace awards!
The Product Manager IV (Domain Product Manager) will own the platform capabilities, standards, and workflows that make AI systems measurable, safe, explainable, and trustworthy. The PMIV will connect evaluation, governance, observability, risk management, and product delivery into a practical quality system.
Our AI-native team within Aya is focused on disrupting the market with AI Native user experiences and AI Native delivery practices, from UX, Product Management, Lean Delivery, Architecture, Engineering, and Evaluation. The team has a startup mentality with a constant eye towards scale, security, quality, and consumer trust.
Who We Are
We’re an $8+ billion, rapidly growing workforce solutions provider in the healthcare industry. We deliver tech-enabled services that help healthcare organizations meet and manage their contingent labor needs. We build and manage tech-enabled marketplaces for national and local healthcare talent and deliver contingent labor management solutions through our proprietary software platform.
At Aya, we’re obsessed with creating exceptional experiences for our clients, clinicians, and employees. In fact, we put employee satisfaction above all else. Our team members are responsible for incomparable customer experience and we know that happy employees are critical to maintaining happy clients. We foster an entrepreneurial, high-energy, low-bureaucracy culture and value innovative thinking and creative problem solving. We embrace diversity in thought and backgrounds unified by a commitment to high achievement. When you join Aya, you’ll be surrounded by teammates who care about you as an individual and leaders who will help you grow both personally and professionally.
Responsibilities
- Understand needs and friction points of AI developers, product teams, evaluators, data teams, and operators.
- Define the platform contract: what every squad can rely on, written down, versioned and enforced by the pipeline.
- Prioritize reusable capabilities for model and tool integration, context access, CI/CD, environments, feature flags, observability, evaluation, and incident response.
- Prioritize scenario libraries, automated evaluations, human review, red teaming, monitoring and incident investigation. Replace release gates with thresholds the pipeline enforces.
- Partner with Engineering and Architecture to define APIs, platform contracts, documentation, onboarding, and operational standards.
- Ensure secure access, least privilege, data protection, auditability, and separation of development, staging, and production.
- Define measures including time to first deployment, deployment frequency, change failure rate, reliability, and developer satisfaction.
- Make the decision record and the evaluation suite the documentation: intended behavior, limitations, risk controls, provenance and model or prompt changes live there and nowhere else.
- Manage tradeoffs between standardization, autonomy, speed, cost, and maintainability.
- Create feedback loops through internal research, usage analytics, support data, and platform reviews.
- Communicate platform strategy and investment needs to technology and product leaders.
- Publish platform health and adoption on the live status page. No status meetings.
- Keep the paved path the cheapest path; a squad bypassing the platform is the first thing to fix.
- Treat the development process itself as a product: own the next version of the AISDLC with the Flow leads.
- Own the human-in-the-loop register: every intervention becomes an evaluation case.
- Report the AI product quality lines on Aya’s own scorecard, weekly.
Qualifications
- Bachelor’s degree or equivalent experience in product management, engineering, data, quality, risk, security, or a related field.
- 5+ years of product management or technology experience with quality, platform, governance, analytics, or enterprise systems.
- Working understanding of AI evaluation, software quality, observability, privacy, security, and risk management.
- Ability to convert principles and policy requirements into usable workflows and measurable controls.
- Strong analytical, communication, facilitation, and cross-functional leadership skills.
- Comfort working with ambiguity and making risk-based prioritization decisions.
Preferred Qualifications
- Experience with LLM evaluation, red teaming, model monitoring, responsible AI, MLOps, or AI governance.
- Experience establishing enterprise quality or trust platforms.
What We Offer
- Free premium medical, dental, life and vision insurance
- Generous 401(k) match
- Aya also offers other benefits to those that are eligible and where required by applicable law, including reimbursements and discretionary bonuses
- Aya provides paid sick leave in accordance with all applicable state, federal, and local laws. Aya’s general sick leave policy is that employees accrue one hour of paid sick leave for every 30 hours worked. However, to the extent any provisions of the statement above conflict with any applicable paid sick leave laws, the applicable paid sick leave laws are controlling
- Celebrations! We hit our goals and reward ourselves.
- Company-sponsored virtual events, happy hours and team-building activities are always on the horizon — plus, you get a special treat on your birthday!
- Unlimited DTO — we believe in time off!
- Virtual yoga, meditation or boot camp classes offered daily
Compensation: Aya reasonably anticipates the pay scale for this position to be an annual salary of $165,000 to $185,000.
The pay scale for this position may vary if applicant possesses experience outside of what Aya reasonably anticipates for this position. Bonuses are subject to the role and your manager’s discretion.
Aya is an Equal Opportunity Employer (EEO), including Disability / Vets, and welcomes all to apply. Please click here for our EEO policy.
Apply at Aya Healthcare Inc. (opens in a new tab)
Source: Aya Healthcare Inc. job board (Greenhouse).
Report this job
Wrongly listed? Tell us why.