AI Platform Engineer

HALO Branded Solutions is a global leader in branded merchandise, uniform programs, and recognition solutions, and we’re building something new. We’re assembling a dedicated Agentic Systems team to design and build the intelligent systems that will transform how we take an order from ideation to delivery. That means reimagining the full order management lifecycle: quote capture, supplier and decorator coordination, shipping, PO and invoicing as a platform where AI agents do the work that today requires dozens of manual handoffs across customers, sales, operations, and finance.

We’re not experimenting with AI. We’re building production systems that will run the business.

HALO is looking for a AI Platform Engineer who will make the platform real: building, running, and hardening the AI harness (runtime layer), control plane (governance layer), and operations control center (observability layer) in close partnership with the AI Platform Architect. This is the role that sits between architectural vision and working production infrastructure, implementing the orchestration framework, building the shared state and memory layer, establishing the integration contracts, and ensuring the platform is reliable enough that every agent running on it actually works. The Architect draws the blueprint; you build the building and keep it standing.

This is not a junior role with a senior title. This is a systems-first engineering role with serious development depth. The decisions you make at the implementation level, how state is managed across agent handoffs, how the runtime is structured so deploying a new agent doesn’t require rebuilding the platform, how failure is isolated so one agent’s problem doesn’t cascade, determine whether HALO’s agents work in production. That’s the responsibility this role carries. If you’re a strong systems engineer with deep distributed systems instincts who is ready to move into AI infrastructure, or an experienced AI platform engineer who wants to build something from the ground up, this is the role.

Responsibilities

Build and operate the orchestration infrastructure.

Implement the multi-agent orchestration layer that all HALO agents run on, managing routing between agents, retry logic, circuit breakers, payload validation, and sequencing. This infrastructure lives outside of individual agents, not inside them. Framework selection is an Architect-level decision; implementation and ongoing operation are yours.

Own shared state and memory.

Design and implement the state management layer that lets agents pass context across handoffs without losing information: session state, cross-agent memory, and the persistence model that supports both short-lived task agents and longer-running workflow agents.

Build the agent runtime environment.

Own the infrastructure agents execute on: deployment pipelines, environment management, model version pinning, and the scaffolding that makes deploying a new agent a configuration exercise, not an infrastructure project. The Agent Developers should be able to ship a new agent without filing a ticket to you first.

Define and enforce integration contracts.

Work directly with the AI Integration Engineer to establish and maintain the contracts governing how agents request data: format, latency guarantees, error handling. Own the API gateway layer between the orchestration platform and the external systems agents interact with.

Own platform reliability.

Uptime, failure isolation, incident response for agent failures, and the runbook for what happens when an agent behaves unexpectedly in production. This is an ongoing operational responsibility. The platform is never “done” in a way that lets you stop thinking about its reliability.

Provide the observability infrastructure.

Implement the platform-level hooks: logging interfaces, trace endpoints, policy enforcement points that the Governance Engineer instruments. The observability standards live with the Governance Engineer; the infrastructure that makes those standards enforceable lives with you.

Requirements

• 5+ years of software or platform engineering with genuine depth in distributed systems: state management, failure modes, event-driven architecture, or API platform engineering
• Experience building or operating infrastructure that other engineers build on, platforms with downstream consumers who depend on their reliability
• Production experience with at least one agent or LLM orchestration framework (AWS AgentCore, LangGraph, CrewAI, LangChain, or equivalent) or strong distributed systems instincts and demonstrated ability to ramp quickly
• Comfort with operational ownership and being accountable for reliability

You’ll stand out if you have:

• Hands-on experience building multi-agent orchestration infrastructure in production
• Familiarity with agent state and memory patterns: how context persists across agent turns, sessions, and workflow stages
• Experience with AI observability tooling (LangSmith, Arize, Weights & Biases, or equivalent) from the infrastructure side
• Background in API gateway design and integration contract management between platform layers
• Experience in order management, commerce, or supply chain domains

Compensation: The estimated base salary range for this position is between $170,000-$220,000 annually. Please note that this pay range serves as a general guideline and reflects a broad spectrum of labor markets across the US. While it is uncommon for candidates to be hired at or near the top of the range, compensation decisions are influenced by various factors. At HALO, these include, but are not limited to, the scope and responsibilities of the role, the candidate’s work experience, location, education and training, key skills, internal equity, external market data, and broader market and business considerations.

Benefits: At HALO, we offer benefits that support all aspects of your life, helping you find a work-life balance that’s right for you. Our comprehensive benefits include nationwide coverage for Medical, Dental, Vision, Life, and Disability insurance, along with additional Voluntary Benefits. Prepare for your financial future with our 401(k) Retirement Savings Plan, Health Savings Accounts (HSA), and Flexible Spending Accounts (FSA).

Application Information: To apply to this opportunity, click the APPLY button at the top right or very bottom of the screen to complete our online application. A resume is optional, so you may choose to upload and have the application prefill with your information. There are 5 sections to complete in total, including General information, Work History, Education, Compliance, and optional demographic questions. Once you have successfully submitted your application, you will receive a submission confirmation email from our system.

Application Deadline: Applications are reviewed and processed only when there is a specific need or opportunity, rather than on a fixed schedule or at a set deadline. Because they are reviewed on an as-needed basis, a job posting will be removed once the position has been filled or is no longer available.

More About HALO

At HALO, we energize our clients’ brands and amplify their stories to capture the attention of those who matter most. That’s why over 60,000 small- and mid-sized businesses partner with us, making us the global leader in the branded merchandise industry.

• Career Advancement: At HALO, we’re passionate about promoting from within. Internal promotions have been key to our exponential growth over the past few years. With so many industry leaders at HALO, you’ll have the opportunity to accelerate your career by learning from their experience, insights, and skills. Plus, you’ll gain access to HALO’s influential global network, leadership opportunities, and diverse perspectives.
• Culture: We love working here, and we’re confident you will too. At HALO, you’ll experience a culture of ingenuity, inclusion, and relentless determination. We push the limits of possibility and imagination by staying curious, humble, and bold breaking through yesterday’s limits. Diversity fuels our creativity, and we thrive when each of us contributes to an inclusive environment based on respect, dignity, and equity. We hold ourselves to a high standard of excellence with a commitment to results and supporting one another with accountability, transparency, and dependability.
• Recognition: At HALO, your success is our success. You can count on us to celebrate your wins. Colleagues across the company will join in recognizing your milestones and nominating you for awards. Over time, you’ll accumulate recognition that can be converted into gift cards, trips, concert tickets, and merchandise from your favorite brands.
• Flexibility: Many of our roles offer hybrid work options, and we pride ourselves on flexible schedules that help you balance professional and personal demands. We believe that supporting our customers is a top priority and trust that you and your manager will collaborate to create a schedule that achieves this goal.

HALO is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We insist on an environment of mutual respect where equal employment opportunities are available to all applicants without regard to race, color, religion, sex, pregnancy (including childbirth, lactation and related medical conditions), national origin, age, physical and mental disability, marital status, sexual orientation, gender identity, gender expression, genetic information (including characteristics and testing), military and veteran status, and any other characteristic protected by applicable law. Inclusion is a core value at HALO and we seek to recruit, develop and retain the most talented people.

HALO participates in E-Verify. Please see the following notices in English and Spanish for important information: E-Verify Participation and Right to Work.

HALO is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need reasonable accommodation because of a disability for any part of the employment process – including the online application and/or overall selection process – you may email us at hr@halo.com. Please do not use this as an alternative method for general inquiries or status on applications as you will not receive a response. Reasonable requests will be reviewed and responded to on a case-by-case basis.