IT & Software

Senior Agent Infrastructure Engineer

Avenue.io Inc.

Toronto · Ontario · Canada

Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition in a remote-friendly environment. Shape platforms for autonomous agents at scale.

As a Senior Staff Software Engineer, you will create infrastructure spanning machine learning systems, distributed infrastructure, and developer experience. You will support secure execution, agent state management, model routing, and resource management. The work connects emerging research with reliable production platforms.

Key Responsibilities:

  • Build secure execution environments for agent-generated code
  • Design identity, authentication, and trust boundaries for agents
  • Develop model routing across model types and environments
  • Manage quotas and resources for long-running agent workflows
  • Create state, memory, and filesystem abstractions

Requirements:

  • Production machine learning infrastructure experience
  • Strong systems fundamentals and distributed systems experience
  • Hands-on agentic systems or multi-agent workflow experience
  • Familiarity with model routing and LLM provider frameworks
  • Experience with Kubernetes and fault-tolerant systems

Apply systems depth and machine learning understanding to build secure, scalable agent infrastructure at Cohere for future AI systems.

#J-18808-Ljbffr

Reference: WJ-4703_9790579

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.