Senior Software Engineer – AI Infrastructure
About This Role
The AI Infrastructure team builds and operates the production systems that power intelligent agents at scale, sitting at the foundation of the agent platform and ensuring that model inference, orchestration, and execution layers are reliable, observable, and performant under real-world load. Working closely with the Agent Systems team and broader infrastructure partners, this group owns the core primitives that enable agents to safely operate across internal systems in a high-scale, high-stakes environment serving millions of users, where systems must meet strict reliability, latency, and correctness standards. This is a deeply production-oriented team, combining strong systems thinking with applied ML infrastructure experience, building in Rust and operating services where performance and failure modes matter.
What You'll Be Doing
Designing and building the infrastructure layer powering AI agent systems in production
Developing high-performance Rust services that handle model inference, orchestration, and execution
Architecting scalable systems capable of supporting millions of users and high request throughput
Building reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
Defining guardrails, observability, and failure handling for agent-driven workflows
Optimizing latency, throughput, and cost across inference and orchestration layers
Partnering closely with the Agent Systems team to turn experimental prototypes into hardened production systems
Contributing to foundational infrastructure decisions in a high-scale, high-impact environment
What We're Looking For
5+ years of experience building and operating high-scale production systems
Strong proficiency in Rust and systems-level programming
Deep understanding of distributed systems, reliability engineering, and performance optimization
Experience operating services serving millions of users or high-throughput workloads
Familiarity with ML infrastructure, model serving, or MLOps in production environments
Experience designing observability, monitoring, and failure recovery systems
Strong collaboration skills working across infrastructure and applied engineering teams
A high ownership mindset suited to a high-stakes production environment
Bonus Points
Experience building infrastructure for agent-based or LLM-powered systems
Background in high-performance networking, async systems, or low-latency architectures
Experience with container orchestration and cloud-native infrastructure
Familiarity with evaluation frameworks and model performance monitoring at scale
Experience working in fast-moving 0→1 or platform-building teams
Salary Range
USD 127,200 - 254,400 per year
About Kraken
Kraken is a leading US-based cryptocurrency exchange, committed to providing secure, innovative, and reliable trading tools for digital assets. Our mission is to accelerate the global adoption of cryptocurrency by building a more open, free, and compliant financial system. We empower individuals and institutions alike with robust platforms designed for exceptional performance and peace of mind, operating at the forefront of financial technology and regulatory adherence. Our culture at Kraken is built on principles of autonomy, transparency, and a relentless pursuit of excellence. We foster an environment where passionate, talented individuals can thrive, take ownership of their work, and contribute to groundbreaking advancements in the blockchain space. Collaboration is key, and we champion diverse perspectives to solve complex challenges, ensuring our team members feel valued, supported, and continuously challenged to grow. Joining Kraken means becoming part of a dynamic team that is redefining the future of finance from our US base. We offer unparalleled opportunities for professional development, the chance to work on high-impact projects, and a direct role in shaping an industry poised for exponential growth. If you are eager to make a significant impact, innovate alongside some of the brightest minds, and build solutions that will change the world, explore our 121 open positions and discover where you belong.
Ready to Apply?
To submit your application for this position, please visit Kraken's official website and follow their application process.