Senior Software Engineer - AI Platform Team

About the role

This role focuses on developing and maintaining the foundational AI infrastructure at Coinbase. You will be responsible for key components like the LLM Gateway, which unifies access to numerous models with features like authentication and cost optimization. Another critical area is the AI Hub, serving as a central access point for agents, models, and knowledge bases, ensuring a streamlined development and deployment process for AI capabilities across the company.

The position also involves building the Agent and MCP runtime environment, which utilizes microVM sandboxes for secure agent execution and manages a large number of servers. You will contribute to creating Knowledge Bases that integrate various data sources for agents to query, and develop tools for AI spend management and performance evaluation. This includes building in-house LLM-as-judge systems for tracing and evaluation.

Success in this role means taking ownership of significant, multi-quarter projects within the AI platform or applied AI agents. This requires close collaboration with engineering, security, legal, finance, and product teams, as well as external partners. A key aspect of the role also includes publicly sharing the team's work through blog posts and presentations.

The listed salary range for this position is between $98,000 and $162,000.

Skills that matter here

• AI: This role directly involves building and operating LLM and agent infrastructure, as well as developing AI agents for various business functions.
• Software Development: You will be writing code to create and maintain core platform components, runtimes, APIs, and applied AI solutions.
• Platform Engineering: The position focuses on building scalable, reliable, and secure infrastructure that other teams at Coinbase will leverage for their AI initiatives.

Who this role suits

• Someone who thrives in an intense, high-bar environment and is motivated by being pushed to their limits.
• An individual who can independently own and drive large, complex projects from conception to completion.
• A collaborator who excels at partnering with diverse internal teams and external providers.
• A person interested in showcasing their team's technical achievements publicly through writing and speaking.

From the employer

What you’ll be doing:

• LLM Gateway: one API for 60+ models across all major providers, including self-hosted open weight models, with auth, PII redaction, quotas, fallbacks, and cost optimization.
• AI Hub: single front door for agents, skills, MCP servers, knowledge bases, models, memories, and keys.
• Agent and MCP runtime: microVM sandboxes per agent run, a governed MCP gateway over 125+ servers, cross trust agent identity, tier 1 agents for code, analytics, and exec personas.
• Knowledge Bases: connect any data source, auto provision vector and markdown stores, queryable by any agent over MCP.
• AI Spend Hub: FinOps for AI, spend attribution and governance across the company.
• Evaluation and observability: in-house LLM as judge harness with full tracing and eval tooling.
• Company wide chat and low code workflow surfaces, thousands of weekly actives each.
• Applied AI: we embed with teams to build production agents, build the feedback loops that let subject matter experts refine them, and apply traditional ML including fine tuning where it beats prompting.

What we look for in you:

• Own multi quarter, high impact initiatives on the platform (gateway, runtime, knowledge, governance) or the applied agents on top.
• Partner across engineering, security, legal, finance, and product, and work directly with our partners at the frontier labs and major cloud providers.
• Public blog posts and talks showcasing the team's work.

What we offer:

• Competitive salary ranging from $98K to $162K.
• Remote work flexibility with quarterly in-person sessions.
• Equal Opportunity Employer status.