Staff AI Engineer | US | Remote

ABOUT THE ROLE Grafana Labs is seeking a Staff AI Engineer to own the AI agent infrastructure and automation platform that powers our Marketing Operations organization. As a Staff Engineer, you will have high autonomy to drive technical direction and make decisions that impact the company's growth. This is a remote opportunity and we are looking for candidates from the U.S. WHAT YOU'LL DO As a Staff AI Engineer, you will be responsible for designing, building, and operating multi-agent AI systems that operate 24/7 across teams. Your key responsibilities will include: - Owning end-to-end development of multi-agent AI systems, from architecture and implementation through testing, deployment, and ongoing operation - Building modular, composable agentic systems using orchestration frameworks (LangChain, CrewAI, Anthropic MCP, or similar) - Developing reusable agentic skills that agents invoke across interfaces (Slack, dashboards, internal apps, CLIs) - Implementing observability and feedback loops including logging, performance metrics, prompt iteration, model evaluation, and cost management - Establishing governance and compliance standards for AI workflows including access controls, audit trails, PII handling, and human-in-the-loop escalation paths You will also be responsible for building systems that connect AI models to business systems (BigQuery, Slack, CRMs, email, calendars, analytics tools), architecting data flows for retrieval-augmented generation (RAG), and building serverless or containerized services that scale with usage and integrate with Grafana's cloud infrastructure. Additionally, you will partner with RevOps, Demand Generation, Regional Marketing, and SDR teams to scope high-impact automation problems, identify bottlenecks, and build solutions with measurable business outcomes. You will design and deploy workflows using orchestration tools (n8n, Workato, or custom platforms) with CI/CD, testing, and production reliability standards. WHAT YOU'LL NEED - 8+ years of software engineering experience with depth in backend development, systems integration, or data/analytics engineering - 2+ years hands-on experience applying LLMs/AI to production workflows, not just prototypes - Strong proficiency in Python and JavaScript/Node.js with Git-based workflows, code review practices, and testing discipline - Hands-on experience with LLM frameworks and patterns including prompt engineering, RAG, function calling/tool use, structured output parsing, and evaluation - Experience building and operating multi-agent systems at scale including agent decomposition, orchestration patterns (sequential chains, router/dispatcher, parallel fan-out), state management, and production monitoring WHY REMOTE Grafana Labs is a 100% remote company with 1,600+ team members across 40+ countries. We are committed to providing a flexible and inclusive work environment that allows our engineers to thrive from anywhere in the world. BENEFITS - Competitive salary - Comprehensive health plan - Parental leave - Education stipend - Life insurance - Flexible schedule - Access to AI coding assistants (Claude Code, Gemini CLI, OpenAI Codex, and others of your choice within security guidelines) - Opportunities for professional growth and development