Principal Engineering Manager

Role Overview

GitHub is hiring a Principal Engineering Manager to lead development of the GitHub Copilot AI inference platform. You’ll oversee allocation and deployment of AI resources, manage high-throughput inference infrastructure, and improve the experiment-to-production pipeline for generative AI workloads at scale.

Responsibilities

• Own and drive the technical roadmap aligned with product goals, prioritizing engineering work strategically and adopting new technologies/methodologies when beneficial.
• Coordinate across teams: facilitate cross-team communication, identify dependencies, and resolve conflicts to ensure seamless integration across products, applications, and services.
• Lead organizational growth: mentor senior engineering leaders, manage performance, and ensure team skills remain current.
• Ensure performance, reliability, and compliance through capacity planning and dynamic traffic shaping.
• Guide teams to design scalable, secure, and observable systems that meet business and technical requirements.
• Champion experimentation and telemetry-driven development to enable rapid iteration and data-informed decisions.
• Drive engineering excellence via automation, tooling, and standardization across deployment, testing, and operations.
• Own incident response and reliability practices, ensuring services meet SLOs and that postmortems drive systemic improvements.
• Partner with architects to shape the long-term AI infrastructure vision, identify innovation opportunities, and lead initiatives that scale globally.

Requirements

• 11+ years of software engineering / computer science (or related) experience, including proven experience delivering production software.
• Strong coding background in one or more of: C, C++, C#, Java, JavaScript, Go, Ruby, Rust, Python.
• Demonstrated technical leadership in distributed systems and generative AI serving architectures.

Nice-to-Haves

• Background in orchestration frameworks for generative AI workloads.
• Experience partnering with product, infrastructure, and research teams (including cross-company collaboration with Microsoft).