Senior Principal AI Software Engineer (IT Go-To-Market & Customer Experience)

Role overview

Senior Principal AI Software Engineer for IT Go-To-Market & Customer Experience. You will help architect and build the next generation of business applications during Palo Alto Networks’ Generative AI transformation, with a strong emphasis on technical leadership and hands-on engineering.

Responsibilities

• Design and implement an “AI Gateway” intermediary layer to ensure vendor independence, enabling seamless switching between LLMs.
• Build a unified API endpoint that abstracts individual LLM provider complexity, with centralized access control and security.
• Implement GenAI-focused observability pipelines to capture trace-level data, prompt inputs/outputs, and model latency.
• Apply GenAI to complex Go-To-Market (GTM) business logic for IT, sales, and customer experience.
• Pioneer testing methodologies for QA, including establishing Golden Datasets and performing comparative model analysis.
• Partner with business stakeholders to design GTM workflows for sales/support operations.

Requirements

• 12+ years of IT system architecture, design, and development experience (or 8+ with a Master’s, or 5+ with a PhD).
• Hands-on experience with LLM-based applications, including exposure to models such as Llama 3, GPT-4, and Anthropic.
• Deep experience with multi-agent systems, Agent-to-Agent (A2A) communication, and orchestration frameworks.
• Expert-level proficiency in Python.
• Demonstrated technical leadership delivering large-scale implementations in Agile/Scrum environments.
• Ability to work directly with business stakeholders to design GTM-related workflows.

Nice-to-haves

• Familiarity with Java or Node.js for enterprise integration.
• Experience with AI tracing and evaluation tools such as LangSmith, Arize, HoneyHive, or implementing via OpenTelemetry.