Senior Software Engineer

Role overview

You’ll join a client team building a new AI Solutions capability and will design and build a reusable GenAI content-generation platform. The platform will support multiple internal AI products that follow a common flow: enterprise data + LLM orchestration → generated documents/emails/reports, so downstream teams can ship faster without rebuilding the stack.

Responsibilities

• Own backend architecture for a shared GenAI content-generation platform used across multiple internal products.
• Design multi-tenant patterns including:
  • configuration isolation
  • data segmentation
  • policy enforcement
  • clean service interfaces
• Implement LLM orchestration pipelines for high-quality generation, including:
  • templating
  • context selection
  • output post-processing
• Build or integrate retrieval components suitable for regulated environments, including:
  • semantic search / RAG
  • vector stores
• Partner with stakeholders to ensure security-by-design, auditability, and operational excellence.

Requirements

• 8+ years of software engineering experience; Python is the primary language.
• Built and shipped a multi-tenant platform in production (GenAI platform experience strongly preferred).
• Strong AWS experience (architecture + implementation).
• Hands-on experience with at least one of:
  • RAG / semantic search
  • document-generation pipelines
  • multi-agent systems
• Experience delivering LLM-enabled systems in regulated or highly controlled enterprise environments.

Nice to have

• Experience with private model hosting / in-VPC model endpoints.
• Familiarity with Bedrock / SageMaker or similar hosting patterns.
• Experience building internal developer platforms (SDKs, templates, CI/CD scaffolding).

Success metrics (high level)

• A clear, pragmatic architecture and “golden path” (design doc + reference implementation).
• A production-ready multi-tenant platform MVP supporting at least one end-to-end use case.
• Reusable components for retrieval, orchestration, guardrails, and post-processing.
• Operational readiness: logging/metrics/tracing, dashboards, alerting, deployment pipeline, and runbooks.

Start & location

• Start: ASAP (flexible)
• Remote-friendly within the U.S. (aligned time zones acceptable); occasional on-site may be requested.