Gen AI and Agentic AI Engineer

Role Overview

Design, develop, optimize, and test Generative AI and Agentic AI solutions to deliver accurate and high-quality outputs for business applications. Partner with stakeholders to drive business value through LLM/RAG, prompt engineering, and AI-driven automation.

Responsibilities

• Prompt Design & Optimization: Create and refine prompts for LLMs; implement prompt techniques to improve response quality and efficiency.
• Agentic AI Development: Design, implement, and maintain agentic AI solutions across the agent lifecycle.
• Testing & Evaluation: Run and interpret A/B testing for prompt and automation variants; analyze model behaviors, agent paths, deviations, and degradations.
• Explainability & Governance:
  • Implement explainability techniques (e.g., SHAP) and explainability frameworks (mentions Model Context Protocols).
  • Provide recommendations for AI acceptable use and ethics; collaborate with Legal/Compliance.
• MLOps Collaboration & Monitoring: Work with MLOps to establish observability and monitoring to detect performance degradations and potential ethical/bias issues.
• Security & Data Quality: Ensure data integrity and adherence to security protocols and regulatory requirements.
• Documentation & Reuse: Create documentation and reusable prompt libraries/libraries for internal/external use.
• Stakeholder Collaboration: Coordinate with product managers, data scientists, ML engineers, and business stakeholders to integrate solutions into workflows.

Requirements (Must Have)

• Experience designing and developing Generative AI and agentic AI solutions.
• Experience performing A/B testing and interpreting results to evaluate AI model performance.
• Ability to implement AI explainability techniques (e.g., SHAP).
• Ability to create and maintain reusable prompt libraries.
• Experience defining and implementing AI workflows from design through production.

Nice-to-Haves / Keywords from Posting

• Agentic AI, GenAI, LLMs, and RAG.
• Prompt engineering and development of AI interactions.
• RPA / Robotic Process Automation background.
• Microsoft Azure AI toolset; GPT models and DALL·E.
• Familiarity with concepts like GANs and VAEs.
• Python, SQL.

Location & Work Setup

• Fully remote (W2 only).
• Mandatory 5-day onboarding in Tampa, FL (travel expenses covered).
• After onboarding: one trip per quarter to Florida (travel expenses covered).