Senior Software Engineer

Role overview

Senior Software Engineer specializing in Python and the Data Ecosystem at ClickHouse. You will shape the Python connector and SDK ecosystem, expand integrations with orchestration and transformation tools, and drive ClickHouse’s AI/LLM integration strategy for architectures such as RAG, feature pipelines, and LLM-powered data applications.

Key missions

• Own and evolve ClickHouse’s Python connectors and SDKs, improving performance, reliability, and API design.
• Build and maintain integrations with:
  • Orchestration platforms: Airflow, Dagster, Prefect
  • Transformation tools: dbt
  • Ensure enterprise-grade quality standards.
• Lead the AI/LLM integration strategy by designing connectors and models that make ClickHouse a natural fit for:
  • RAG pipelines
  • Feature pipelines for ML
  • LLM-powered applications and agents
• Collaborate across teams to align integration work with broader platform priorities and engage with the open-source community.

Responsibilities

• Design, build, and maintain production-grade Python connectors/SDKs/integrations.
• Drive integration product thinking: contribute product-level insight into what to build and why.
• Work hands-on with AI/ML-related data engineering workflows in production.

Requirements

• 7+ years of software development experience, ideally with hands-on time as a Data Engineer, Data Scientist, or ML Engineer.
• Strong, concurrent Python experience: threading, multiprocessing, and async patterns.
• Solid Python data ecosystem experience: Pandas, NumPy, Pydantic, and related libraries.
• Proven experience designing/building/maintaining production-grade Python connectors/SDKs/integrations for a major platform.
• Deep understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.
• Hands-on AI/ML in data engineering contexts, such as:
  • embedding generation
  • vector search
  • feature pipelines
  • LLM-powered tooling in production
• Ability to deploy AI/ML models in production, including inference APIs and vector databases.
• Strong written and verbal communication; comfortable collaborating across engineering and with open-source communities.

Nice-to-haves

• Familiarity with the JVM ecosystem.
• Familiarity with ClickHouse or similar high-performance OLAP platforms.
• Prior contributions/practical experience with Airflow, Dagster, or Prefect.
• Prior experience as a Data Engineer or Data Scientist in a product-facing or platform role.