About the role

Role Overview

Senior Software Engineer specializing in Python and the data ecosystem. You will shape ClickHouse’s Python connector and SDK ecosystem, build integrations with orchestration/transformation tools, and help drive ClickHouse’s AI/LLM integration strategy.

Key Missions

Evolve ClickHouse’s Python connectors and SDKs, improving performance, reliability, and API design.
Build and maintain integrations with:
- Orchestration platforms: Airflow, Dagster, Prefect
- Transformation tools: dbt
Lead the AI/LLM integration strategy, designing connectors/models that make ClickHouse a natural fit for:
- RAG architectures
- ML feature pipelines
- LLM-powered data applications

Responsibilities

Own and evolve the ClickHouse Python connector and SDK ecosystem.
Provide product-level insight into what to build and why, based on deep understanding of data engineering workflows.
Collaborate across engineering functions and with open-source communities.

Requirements

7+ years of software development experience; ideally hands-on as a Data Engineer, Data Scientist, or ML Engineer.
Solid experience in the Python data ecosystem: Pandas, NumPy, Pydantic, and related libraries.
Deep experience designing/building/maintaining production-grade Python connectors/SDKs/integrations for at least one major platform (orchestration, BI, MLOps, or data transformation).
Strong written and verbal communication; comfortable cross-functional and open-source collaboration.
Experience with concurrent Python: threading, multiprocessing, and async patterns.
Hands-on AI/ML in data engineering contexts (production—not just experimentation): embedding generation, vector search, feature pipelines, or LLM tooling.
Database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.

Nice to Have

Prior contributions to Airflow, Dagster, or Prefect.
Experience deploying AI/ML models in production (inference APIs, vector databases).
Prior Data Engineering/Data Science experience in a product-facing or platform role.
Familiarity with the JVM ecosystem.
Familiarity with ClickHouse or similar high-performance OLAP platforms.

About ClickHouse

ClickHouse is on a mission to transform how businesses utilize data, with a focus on data processing and analytics. The company builds high-performance data systems and an ecosystem around modern data workflows, including AI/LLM integration.

Tags