ClickHouse Operations Engineer

About PostHog

PostHog is your product’s context layer. It ingests and stores your analytics, errors, replays, and business data so you and your agents can query and act on it.

What You'll Be Doing

ClickHouse is the core piece of infrastructure at PostHog. Every product and customer relies on it to ingest, store, and query data.

We need someone to automate, manage, and maintain ClickHouse as we grow towards capturing trillions of events per year and having one of the world’s largest clusters.

• ClickHouse operations and scaling infrastructure, as well as node and instance-level performance optimization.
• Ensure the right hardware is deployed at the right time for each workload on ClickHouse.
• Build systems and automations for the provisioning and scaling of large ClickHouse clusters, handling over 100 PB of data.
• Investigate and experiment using the latest hardware from cloud providers to find the optimal setup (with dedicated budget).
• Use Terraform, Ansible, and Kubernetes to automate dynamic provisioning of instances.
• Work on cutting-edge ClickHouse implementations, such as open format backed tables, and query performance tooling/query optimization.

Qualifications

• OLAP Database Experience: Deep experience with ClickHouse or other OLAP databases, specifically understanding internals rather than just high-level usage.
• Automated Dynamic Provisioning: Strong experience utilizing Terraform, Ansible, and Kubernetes.
• Scale and Complexity: Experience operating and building high-scale, complex data storage solutions.
• Tech Stack: Experience with Python, Terraform, Ansible, Kubernetes, AWS, and ZooKeeper (or alternatives).