Staff Software Engineer, Cloud Monitoring Service (Distributed Systems)

About the Role

Crusoe is seeking a Staff Software Engineer to lead distributed systems design and development within Crusoe Cloud's Cloud Monitoring Service. This team builds the telemetry systems that collect, process, store, and serve the metrics and logs our customers depend on to run AI workloads at scale. You will own the design and evolution of high-throughput, multi-tenant data systems, from collection at the edge through ingestion, storage, and query.

What You'll Be Working On

• Distributed Systems Ownership: Own the architecture and evolution of large-scale telemetry pipelines, including high-volume ingestion, stream processing, time-series and log storage, and low-latency query paths. Design systems that stay correct, available, and cost-efficient as data volume grows 10x.
• Scalable, Multi-Tenant Design: Design services that are highly scalable, durable, and fair across tenants. Address hot shards, high-cardinality data, noisy neighbors, backpressure, retention and compaction at scale, and graceful degradation under load.
• Reliability and Operational Excellence: Build for operability from day one. Improve pipeline reliability and data freshness, reduce on-call burden through better system design, and participate in a customer-facing on-call rotation.
• Technical Leadership: Set the technical direction for the team's distributed systems work. Drive design reviews, identify one-way door decisions early, and raise engineering standards across the team.
• Cross-Team Collaboration: Work with product, compute, networking, and platform teams to ensure observability decisions are made with full context.
• Mentorship: Coach senior and mid-level engineers through design work, code review, and incident response.

What You'll Bring to the Team

• Distributed Systems Depth: Deep, hands-on experience designing and operating distributed systems at scale, solving real problems in sharding, replication, consistency, load balancing, and concurrency.
• Observability Data Experience: Experience building or operating large-scale data infrastructure (time-series databases, log aggregation, streaming pipelines, or distributed tracing backends) and familiarity with technologies such as Prometheus, VictoriaMetrics, Loki, OpenTelemetry, Kafka, Vector, or similar.
• Technical Proficiency: Strong programming fundamentals in Go or another modern compiled language (Go strongly preferred). Comfort with Kubernetes, microservices, and CI/CD.
• Design Judgment at Staff Level: Ability to proactively scope ambiguous problems, address non-functional requirements, and reason about customer and business tradeoffs.
• Operational Mindset: On-call experience on a customer-facing service.
• Cross-Functional Influence: Proven track record of driving technical outcomes that span team boundaries.
• Mentorship: Commitment to mentoring and elevating team members through design guidance and thoughtful code review.
• Professional Experience: 8+ years of software development experience, with sustained ownership of production distributed systems.