Employer listing
Staff Software Engineer, Backend Platform
Harvey
San Francisco, Ca · hybrid · full time · Staff
$231,000 - $340,000
Role Overview
As a Backend Platform Engineer at Harvey, you will help build and operate the cohesive backend platform that all our services run on. You’ll design and implement shared frameworks and libraries that abstract common concerns, improve developer experience, and raise the baseline for reliability and performance across all teams.
Your mission aligns with our platform charter: create “a shared foundation that enables product teams to ship reliable, observable, and performant experiences quickly and safely.” Centralizing common work allows product engineers to focus on shipping features rather than re-inventing the wheel.
What You'll Do
- Develop and maintain Harvey’s internal backend frameworks and libraries that provide common capabilities (API routing, service lifecycle management, caching and messaging primitives, error handling interfaces, etc.).
- Create and improve APIs, service templates, and versioned interfaces that establish consistent patterns for building new services and features.
- Introduce and champion modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing, evolving the platform for performance and scalability.
- Design Harvey-specific abstractions and domain-specific frameworks covering cross-cutting concerns (e.g., authorization, streaming, data governance, event processing).
- Embed reliability and observability into the platform by building in tracing, metrics, and automated tests (shift-left).
- Collaborate with the Model Infrastructure team to tackle challenges unique to GenAI-native applications (high-throughput model inference, streaming/long-running APIs, retrieval context handling, and prompt lifecycle).
- Collaborate with Developer Experience and Infrastructure teams to integrate platform components into deployment and monitoring ecosystems.
- Partner closely with product engineering teams to gather feedback, evangelize best practices, and provide strong defaults and documentation.
What You Have
- 8+ years of software engineering experience (post-BS/MS), including building scalable backend systems or internal developer platforms.
- Proficiency in Python (or similar languages) and deep knowledge of backend development fundamentals (APIs, data stores, concurrency, distributed systems).
- Hands-on experience with web frameworks and service architectures (e.g., Flask/FastAPI, bounded context services, microservices) and designing clean, versioned APIs.
- Familiarity with caching, messaging, and database technologies (Redis, Kafka, SQL/NoSQL databases, Vector databases) for high performance and reliability.
- Track record of writing high-quality, well-tested code using unit/integration testing, static typing, and CI.
- Strong problem-solving skills and passion for improving developer experience.
- Excellent collaboration and communication skills.
- Experience contributing to or maintaining internal libraries/frameworks is a plus.
Benefits
Offers equity and bonus compensation.