Senior Software Engineer, Workload Resilience

About the Role

The Workload Resilience team is focused on improving the availability of MongoDB through solutions in the data plane. We build out the core server workload management infrastructure so that MongoDB can properly queue, load shed, and make decisions to stabilize performance during situations where system resources are beginning to become constrained.

Candidate Profile

• Minimum 5 years of experience in programming, debugging, and performance tuning distributed and/or highly concurrent low-level software systems. Experience in C++ and/or Rust is preferable.
• Strong operational excellence fundamentals, with a focus on refining tools, team processes, and culture to deliver high-quality and reliable software consistently.
• Strong systems fundamentals, including multi-threaded programming and performance profiling.
• Excellent verbal and written technical communication skills and a desire to collaborate with colleagues and mentor junior engineers and interns.
• Experience with distributed system concepts such as fault tolerance, consistency, and availability.
• Experience with writing software to observe and mitigate overload scenarios for highly performant and concurrent systems.

Position Expectations

• Write production-ready database code in C++, Rust, or possibly another low-level language.
• Write unit tests and integration tests in C++, Rust, JavaScript, and Python to demonstrate application correctness.
• Investigate the availability and performance characteristics of the server and write regression tests.
• Implement and continuously improve server workload policies to rate limit, prioritize, and make decisions about incoming and in-progress operations to maximize database availability and performance while the system is overloaded.
• Improve the workload and system observability/diagnostics of the core server.
• Diagnose availability, performance, and correctness test failures, identify bugs and/or deficiencies in existing code, and fix them.
• Interview candidates for software engineering positions.
• Proactively and continuously improve our operational readiness including monitoring and observability, incident management, and rollout processes.
• Collaborate with stakeholders and engineering teams across the company to jointly work on large initiatives.
• Mentor new and junior engineers on the team, participating in helping facilitate technical growth in the team.
• Lead projects through writing scope and technical design documents, and be able to appropriately estimate and plan out execution streams across contributors.

Success Measures

• In the first month: Understand the high level architecture of MongoDB and fix a few bugs.
• In three months: Contribute to the development of a project slated for the next major release of MongoDB; take on code review responsibilities and participate in reviewing design for new features.
• In six months: Lead the development of a new feature and help mentor new engineers on the team.