Splunk Infrastructure Engineer

Position Overview

Okta seeks a Splunk Infrastructure Engineer to own and evolve its Splunk ecosystem, delivering a comprehensive, scalable observability platform for SRE teams and business partners.

Responsibilities

• Optimize log data collection, processing, and storage for highly reliable, low-latency Splunk services.
• Participate in on-call rotations and lead post-incident reviews to drive systemic improvements and observability-driven development.
• Automate deployment and scaling of observability agents and collectors to eliminate toil.

Required Qualifications

• Minimum 5+ years of experience scaling and managing Splunk Cloud at scale (1,000+ SVCs), including Workload Management (WLM) and HEC optimization.
• Expertise creating intuitive, actionable Splunk dashboards that correlate data across multiple sources.
• A data-driven approach to debugging complex, cross-service performance bottlenecks.
• Ability to access federal environments and/or protected federal data. Upon hire, provide documentation establishing U.S. Person status, such as U.S. Citizen, National, Lawful Permanent Resident, Refugee, or Asylee, under 22 CFR 120.15.
• Attend in-person onboarding at the San Francisco or Chicago office during the first week of employment.

Preferred Qualifications

• Hands-on experience with OpenTelemetry, Vector, or similar application instrumentation frameworks.
• Experience implementing the Splunk charge-back app for usage reporting.
• Experience managing native observability tools in AWS or GCP.

Location and Work Arrangement

• Hybrid role.
• Listed locations: Bellevue, Washington; Chicago, Illinois; New York, New York; San Francisco, California; and Washington, DC.

Compensation and Benefits

• San Francisco Bay Area annual base salary: $194,000–$267,000 USD.
• California outside the San Francisco Bay Area, Colorado, Illinois, New York, and Washington annual base salary: $174,000–$238,000 USD.
• Actual base salary depends on skills, qualifications, experience, and work location.
• Equity where applicable, bonus, health, dental and vision insurance, 401(k), flexible spending account, PTO, and parental leave, subject to applicable plans and policies.

Application Notices

• Reasonable accommodations for applications, interviews, or onboarding may be requested using the employer's accommodation form.
• Okta may use Automated Employment Decision Tools in recruitment and hiring. New York City applicants and employees can consult the employer's NYC AEDT Notice.