Employer listing
Principal AI Architect
Rubrik
Palo Alto, Ca · on site · full time · Principal
$254,300 - $356,300
About the Role
At Rubrik IT, we are transforming how the enterprise thinks and operates — building a "thinking enterprise" where intelligent, agentic systems reason across our data, tools, and workflows to drive speed, quality, and measurable business impact. As an AI Architect, you will be a pivotal technical leader driving AI Native solutions that make this vision real.
You will operate where AI innovation, top-tier engineering, and business outcomes converge, acting as the technical bridge between complex business problems and cutting-edge AI execution. Leveraging our robust Enterprise AI Platform, you will translate ambiguous problems into concrete AI solution designs and ensure their successful deployment and measurable impact.
What You'll Do
- Lead applied AI solution design and architecture, breaking down ambiguous business problems into concrete, actionable AI solution designs.
- Contribute to the detailed design of large-scale, distributed AI/ML systems, ensuring performance, reliability, and security.
- Design and improve retrieval, prompting, tool-calling, and orchestration patterns for internal use cases such as knowledge assistants, workflow automation, and decision support.
- Champion and enforce design standards, patterns, and best practices for scalable and secure development of AI applications across teams.
- Drive the hands-on development and implementation of key AI components, supporting both traditional and Generative AI model development and deployment.
- Build and deploy AI-enabled internal workflows that connect enterprise systems, data sources, model APIs, and automation layers.
- Leverage AI-assisted development to accelerate implementation, bringing a strong 'editor' mindset to ruthlessly audit, review, and secure AI-generated code against our standards for reliability, security, observability, and documentation.
- Lead the implementation and continuous improvement of MLOps pipelines, including automated model training, versioning, deployment, and monitoring.
- Develop and maintain evaluation approaches for output quality, retrieval accuracy, latency, and failure modes, and use findings to improve system performance over time.
- Help identify where human review, controls, and escalation paths are required to support responsible deployment of AI-enabled systems.
- Apply sound engineering judgment to balance speed, usability, risk, and maintainability in production and near-production environments.
- Proactively collaborate with executive leadership, data science, engineering, and product stakeholders to translate business use-cases into scalable AI solutions.
- Lead rigorous problem formulation by partnering with R&D, Security, Data, HR, Finance, and business stakeholders.
- Provide technical leadership and mentorship to other AI/ML engineers, fostering a culture of engineering excellence and hands-on experimentation.
- Contribute reusable components, playbooks, and patterns that reduce duplicate effort and improve speed across the engineering environment.
- Connect technical architecture and AI implementations directly to measurable business outcomes.
- Actively research and evaluate cutting-edge AI/ML techniques, algorithms, and models to identify opportunities for platform enhancement and new solution development.
Experience You'll Need
- 10+ years of core Software/Systems Engineering architecture experience, including 4+ years dedicated to building and deploying applied AI/ML systems in production.
- Bachelor’s degree in Computer Science, Engineering, or a related field (Master’s/Ph.D. is a plus).
- Direct hands-on experience with Generative AI technologies, including LLMs, Retrieval-Augmented Generation (RAG), context graphs, memory management, and agentic AI architectures.
- Strong programming skills in Python, Java, or Go. Deep proficiency with GenAI orchestration frameworks (e.g., LangGraph, LlamaIndex, AutoGen, Semantic Kernel) and a working knowledge of traditional ML frameworks (e.g., PyTorch, TensorFlow).
- Extensive hands-on experience with the modern AI data ecosystem, including Vector Databases (e.g., Pinecone, Weaviate) and Graph Databases (e.g., Neo4j).
- Experience with distributed systems architecture, event-driven streaming platforms, and cloud AI/ML platforms (e.g., GCP Vertex AI, AWS SageMaker, Azure OpenAI).
- Strong ability to work across data, model, application, and infrastructure layers, operating effectively with incomplete information and ambiguous problems.
- Experience integrating applications, data sources, or internal platforms through APIs, services, event-driven patterns, or workflow tools.
- Deep understanding of security principles as they apply to AI systems (e.g., prompt injection, data exfiltration, RBAC). Experience in enterprise-scale environments with meaningful privacy or compliance constraints.
- Experience with telemetry, tracing, and production monitoring for AI systems (e.g., LangSmith, Phoenix, Datadog).
- Experience contributing to open-source AI projects, publications, or active participation in the AI engineering community.
- Evidence of applied AI building — GitHub contributions, technical writing, demos, or open-source work demonstrating curiosity for emerging AI tooling.
- Prior experience in solutions architecture, successfully bridging technical teams and senior business stakeholders.
Benefits
Eligible for equity and comprehensive benefits in addition to base salary.