Principal Engineer – Generative AI & LLM Platforms

About the role

Hewlett Packard Enterprise is seeking a Principal Engineer to lead the design and delivery of production‑grade Generative AI and large language model (LLM) platforms. The role is hybrid, requiring an average of two days per week on‑site at an HPE office.

Key responsibilities

• Define technical strategy, multi‑year product road‑maps and evaluate emerging technologies for customer‑focused innovation.
• Architect scalable, low‑latency, multi‑tenant distributed systems for LLM inference, prompt engineering, fine‑tuning and model customization.
• Lead observability, SLOs, incident response, capacity planning and cost management for AI services.
• Provide technical leadership, mentorship and cross‑team influence across multiple product areas.

Required profile

• Advanced degree in Computer Science, Machine Learning, AI or related field.
• 15+ years of industry experience with proven technical leadership at Staff/Principal/Architect level.
• Demonstrated ability to mentor engineers, build technical communities and drive innovation in ambiguous environments.

Required skills

• Strong hands‑on proficiency in Python and Golang.
• Deep knowledge of transformer‑based LLMs, tokenization, embeddings, prompt engineering and model evaluation.
• Experience building production‑grade Generative AI systems, including RAG, agents, tool‑calling workflows and safety mechanisms.
• Hands‑on experience with AWS services (compute, storage, IAM, monitoring, automation) and cloud‑native architecture (Kubernetes, infrastructure‑as‑code).
• Expertise in networking (routing, switching, VPC design, hybrid‑cloud connectivity) and distributed systems design.

What we offer

• Comprehensive health and wellbeing benefits for employees and families.
• Personal and professional development programs to support career growth.
• Inclusive culture that values diverse backgrounds and flexible work arrangements.