AI Tooling and Infrastructure Engineer

About the role

This hybrid position (average 2 days onsite per week) is within HPE Networking's Training and Documentation organization. You will build and operate infrastructure that integrates large language models (LLMs) into internal tools and customer‑facing products to support technical training and documentation.

Key responsibilities

• Design, build, and operate infrastructure that integrates LLMs into internal tools and customer‑facing products.
• Evaluate, implement, and maintain third‑party AI tooling and platforms, managing vendor relationships.
• Develop homegrown pipelines, orchestration layers, retrieval systems, and monitoring when off‑the‑shelf solutions are insufficient.
• Own operational reliability of AI‑powered systems, including uptime, latency, cost, and observability.
• Implement guardrails for cost, rate limits, prompt/version management, and failure handling.
• Collaborate with documentation and training stakeholders to translate use cases into maintainable systems.
• Set up monitoring, logging, and telemetry to track AI system performance in production.
• Contribute to internal standards and best practices for AI tooling adoption.
• Act as an AI evangelist, sharing knowledge and demonstrating new capabilities.

Required profile

• 5+ years of experience in software engineering, infrastructure, platform, or DevOps/SRE roles.
• Strong scripting/programming ability in Python, Java, or similar languages.
• Experience integrating third‑party APIs into production systems, preferably LLM APIs.
• Hands‑on experience with cloud infrastructure (AWS, GCP, or Azure) and infrastructure‑as‑code practices.
• Proficiency with containers and container tooling.
• Comfort operating in both Linux and Windows server environments.
• Experience building reliable, observable, and cost‑conscious backend services.
• Pragmatic approach to buy‑vs‑build decisions and bias toward rapid iteration.

Required skills

• Python
• Java
• Cloud platforms (AWS, GCP, Azure)
• Infrastructure‑as‑code
• Containers (Docker, Kubernetes)
• Linux and Windows server administration
• API integration (including LLM APIs)
• Monitoring and observability tools

What we offer

• Health and wellbeing benefits for you and your loved ones.
• Personal and professional development programs.
• Inclusive culture that values diverse backgrounds.
• Flexibility to balance work and personal needs.