AI Infrastructure Architect📣 Job Ad

About Hyper Lychee Labs and the Role

Hyper Lychee Labs is an IT services and consulting company dedicated to delivering innovative and impactful solutions to a diverse client base, including Fortune 500 companies, the Government of India, and forward-thinking startups. The company focuses on leveraging technology for transformation through custom software development, complex systems implementation, and strategic consulting. We are seeking an AI Infrastructure Architect to join our team in a full-time, on-site capacity in Riyadh, Saudi Arabia.

Role Summary

This role is based on-site in Riyadh, Saudi Arabia, requiring regular presence for stakeholder interaction and design collaboration. The AI Infrastructure Architect will be responsible for designing robust, cost-efficient, and highly performant on-premise AI/ML infrastructure, specifically for managing Large Language Models (LLMs) and GPU resources. This position involves a clear separation of duties, focusing on architectural design, while MLOps/LLMOps Engineers handle operationalization.

Key Responsibilities

• Design on-premise architecture for managing LLMs and GPU infrastructure, optimizing for minimum cost and maximum efficiency.
• Produce High-Level Designs (HLDs) and Low-Level Designs (LLDs) for various AI/agentic use cases.
• Determine appropriate LLM(s) for specific use cases and define suitable approaches per scenario.
• Define GPU parallelization strategies, including how models and workloads are distributed across available GPU resources.
• Design agent orchestration patterns for coordinating and communicating multiple AI agents within client infrastructure.
• Collaborate closely with MLOps/LLMOps Engineers responsible for operationalizing the designed architectures.

Required Qualifications and Experience

Candidates should possess 5-10 years of relevant experience and demonstrate the following essential qualifications:

• Proven experience in architecting on-premise AI/ML infrastructure, specifically not cloud-based at this stage.
• Strong understanding of GPU infrastructure, including parallelization techniques for LLM workloads.
• Experience designing agent orchestration approaches for multi-agent generative AI systems.
• Ability to produce clear High-Level Design (HLD) and Low-Level Design (LLD) documentation for operational teams.
• Comfort working in highly regulated, on-premise-first environments, as no cloud infrastructure is currently in use for this engagement.

Preferred Attributes

The following qualifications are considered advantageous:

• Prior architecture experience within the banking or financial services sector.
• Familiarity with regulatory and compliance constraints affecting infrastructure design in BFSI environments.
• Experience advising on cloud-migration-readiness architecture, anticipating future migration once regulatory approval is granted.

Work Setting

This is a full-time, on-site position based in Riyadh, Saudi Arabia. Hyper Lychee Labs fosters a culture of creativity, diversity, and inclusion, empowering businesses to thrive in a rapidly evolving technological landscape. Salary for this position will be discussed during the interview process.