Question 1
A customer has developed a custom NIM and stores it in their NGC Private Registry. The customer wants to use that NIM in inferencing workloads running on HPE Private Cloud AI.
What should you recommend?
HPE Machine Learning Inferencing Software (MLIS) provides native integration with NVIDIA NGC registries, allowing organizations to deploy privately published NVIDIA Inference Microservices (NIMs) within HPE Private Cloud AI.
The recommended architecture uses an MLIS registry configured with the customer's NVIDIA NGC credentials, organization name, and optional team name. HPE documentation specifies that organizations publishing customized NIMs should use their own organization identifier rather than the default NVIDIA NIM organization.
After configuring the registry, administrators can register the custom NIM as a packaged model and create an inference deployment. MLIS manages deployment parameters, including the runtime image, GPU allocation, resource requirements, and inference endpoint configuration.
Option A is inappropriate because NVIDIA AI Blueprints provide application-level reference implementations rather than the underlying registry integration required here.
Option C introduces additional Ray Serve deployment complexity despite MLIS providing the necessary functionality.
Option D requires unnecessary model distribution and manual KServe configuration, bypassing centralized model management.
Using MLIS with the customer's private NGC registry maintains a consistent inference deployment process and enables the organization to manage custom NIMs through the existing HPE Private Cloud AI platform.
Official HPE Reference: HPE AI Essentials Software --- NGC Registry Setup, Add Registry, and Add Packaged Model.
support.hpe.com