QuestionQ1

Design HPE solutions with a focus on AI and HPC workloads

A customer has developed a custom NIM and stores it in their NGC Private Registry. The customer wants to use that NIM in inferencing workloads running on HPE Private Cloud AI.

What should you recommend?

  • A Finding and importing NVIDIA AI blueprint that supports the custom NIM
  • B Using MLIS with an NGC registry that points to the customer’s private registry
  • C Using Ray Serve with custom-built deployments based on the custom NIM image
  • D Downloading the custom NIM to individual users’ models-pvc and manually creating KServe endpoints to deploy the NIM
Explanation

HPE MLIS can deploy NIM packaged models through an NGC registry. For organization-published customized NIMs, the NGC registry configuration uses the organization’s name, allowing MLIS to discover and deploy the NIMs available in that private registry.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!