QuestionQ21

Demonstrate AISolutions

You are demonstrating HPE Private Cloud AI and HPE Machine Learning Inference Software to a customer. The customer says the organization has a custom model stored in an OpenLLM hub that it would like to deploy using HPE Machine Learning Inference Software.

What should you explain?

  • A HPE Machine Learning Inference Software supports pulling this model from the hub and deploying it.
  • B While HPE Machine Learning Inference Software does not support deploying custom models, Ray Serve, also provided by HPE Private Cloud AI, does.
  • C While HPE Machine Learning Inference Software does not support deploying custom models, KServe, also provided by HPE Private Cloud AI, does.
  • D HPE Machine Learning Inference Software can deploy this model if the customer packages it with Bento Archive and saves it to a PVC in HPE Private Cloud AI.
Explanation

HPE Machine Learning Inferencing Software supports an OpenLLM registry that provides direct access to OpenLLM-compatible models in the Hugging Face model hub. It can pull those models into the platform and deploy them as inference services.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!