NCA-AIIO: AI Infrastructure and OperationsDemo

Question

Which architecture—training or inference—requires greater data storage?

A Training and inference architecture require the same amount of data storage.
B Training architecture requires more data storage.
C Inference architecture requires more data storage.

Explanation

Training architecture requires more data storage because it must retain training data and additional learning-state information such as gradients, optimizer state, intermediate values, and often model checkpoints. Inference primarily stores and uses the trained model and its input/output data.

NCA-AIIO: AI Infrastructure and OperationsDemo

AstroTutor

Notes

Readiness

QuestionQ82

Community Discussion