QuestionQ44

Automating and orchestrating ML pipelines

You have a custom job that runs weekly on Vertex AI. The job uses a proprietary ML workflow that generates the datasets, models, and custom artifacts, then sends them to a Cloud Storage bucket. Many different versions of the datasets and models have been produced. Because of compliance requirements, your company must track which model was used to make a particular prediction and must be able to access the artifacts for every model. How should you configure your workflows to satisfy these requirements?

Explanation

Vertex AI Metadata provides managed lineage tracking for custom workflows. Model and dataset files can be recorded as artifacts, workflow or prediction activity as executions, and related resources grouped in contexts. Events connect artifacts to executions as inputs or outputs, allowing the exact model used for a prediction and its associated artifacts to be traced and retrieved.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!