QuestionQ55

Implement text analysis solutions

You have a multimodal generative AI model that accepts image uploads and uses extracted image text to generate responses.

You discover that users can upload unsafe images and embed hidden instructions within images to manipulate the model.

You need to implement controls to mitigate this risk.

Proposed solution: Configure protected material detection.

Does this solution meet the goal?

  • A Yes
  • B No
Explanation

Protected material detection scans AI-generated output for known copyrighted or licensed third-party content, such as song lyrics, articles, or public source code, so the output does not reproduce it verbatim. It has no role in screening uploaded images for unsafe content and no role in detecting instructions hidden inside image text, so it does not address either part of the stated risk.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!