QuestionQ20

VerifiedDeveloping custom agents

You are building an automated medical research assistant agent in Gemini Enterprise to analyze patient records for rare diseases. Ingestion includes high-resolution radiology scans and unstructured handwritten clinical notes stored in Cloud Storage. The agent must correlate fine visual tissue abnormalities in the radiology scans with contextual annotations in physician notes.

You need to configure the data ingestion and modeling pipeline to maximize diagnostic correlation without losing spatial or visual details.

What should you do?

Explanation

Native multimodal input can bring images and notes together for analysis without first downsampling the scans or reducing them to text or classification embeddings. Cloud Storage file references are supported, and higher media-resolution settings can improve perception of fine image details. However, file references do not guarantee that every detail is preserved: images are tokenized, and Google states that Gemini models are not suitable for interpreting medical images or providing medical advice. (docs.cloud.google.com)

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!