QuestionQ213

Data Ingestion and Transformation

A company is building near-real-time dashboards to visualize time-series data. The company ingests data into Amazon Managed Streaming for Apache Kafka (Amazon MSK). A customized data pipeline consumes the data, then writes it to Amazon Keyspaces (for Apache Cassandra), Amazon OpenSearch Service, and Apache Avro objects in Amazon S3.

Which solution will make the data available to the visualizations with the LEAST latency?

  • A Create OpenSearch Dashboards by using the data from OpenSearch Service.
  • B Use Amazon Athena with an Apache Hive metastore to query the Avro objects in Amazon S3. Use Amazon Managed Grafana to connect to Athena and to create the dashboards.
  • C Use Amazon Athena to query the data from the Avro objects in Amazon S3. Configure Amazon Keyspaces as the data catalog. Connect Amazon QuickSight to Athena to create the dashboards.
  • D Use AWS Glue to catalog the data. Use S3 Select to query the Avro objects in Amazon S3. Connect Amazon QuickSight to the S3 bucket to create the dashboards.
Explanation

OpenSearch Dashboards directly visualizes data indexed in Amazon OpenSearch Service and can refresh panels as new data arrives. Because the pipeline already writes the streaming data to OpenSearch Service, this avoids querying Avro files in Amazon S3 through Athena and the additional catalog and visualization integrations required by the other approaches.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!