QuestionQ17

VerifiedIngest and transform data

You have a Fabric workspace that includes a lakehouse named Lakehouse1.

An external data source contains data files that are 500 GB each. One new file is added every day.

You need to ingest the data into Lakehouse1 without applying transformations. The solution must meet these requirements:

  • Trigger the process when a new file is added.
  • Provide the highest throughput.

Which type of item should you use to ingest the data?

Explanation

A Fabric notebook runs Apache Spark jobs, which can ingest large files through distributed processing and write them to a lakehouse without transformation. Fabric events can be consumed by Activator to trigger a notebook when a file is created. Eventstream is designed for real-time event ingestion and routing, whereas Reflex triggers actions and does not itself perform bulk file ingestion.

Learn more

Community Discussion

No comments yet. Be the first to start the discussion!