DP-600: Implementing Analytics Solutions Using Microsoft FabricDemo

HOTSPOT -

You have a Fabric tenant that contains a lakehouse named Lakehouse1. Lakehouse1 contains a table named Nyctaxi_raw. Nyctaxi_row contains the following table:

You create a Fabric notebook and attach it to Lakehouse1.

You need to use PySpark code to transform the data. The solution must meet the following requirements:

• Add a column named pickupDate that contains only the date portion of pickupDateTime.
• Filter the DataFrame to include only rows where fareAmount is positive and less than 100.

How should you complete the code?

df = spark.read.format("delta").load("Tables/nyctaxi_raw")

df2=
Select…("pickupDate", df['tpepPickupDateTime']
Select… \
Select…