QuestionQ93

VerifiedPlan and implement data platform resources

You have an Azure Synapse Analytics Apache Spark pool named Pool1.

You plan to load JSON files from an Azure Data Lake Storage Gen2 container into tables in Pool1. The structure and data types differ by file.

You need to load the files into the tables while preserving the source data types.

What should you do?

Explanation

PySpark can read JSON files into DataFrames with inferred schemas, retaining the fields' detected data types, and write those DataFrames to Apache Spark tables. This supports JSON files whose structures and types vary.

Community Discussion

No comments yet. Be the first to start the discussion!