A data analyst has developed a query that runs against Delta table. They want help from the data engineering team to implement a series of tests to ensure the data returned by the query is clean. However, the data engineering team uses Python for its tests rather than SQL.
Which of the following operations could the data engineering team use to run the query and operate with the results in PySpark?

• A.SELECT * FROM sales
• B.spark.delta.table
• C.spark.sql
• D.There is no way to share data between PySpark and SQL.
• E.spark.table

Comment: *

Name: *

Email: *

Verification: *

A dataset has been defined using Delta Live Tables and includes an expectations clause:
CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION DROP ROW What is the expected behavior when a batch of data containing data that violates these constraints is processed?

• A.Records that violate the expectation are dropped from the target dataset and loaded into a quarantine table.
• B.Records that violate the expectation are added to the target dataset and flagged as invalid in a field added to the target dataset.
• C.Records that violate the expectation are dropped from the target dataset and recorded as invalid in the event log.
• D.Records that violate the expectation are added to the target dataset and recorded as invalid in the event log.
• E.Records that violate the expectation cause the job to fail.

Comment: *

Name: *

Email: *

Verification: *

A data engineer has developed a data pipeline to ingest data from a JSON source using Auto Loader, but the engineer has not provided any type inference or schema hints in their pipeline. Upon reviewing the data, the data engineer has noticed that all of the columns in the target table are of the string type despite some of the fields only including float or boolean values.
Which of the following describes why Auto Loader inferred all of the columns to be of the string type?

• A.Auto Loader cannot infer the schema of ingested data
• B.There was a type mismatch between the specific schema and the inferred schema
• C.Auto Loader only works with string data
• D.JSON data is a text-based format
• E.All of the fields had at least one null value

Comment: *

Name: *

Email: *

Verification: *

A data engineer has configured a Structured Streaming job to read from a table, manipulate the data, and then perform a streaming write into a new table.
The code block used by the data engineer is below:

If the data engineer only wants the query to process all of the available data in as many batches as required, which of the following lines of code should the data engineer use to fill in the blank?

• A.processingTime(1)
• B.trigger(availableNow=True)
• C.trigger(parallelBatch=True)
• D.trigger(processingTime="once")
• E.trigger(continuous="once")

Comment: *

Name: *

Email: *

Verification: *

What is stored in a Databricks customer's cloud account?

• A.Data
• B.Cluster management metadata
• C.Databricks web application
• D.Notebooks

Comment: *

Name: *

Email: *

Verification: *