A data engineer notices that a Spark job performing a join between a large table and a small lookup table is slow. The lookup table is only a few megabytes. Which Spark optimization technique should be applied to improve the performance of the join operation?

• A.Shuffle join
• B.Cartesian join
• C.Sort merge join
• D.Broadcast join

Comment: *

Name: *

Email: *

Verification: *

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.
Which of the following commands could the data engineering team use to access sales in PySpark?

• A.SELECT * FROM sales
• B.There is no way to share data between PySpark and SQL.
• C.spark.sql("sales")
• D.spark.delta.table("sales")
• E.spark.table("sales")

Comment: *

Name: *

Email: *

Verification: *

A data engineer wants to create a relational object by pulling data from two tables. The relational object does not need to be used by other data engineers in other sessions. In order to save on storage costs, the data engineer wants to avoid copying and storing physical data.
Which of the following relational objects should the data engineer create?

• A.Spark SQL Table
• B.View
• C.Database
• D.Temporary view
• E.Delta Table

Comment: *

Name: *

Email: *

Verification: *

Which of the following approaches should be used to send the Databricks Job owner an email in the case that the Job fails?

• A.Setting up an Alert in the Notebook
• B.Setting up an Alert in the Job page
• C.There is no way to notify the Job owner in the case of Job failure
• D.MLflow Model Registry Webhooks
• E.Manually programming in an alert system in each cell of the Notebook

Comment: *

Name: *

Email: *

Verification: *

An engineering manager wants to monitor the performance of a recent project using a Databricks SQL query. For the first week following the project's release, the manager wants the query results to be updated every minute. However, the manager is concerned that the compute resources used for the query will be left running and cost the organization a lot of money beyond the first week of the project's release.
Which of the following approaches can the engineering team use to ensure the query does not cost the organization any money beyond the first week of the project's release?

• A.They can set the query's refresh schedule to end on a certain date in the query scheduler.
• B.They can set the query's refresh schedule to end after a certain number of refreshes.
• C.They can set a limit to the number of individuals that are able to manage the query's refresh schedule.
• D.They can set a limit to the number of DBUs that are consumed by the SQL Endpoint.
• E.They cannot ensure the query does not cost the organization money beyond the first week of the project's release.

Comment: *

Name: *

Email: *

Verification: *