A data engineer has a Python notebook in Databricks, but they need to use SQL to accomplish a specific task within a cell. They still want all of the other cells to use Python without making any changes to those cells.
Which of the following describes how the data engineer can use SQL within a cell of their Python notebook?

• A.It is not possible to use SQL in a Python notebook
• B.They can attach the cell to a SQL endpoint rather than a Databricks cluster
• C.They can simply write SQL syntax in the cell
• D.They can add %sql to the first line of the cell
• E.They can change the default language of the notebook to SQL

Comment: *

Name: *

Email: *

Verification: *

A data engineer is designing a data pipeline. The source system generates files in a shared directory that is also used by other processes. As a result, the files should be kept as is and will accumulate in the directory. The data engineer needs to identify which files are new since the previous run in the pipeline, and set up the pipeline to only ingest those new files with each run.
Which of the following tools can the data engineer use to solve this problem?

• A.Unity Catalog
• B.Delta Lake
• C.Databricks SQL
• D.Data Explorer
• E.Auto Loader

Comment: *

Name: *

Email: *

Verification: *

A data engineer wants to schedule their Databricks SQL dashboard to refresh every hour, but they only want the associated SQL endpoint to be running when It is necessary. The dashboard has multiple queries on multiple datasets associated with it. The data that feeds the dashboard is automatically processed using a Databricks Job.
Which approach can the data engineer use to minimize the total running time of the SQL endpoint used in the refresh schedule of their dashboard?

• A.O They can reduce the cluster size of the SQL endpoint.
• B.Q They can turn on the Auto Stop feature for the SQL endpoint.
• C.O They can set up the dashboard's SQL endpoint to be serverless.
• D.0 They can ensure the dashboard's SQL endpoint matches each of the queries' SQL endpoints.

Comment: *

Name: *

Email: *

Verification: *

In order for Structured Streaming to reliably track the exact progress of the processing so that it can handle any kind of failure by restarting and/or reprocessing, which of the following two approaches is used by Spark to record the offset range of the data being processed in each trigger?

• A.Checkpointing and Idempotent Sinks
• B.Write-ahead Logs and Idempotent Sinks
• C.Checkpointing and Write-ahead Logs
• D.Replayable Sources and Idempotent Sinks
• E.Structured Streaming cannot record the offset range of the data being processed in each trigger.

Comment: *

Name: *

Email: *

Verification: *

A data engineer has left the organization. The data team needs to transfer ownership of the data engineer's Delta tables to a new data engineer. The new data engineer is the lead engineer on the data team.
Assuming the original data engineer no longer has access, which of the following individuals must be the one to transfer ownership of the Delta tables in Data Explorer?

• A.Databricks account representative
• B.This transfer is not possible
• C.Workspace administrator
• D.New lead data engineer
• E.Original data engineer

Comment: *

Name: *

Email: *

Verification: *