Which statement describes a key benefit of an end-to-end test?

• A.It closely simulates real world usage of your application.
• B.It pinpoint errors in the building blocks of your application.
• C.It provides testing coverage for all code paths and branches.
• D.It makes it easier to automate your test suite

Comment: *

Name: *

Email: *

Verification: *

A member of the data engineering team has submitted a short notebook that they wish to schedule as part of a larger data pipeline. Assume that the commands provided below produce the logically correct results when run as presented.

Which command should be removed from the notebook before scheduling it as a job?

• A.Cmd 2
• B.Cmd 3
• C.Cmd 4
• D.Cmd 5
• E.Cmd 6

Comment: *

Name: *

Email: *

Verification: *

While reviewing a query's execution in the Databricks Query Profiler, a data engineer observes that the Top Operators panel shows a Sort operator with high Time Spent and Memory Peak metrics. The Spark UI also reports frequent data spilling. How should the data engineer address this issue?

• A.Switch to a broadcast join to reduce memory usage.
• B.Repartition the DataFrame to a single partition before sorting.
• C.Convert the sort operation to a filter operation.
• D.Increase the number of shuffle partitions to better distribute data.

Comment: *

Name: *

Email: *

Verification: *

A user wants to use DLT expectations to validate that a derived table report contains all records from the source, included in the table validation_copy.
The user attempts and fails to accomplish this by adding an expectation to the report table definition.

Which approach would allow using DLT expectations to validate all expected records are present in this table?

• A.Define a SQL UDF that performs a left outer join on two tables, and check if this returns null values for report key values in a DLT expectation for the report table.
• B.Define a function that performs a left outer join on validation_copy and report and report, and check against the result in a DLT expectation for the report table
• C.Define a temporary table that perform a left outer join on validation_copy and report, and define an expectation that no report key values are null
• D.Define a view that performs a left outer join on validation_copy and report, and reference this view in DLT expectations for the report table

Comment: *

Name: *

Email: *

Verification: *

The data engineer team is configuring environment for development testing, and production before beginning migration on a new data pipeline. The team requires extensive testing on both the code and data resulting from code execution, and the team want to develop and test against similar production data as possible.
A junior data engineer suggests that production data can be mounted to the development testing environments, allowing pre production code to execute against production data. Because all users have Admin privileges in the development environment, the junior data engineer has offered to configure permissions and mount this data for the team.
Which statement captures best practices for this situation?

• A.Because access to production data will always be verified using passthrough credentials it is safe to mount data to any Databricks development environment.
• B.All developer, testing and production code and data should exist in a single unified workspace; creating separate environments for testing and development further reduces risks.
• C.In environments where interactive code will be executed, production data should only be accessible with read permissions; creating isolated databases for each environment further reduces risks.
• D.Because delta Lake versions all data and supports time travel, it is not possible for user error or malicious actors to permanently delete production data, as such it is generally safe to mount production data anywhere.

Comment: *

Name: *

Email: *

Verification: *