A data engineer needs to apply custom logic to identify employees with more than 5 years of experience in array column employees in table stores. The custom logic should create a new column exp_employees that is an array of all of the employees with more than 5 years of experience for each row. In order to apply this custom logic at scale, the data engineer wants to use the FILTER higher-order function.
Which of the following code blocks successfully completes this task?

• A.
• B.
• C.
• D.
• E.

Comment: *

Name: *

Email: *

Verification: *

Which of the following benefits is provided by the array functions from Spark SQL?

• A.An ability to work with data in a variety of types at once
• B.An ability to work with data within certain partitions and windows
• C.An ability to work with time-related data in specified intervals
• D.An ability to work with complex, nested data ingested from JSON files
• E.An ability to work with an array of tables for procedural automation

Comment: *

Name: *

Email: *

Verification: *

A data engineering team has two tables. The first table march_transactions is a collection of all retail transactions in the month of March. The second table april_transactions is a collection of all retail transactions in the month of April. There are no duplicate records between the tables.
Which of the following commands should be run to create a new table all_transactions that contains all records from march_transactions and april_transactions without duplicate records?

• A.CREATE TABLE all_transactions AS
  SELECT * FROM march_transactions
  INNER JOIN SELECT * FROM april_transactions;
• B.CREATE TABLE all_transactions AS
  SELECT * FROM march_transactions
  UNION SELECT * FROM april_transactions;
• C.CREATE TABLE all_transactions AS
  SELECT * FROM march_transactions
  OUTER JOIN SELECT * FROM april_transactions;
• D.CREATE TABLE all_transactions AS
  SELECT * FROM march_transactions
  INTERSECT SELECT * from april_transactions;
• E.CREATE TABLE all_transactions AS
  SELECT * FROM march_transactions
  MERGE SELECT * FROM april_transactions;

Comment: *

Name: *

Email: *

Verification: *

Which of the following is a benefit of the Databricks Lakehouse Platform embracing open source technologies?

• A.Cloud-specific integrations
• B.Simplified governance
• C.Ability to scale storage
• D.Ability to scale workloads
• E.Avoiding vendor lock-in

Comment: *

Name: *

Email: *

Verification: *

A data engineer has configured a Structured Streaming job to read from a table, manipulate the data, and then perform a streaming write into a new table.
The cade block used by the data engineer is below:

If the data engineer only wants the query to execute a micro-batch to process data every 5 seconds, which of the following lines of code should the data engineer use to fill in the blank?

• A.trigger("5 seconds")
• B.trigger()
• C.trigger(once="5 seconds")
• D.trigger(processingTime="5 seconds")
• E.trigger(continuous="5 seconds")

Comment: *

Name: *

Email: *

Verification: *