You are working on a marketing team request to identify customers with the same information between two tables CUSTOMERS_2021 and CUSTOMERS_2020 each table contains 25 columns with the same schema, You are looking to identify rows that match between two tables across all columns, which of the following can be used to perform in SQL

• A.1.SELECT * FROM CUSTOMERS_2021
  2. UNION
  3.SELECT * FROM CUSTOMERS_2020
• B.1.SELECT * FROM CUSTOMERS_2021
  2. UNION ALL
  3.SELECT * FROM CUSTOMERS_2020
• C.1.SELECT * FROM CUSTOMERS_2021 C1
  2.INNER JOIN CUSTOMERS_2020 C2
  3.ON C1.CUSTOMER_ID = C2.CUSTOMER_ID
• D.1.SELECT * FROM CUSTOMERS_2021
  2. INTERSECT
  3.SELECT * FROM CUSTOMERS_2020
• E.1.SELECT * FROM CUSTOMERS_2021
  2.EXCEPT
  3.SELECT * FROM CUSTOMERS_2020

Comment: *

Name: *

Email: *

Verification: *

The data engineering team maintains the following code:

Assuming that this code produces logically correct results and the data in the source tables has been de-duplicated and validated, which statement describes what will occur when this code is executed?

• A.A batch job will update the enriched_itemized_orders_by_account table, replacing only those rows that have different values than the current version of the table, using accountID as the primary key.
• B.The enriched_itemized_orders_by_account table will be overwritten using the current valid version of data in each of the three tables referenced in the join logic.
• C.An incremental job will leverage information in the state store to identify unjoined rows in the source tables and write these rows to the enriched_iteinized_orders_by_account table.
• D.An incremental job will detect if new rows have been written to any of the source tables; if new rows are detected, all results will be recalculated and used to overwrite the enriched_itemized_orders_by_account table.
• E.No computation will occur until enriched_itemized_orders_by_account is queried; upon query materialization, results will be calculated using the current valid version of data in each of the three tables referenced in the join logic.

Comment: *

Name: *

Email: *

Verification: *

Incorporating unit tests into a PySpark application requires upfront attention to the design of your jobs, or a potentially significant refactoring of existing code.
Which statement describes a main benefit that offset this additional effort?

• A.Improves the quality of your data
• B.Validates a complete use case of your application
• C.Yields faster deployment and execution times
• D.Troubleshooting is easier since all steps are isolated and tested individually
• E.Ensures that all steps interact correctly to achieve the desired end result

Comment: *

Name: *

Email: *

Verification: *

Which of the following locations in the Databricks product architecture hosts the notebooks and jobs?

• A.Data plane
• B.Control plane
• C.Databricks Filesystem
• D.JDBC data source
• E.Databricks web application

Correct Answer: B

Explanation
The answer is Control Pane,
Databricks operates most of its services out of a control plane and a data plane, please note serverless features like SQL Endpoint and DLT compute use shared compute in Control pane.
Control Plane: Stored in Databricks Cloud Account
*The control plane includes the backend services that Databricks manages in its own Azure account. Notebook commands and many other workspace configurations are stored in the control plane and encrypted at rest.
Data Plane: Stored in Customer Cloud Account
*The data plane is managed by your Azure account and is where your data resides. This is also where data is processed. You can use Azure Databricks connectors so that your clusters can connect to external data sources outside of your Azure account to ingest data or for storage.
Timeline Description automatically generated

Comment: *

Name: *

Email: *

Verification: *

What is the purpose of a silver layer in Multi hop architecture?

• A.Replaces a traditional data lake
• B.Efficient storage and querying of full and unprocessed history of data
• C.A schema is enforced, with data quality checks.
• D.Refined views with aggregated data
• E.Optimized query performance for business-critical data

Correct Answer: C

Explanation
The answer is, A schema is enforced, with data quality checks.
Medallion Architecture - Databricks
Silver Layer:
1.Reduces data storage complexity, latency, and redundency
2.Optimizes ETL throughput and analytic query performance
3.Preserves grain of original data (without aggregation)
4.Eliminates duplicate records
5.production schema enforced
6.Data quality checks, quarantine corrupt data
Exam focus: Please review the below image and understand the role of each layer(bronze, silver, gold) in medallion architecture, you will see varying questions targeting each layer and its purpose.
Sorry I had to add the watermark some people in Udemy are copying my content.

Comment: *

Name: *

Email: *

Verification: *