Free Databricks Associate-Developer-Apache-Spark-3.5 Exam Dumps Questions & Answers

An engineer has two DataFrames: df1 (small) and df2 (large). A broadcast join is used:
python
CopyEdit
from pyspark.sql.functions import broadcast
result = df2.join(broadcast(df1), on='id', how='inner')
What is the purpose of using broadcast() in this scenario?
Options:

• A.  It increases the partition size for df1 and df2.
• B.  It ensures that the join happens only when the id values are identical.
• C.  It reduces the number of shuffle operations by replicating the smaller DataFrame to all nodes.
• D.  It filters the id values before performing the join.

A data engineer wants to write a Spark job that creates a new managed table. If the table already exists, the job should fail and not modify anything.
Which save mode and method should be used?

• A.  saveAsTable with mode ErrorIfExists
• B.  save with mode Ignore
• C.  saveAsTable with mode Overwrite
• D.  save with mode ErrorIfExists

A Spark engineer must select an appropriate deployment mode for the Spark jobs.
What is the benefit of using cluster mode in Apache Spark™?

• A.  In cluster mode, the driver program runs on one of the worker nodes, allowing the application to fully utilize the distributed resources of the cluster.
• B.  In cluster mode, the driver runs on the client machine, which can limit the application's ability to handle large datasets efficiently.
• C.  In cluster mode, resources are allocated from a resource manager on the cluster, enabling better performance and scalability for large jobs
• D.  In cluster mode, the driver is responsible for executing all tasks locally without distributing them across the worker nodes.

43 of 55.
An organization has been running a Spark application in production and is considering disabling the Spark History Server to reduce resource usage.
What will be the impact of disabling the Spark History Server in production?

• A.  Enhanced executor performance due to reduced log size
• B.  Loss of access to past job logs and reduced debugging capability for completed jobs
• C.  Improved job execution speed due to reduced logging overhead
• D.  Prevention of driver log accumulation during long-running jobs

A Data Analyst needs to retrieve employees with 5 or more years of tenure.
Which code snippet filters and shows the list?

• A.  employees_df.filter(employees_df.tenure >= 5).show()
• B.  employees_df.where(employees_df.tenure >= 5)
• C.  filter(employees_df.tenure >= 5)
• D.  employees_df.filter(employees_df.tenure >= 5).collect()