What mechanism does Apache Airflow provide to delay the execution of a task until a certain condition is met?
A The delay parameter in task definitions.

• A.The wait_for_downstream setting in the DAG configuration.
• B.Sensors, which are special operators that wait for a certain condition to be true.
• C.The execution_timeout attribute, which can be set to postpone task execution.

Comment: *

Name: *

Email: *

Verification: *

Your Airflow DAG involves tasks that require access to confidential data like passwords or API keys. How can you securely manage and access these credentials within the DAG?

• A.Store the credentials directly within the DAG code, assuming limited access to the codebase.
• B.Utilize environment variables to store the credentials and access them within the tasks.
• C.Implement a custom secret management solution outside of Airflow.
• D.All of the above

Comment: *

Name: *

Email: *

Verification: *

For a dataset that is used multiple times in different transformations but is not large enough to warrant disk storage, which caching level in Apache Spark is most appropriate?

• A.MEMORY ONLY
• B.DISK ONLY
• C.MEMORY AND DISK SER
• D.MEMORY ONLY SER

Comment: *

Name: *

Email: *

Verification: *

Which Spark component is responsible for managing the execution of tasks on worker nodes?

• A.Spark Driver
• B.Spark Executor
• C.spark SQL
• D.Spark Core

Comment: *

Name: *

Email: *

Verification: *

How can you dynamically generate tasks in Apache Airflow?

• A.By using the Jinja templating engine
• B.By defining a Python function inside the DAG file
• C.By using the Variable feature to store dynamic configurations
• D.By using Python loops to create tasks during DAG parsing

Comment: *

Name: *

Email: *

Verification: *