About Spark SQL&Hive difference and connection, which of the following statements is correct?

• A.Spark SQL relies on Hive metadata
• B.Spark SQL cannot use Hive's custom functions
• C.Spark SQL is compatible with most Hive syntax and functions
• D.The execution engine of Spark SQL is Spark core, HiveThe default execution engine is MapReduce

Comment: *

Name: *

Email: *

Verification: *

The overall process of Kafka Producer reading data is that the Producer connects to any surviving Broker, requests the leader metadata information of the specified topic and partition, and then directly connects to the corresponding Broker to publish the data.

• A.True
• B.False

Comment: *

Name: *

Email: *

Verification: *

In the Spark SQL table, there are often many small files (the size is much smaller than the HDFS block size). In this case, Spark will start more tasks to process these small files. When there is a Shuffle operation in the SQL logic, it will greatly increase the number of hash buckets, which seriously affects performance.

• A.False
• B.True

Comment: *

Name: *

Email: *

Verification: *

Which of the following statement about the segment file in Kafka Logs is correct? (Multiple choice)

• A.Sparse storage, that is, the original complete data, only select multiple data at intervals for storage
• B.Messages can be quickly located by indexing information
• C.The index file is stored sparsely, which can greatly reduce the space occupied by the index file metadata
• D.All index metadata is mapped to memory, which can avoid the index data IO disk operation of sementfile

Comment: *

Name: *

Email: *

Verification: *

Which of the following programming languages is Spark implemented in?

• A.Scala
• B.C++
• C.JAVA
• D.C

Comment: *

Name: *

Email: *

Verification: *