spark下载:

版本:spark 3.3.2

官网:

wget https://archive.apache.org/dist/spark/spark-3.3.2/spark-3.3.2-bin-hadoop2.tgz

华为镜像:

wget https://mirrors.huaweicloud.com/apache/spark/spark-3.3.2/spark-3.3.2-bin-hadoop2.tgz

spark sql与hive catlog的版本兼容:

https://archive.apache.org/dist/spark/docs/3.3.2/sql-data-sources-hive-tables.html

spark hive依赖:

spark3.3.2中包含了hive依赖

spark-sql使用hive catalog见:

https://www.pandadt.tech/arc/hive-catalog -> 启用 Hive catalog支持