spark下载:
版本:spark 3.3.2
官网:
wget https://archive.apache.org/dist/spark/spark-3.3.2/spark-3.3.2-bin-hadoop2.tgz
华为镜像:
wget https://mirrors.huaweicloud.com/apache/spark/spark-3.3.2/spark-3.3.2-bin-hadoop2.tgz
spark sql与hive catlog的版本兼容:
https://archive.apache.org/dist/spark/docs/3.3.2/sql-data-sources-hive-tables.html

spark hive依赖:
spark3.3.2中包含了hive依赖

spark-sql使用hive catalog见:
https://www.pandadt.tech/arc/hive-catalog -> 启用 Hive catalog支持
评论