The Vertica Forum recently got a makeover! Let us know what you think by filling out this short, anonymous survey.
Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!
Spark 3.0 Scala 2.12 Support
JasonRoy
Community Edition User
Hi All,
To support many functionalities of our data analytic application, we upgraded to Spark 3.0, which is supported through scala 2.12. As of today (15 Jan 2021), Vertica 9 and 10 supports only up to Spark 2.4/Scala 2.11.https://essaywriter.fun/
I would like to know when are we expecting latest version of Spark 3.0 support in Vertica? Any idea or any link through which it can be setup with Vertica?
0
Answers
Vertica 10.1.x - A new version of the Spark Connector supports Scala 2.12 with Spark versions 2.4.1 and 3.0. See Vertica Integration for Apache Spark in the supported platforms section for details.
See:
https://www.vertica.com/docs/10.1.x/HTML/Content/Authoring/NewFeatures/10.1/10.1.0/IntegrationSpark.htm
https://www.vertica.com/docs/10.1.x/HTML/Content/Authoring/SparkConnector/ApacheSparkGuide.htm