Add jars to a Spark Job spark-submit
I want to submit some dependency jars along with the code jar file with spark-submit. How to add jar to the Spark Job Submit process?
In Spark we have two options to add jars to
a) Spark Driver
b) Spark Worker nodes
a) Here is example of adding jars to Spark Driver:
spark.driver.extraClassPath or it's alias --driver-class-path to set extra classpaths on the node running the driver.
b) Here is example of adding jars for Worker Nodes spark.executor.extraClassPath to set extra class path on the Worker nodes.