How to check spark version

 
 

Share on Google+Share on Google+

Java Coder
How to check spark version
1 Answer(s)      20 days ago
Posted in : Big Data
Ads

Hi,

How can I find which version of Apache Spark is running on my environment?

How to check spark version?

Thanks

Ads
View Answers

November 27, 2017 at 7:20 PM


Hi,

You can login to your box where apache spark is running then run the command:

spark-shell

It will display the version as shown below:

[[email protected] ~]# spark-shell
SPARK_MAJOR_VERSION is set to 2, using Spark2
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
Spark context Web UI available at http://172.17.0.2:4041
Spark context available as 'sc' (master = local[*], app id = local-1511778019896).
Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.1.1.2.6.1.0-129
      /_/

Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_141)
Type in expressions to have them evaluated.
Type :help for more information.

scala>

scala>

Thanks


Ads









Related Tutorials/Questions & Answers:
How to check spark version
How to check spark version  Hi, How can I find which version of Apache Spark is running on my environment? How to check spark version? Thanks... the command: spark-shell It will display the version as shown below
How to check Hadoop version in Ubuntu?
How to check Hadoop version in Ubuntu?  Hi, I am trying various... to Hadoop cluster through ssh terminal. How to check Hadoop version in Ubuntu? Thanks   Hi, Its easy to check the version of Hadoop in Ubuntu. type
Advertisements
how to insert check box
how to insert check box   how to insert check box into jtable row in swing
How to check a checkbox - Struts
How to check a checkbox  Hello Community, How can i check a checkbox defined with tags. with plain html, the tag checks the box. with the other tags i am getting an error that the property "checked" is not defined. Can someone
How to check if a pid is alive?
How to check if a pid is alive?  Hi, I have a process which is running in background and I want a simple command to find if the process id still running? How to check if a pid is alive? Thanks   HI, You can use
How to check no records - JSP-Servlet
How to check no records  Hi all, I am developing an onlineshopping project, in that how i have 2 check no records. I saw an answer....... At first when a user registers means, his/her cart is empty na... how
how to check a remote applications validity
how to check a remote applications validity  i am developing a network application to avoid unauthorized access to a port .. for that i need to get the application id . how to get the appln id of an appln. or is there any way
How to check whether database exists?
How to check whether database exists?  Hi, I have to create... to creating the database, i want to check whether database exists or not? How can i do this check. can any one help me on this. Please find thesample code
How to check a file exists or not in java.
Description: This example demonstrate how to check a file exits at a given path or not.  The method isFile() of the File class check for its existence. As in the file path we see '\' (backslash) that is used to denote
How to check a file is hidden or not in java
Description: This example demonstrate how to check a file is hidden at a given path or not.  The method isHidden() of the File class check for its hidden property of a file. As in the file path we see '\' (backslash
How to check text in textbox using JavaScript
How to check text in textbox using JavaScript  How to check text... qestion is that is it possible to check text feilds for text or null value. I want... me.   JavaScript validation example to check text in textfeild <
Version of com.revelytix>spark dependency
List of Version of com.revelytix>spark dependency
how to check and print the no of times an integer is repeated in an array
how to check and print the no of times an integer is repeated in an array  how to check and print the no of times an integer is repeated in an array??? suppose my input is 2 4 2 5 2 4 3 4 5 2 then my output should be 2-4
How to check if a string contains a substring in iOS?
on the 'Check If Exists' button application will find the string and show... is the video explanation of the tutorial which teaches you how to run the example code... have learned how to find it a string contains in the source string. Download
how to remove spell check in flex when button is clicked
how to remove spell check in flex when button is clicked  how to remove spell check when button is clicked in rich text editor control
check
updated"); will the above code check if the user has entered value for empcode
Version of com.magicsoho>spark-jq_2.11 dependency
List of Version of com.magicsoho>spark-jq_2.11 dependency
Version of com.magicsoho>spark-jq_2.10 dependency
List of Version of com.magicsoho>spark-jq_2.10 dependency
Version of com.alpinenow>plugin-spark dependency
List of Version of com.alpinenow>plugin-spark dependency
Version of com.alta189>auto-spark dependency
List of Version of com.alta189>auto-spark dependency
Version of com.appsflyer>spark-bigquery_2.10 dependency
List of Version of com.appsflyer>spark-bigquery_2.10 dependency
Version of com.appsflyer>spark-bigquery_2.11 dependency
List of Version of com.appsflyer>spark-bigquery_2.11 dependency
Version of com.bizo>spark-plug_2.10 dependency
List of Version of com.bizo>spark-plug_2.10 dependency
Version of com.bizo>spark-plug_2.11 dependency
List of Version of com.bizo>spark-plug_2.11 dependency
Version of com.crealytics>spark-excel_2.10 dependency
List of Version of com.crealytics>spark-excel_2.10 dependency
Version of com.crealytics>spark-excel_2.11 dependency
List of Version of com.crealytics>spark-excel_2.11 dependency
Version of com.databricks>spark-avro_2.10 dependency
List of Version of com.databricks>spark-avro_2.10 dependency
Version of com.databricks>spark-avro_2.11 dependency
List of Version of com.databricks>spark-avro_2.11 dependency
Version of com.databricks>spark-csv_2.10 dependency
List of Version of com.databricks>spark-csv_2.10 dependency
Version of com.databricks>spark-csv_2.11 dependency
List of Version of com.databricks>spark-csv_2.11 dependency
Version of com.databricks>spark-redshift_2.10 dependency
List of Version of com.databricks>spark-redshift_2.10 dependency

Ads

 
Advertisement null

Ads