pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

Ads
 

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

Hi

I am running pyspark code and it was running fine yesterday. Now its giving the error:

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

How to resolve this?

Here is the full error log:

java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:524oorg.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58un.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:247)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:236)
at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:80)
at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:69)
at py4j.GatewayConnection.run(GatewayConnection.java:214)
at java.lang.Thread.run(Thread.java:748)

What is solution?

Thanks

View Answers

December 27, 2018 at 12:58 AM

Hi,

This error comes when your Spark master and other nodes are not accessible due to some reason.

I re-started spark cluster and it solved.

Thanks

Ads









Related Tutorials/Questions & Answers:
Java error reached end of file while parsing
Java error reached end of file while parsing... of file while parsing  occurred when a programmer do not close the class ... an error i.e java error reached end of file while parsing as the class closing braces
Error in calling javascript function from java
Error in calling javascript function from java  I am callin javascriot function from applet and getting error netscape.javascript.JSException: Unexpected error: This method should not be used unless loaded from plugin.jar
Advertisements
error while compiling - Java Beginners
error while compiling  i am facing problem with compiling and running a simple java program, can any one help me, the error i am getting is javac is not recognised as internal or external command  Check if you JAVA_HOME
Error While Compiling - Java Beginners
Error While Compiling  Hi All I Am a beginner and i face the following problem while compiling can anyone help me. C:\javatutorial\example> javac HelloWorld.java 'javac' is not recognized as an internal or external
getting error while inserting values in database
) { out.println("An Error Had occurred while accessing the database...getting error while inserting values in database  AddUser.java..."); if (envContext == null)throw new Exception("Error: No Context
i got an error while compile this program manually.
i got an error while compile this program manually.  import javax.servlet.http.*; import org.apache.struts.action.*; public class ActionOne{ public...,struts jar files and i got an error in saveErrors() error Heading cannot find
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
error while running a jsp page in netbeans
error while running a jsp page in netbeans  this is error that come under column "java db processes" in netbeans Exception in thread "main" java.lang.ExceptionInInitializerError
error while running the applet - Java Beginners
error while running the applet  import java.applet.Applet; import java.awt.*; import java.awt.event.*; class MyFrame extends Frame { boolean...); ++num; } } } } i have problem while running the code , error
Im getting this error while running JPA project
Im getting this error while running JPA project  Exception in thread "main" javax.persistence.PersistenceException: [PersistenceUnit: examplePersistenceUnit] Unable to configure EntityManagerFactory
error while inserting millions of records - EJB
error while inserting millions of records  Hello, I am using ejb cmp... e.printStackTrace(); } }   The following error is occur java.rmi.ServerError: Unexpected Error; nested exception
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new to maven... I created java spring hibernate project.. and i kept all .java files... on the index page it shows 500 error.. My pOM.xml is 4.0.0
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new... any link on the index page it shows 500 error.. My pOM.xml is <project...; </build> </project> But after deploying that i got this error
cannot find java.exe error while opening netbean5.5 - IDE Questions
cannot find java.exe error while opening netbean5.5  HI, 1)i am... this problem? 2)while i am installing nokiamobiletoolkit, I got the error name is windows 3 occured while loading the java vm(launching error anywhere), How can i
i have got error while compiling simple tag handler
i have got error while compiling simple tag handler   javac.servlet.jsp not found! tell me what are the jar files required to run simple tag handler...;it is : javax.servlet.jsp only but getting error wt is reason
error of HTTP Status 404 while running servlet on apache tomcat server
error of HTTP Status 404 while running servlet on apache tomcat server  i have followed the steps given here.Also hava put servlet-api in lib folder and have set classpath properly. on typing "http://localhost:8080" i do get
Java error java.lang.nullpointerexception
Java error java.lang.nullpointerexception  ...; is the exception that occurred when a programmer perform an operation on a object  or calling a method on the object i.e null. This exception is thrown
SHOWING ERROR CODE 1064 WHILE TRYING TO EXECUTE PROCEDURE
SHOWING ERROR CODE 1064 WHILE TRYING TO EXECUTE PROCEDURE  I AM... AM ALSO PUTTING THE GENERATED ERROR. (0 row(s)affected) (0 ms taken) (0 row(s)affected) (0 ms taken) Error Code : 1064 You have an error in your SQL syntax
I had this error while deploying a web services in jboss
I had this error while deploying a web services in jboss  Error configuring application listener of class com.sun.xml.ws.transport.http.servlet.WSServletContextListener: java.lang.ClassNotFoundException
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
Java error class
the error occurred in the try block. These error occurred due to abnormal condition... and the message to be appear what the error occurred. Let us understand a condition... is you need to show the error message that occurred in your code. Here
error
error  When I deploye the example I have this message cannot Deploy HelloWorld Deployment Error for module: HelloWorld: Error occurred during deployment: Exception while deploying the app [HelloWorld
JSF error
JSF error  some of the users are not able to update the db. getting the error "An Error Occurred: Error calling action method of component with id CreateorManageOffer:jidjsp134312524923 Caused by: java.lang.NullPointerException
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
error
error  while iam compiling iam getting expected error

Ads