pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

Ads
 

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

Hi

I am running pyspark code and it was running fine yesterday. Now its giving the error:

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

How to resolve this?

Here is the full error log:

java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:524oorg.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58un.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:247)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:236)
at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:80)
at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:69)
at py4j.GatewayConnection.run(GatewayConnection.java:214)
at java.lang.Thread.run(Thread.java:748)

What is solution?

Thanks

View Answers

December 27, 2018 at 12:58 AM

Hi,

This error comes when your Spark master and other nodes are not accessible due to some reason.

I re-started spark cluster and it solved.

Thanks

Ads









Related Tutorials/Questions & Answers:
pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext
pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext  Hi I am running pyspark code and it was running fine yesterday. Now its giving the error: pyspark : An error occurred while calling
Error in calling javascript function from java
Error in calling javascript function from java  I am callin javascriot function from applet and getting error netscape.javascript.JSException: Unexpected error: This method should not be used unless loaded from plugin.jar
Advertisements
getting error while inserting values in database
) { out.println("An Error Had occurred while accessing the database...getting error while inserting values in database  AddUser.java..."); if (envContext == null)throw new Exception("Error: No Context
i got an error while compile this program manually.
i got an error while compile this program manually.  import javax.servlet.http.*; import org.apache.struts.action.*; public class ActionOne{ public...,struts jar files and i got an error in saveErrors() error Heading cannot find
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
error while running a jsp page in netbeans
error while running a jsp page in netbeans  this is error that come under column "java db processes" in netbeans Exception in thread "main" java.lang.ExceptionInInitializerError
Im getting this error while running JPA project
Im getting this error while running JPA project  Exception in thread "main" javax.persistence.PersistenceException: [PersistenceUnit: examplePersistenceUnit] Unable to configure EntityManagerFactory
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new to maven... I created java spring hibernate project.. and i kept all .java files... on the index page it shows 500 error.. My pOM.xml is 4.0.0
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new... any link on the index page it shows 500 error.. My pOM.xml is <project...; </build> </project> But after deploying that i got this error
i have got error while compiling simple tag handler
i have got error while compiling simple tag handler   javac.servlet.jsp not found! tell me what are the jar files required to run simple tag handler...;it is : javax.servlet.jsp only but getting error wt is reason
error of HTTP Status 404 while running servlet on apache tomcat server
error of HTTP Status 404 while running servlet on apache tomcat server  i have followed the steps given here.Also hava put servlet-api in lib folder and have set classpath properly. on typing "http://localhost:8080" i do get
I had this error while deploying a web services in jboss
I had this error while deploying a web services in jboss  Error configuring application listener of class com.sun.xml.ws.transport.http.servlet.WSServletContextListener: java.lang.ClassNotFoundException
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
error
error  When I deploye the example I have this message cannot Deploy HelloWorld Deployment Error for module: HelloWorld: Error occurred during deployment: Exception while deploying the app [HelloWorld
JSF error
JSF error  some of the users are not able to update the db. getting the error "An Error Occurred: Error calling action method of component with id CreateorManageOffer:jidjsp134312524923 Caused by: java.lang.NullPointerException
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
Calling a function
Calling a function  Hi, I have a function xyz() in php code. When a button is clicked it should execute that particular function for that i have written as <form action="<?=$_SERVER['PHP_SELF'];?>" method="post">
Calling Destructor
Calling Destructor  How can i call destructor in java using System.gc() or manually. Please anyone give me a example program   Java is a garbage collected language therefore you cannot predict when (or even
Error-
Error-   Hello, I would like to know about XSD file. I try to print XML file but I am getting error SAXException-- says Content is not allowed in prolog. Please help me
error
error  i have 404 error in my program plz tell me yhe solution about
error
error  i have 404 error in my program plz tell me yhe solution about
error
/ServletUserEnquiryForm.shtml getting an error given below SQLException caught: [Microsoft][ODBC SQL Server Driver]COUNT field incorrect or syntax error please suggest
Error
Error  I have created ajax with php for state and city. When I change state then city will not come in dropdown list and it give me error as 'Unknown Runtime Error'. This error come only in IE browser, but in other brower
error
error
error!!!!!!!!!
error!!!!!!!!!   st=con.createStatement(); int a=Integer.parseInt(txttrno.getText()); String b=txttname.getText(); String c=txtfrom.getText(); String d=txtto.getText

Ads