pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

Hi

I am running pyspark code and it was running fine yesterday. Now its giving the error:

pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext

How to resolve this?

Here is the full error log:

java.lang.IllegalArgumentException: requirement failed: Can only call getServletHandlers on a running MetricsSystem
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.metrics.MetricsSystem.getServletHandlers(MetricsSystem.scala:91)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:524oorg.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58un.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:247)
at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
at py4j.Gateway.invoke(Gateway.java:236)
at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:80)
at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:69)
at py4j.GatewayConnection.run(GatewayConnection.java:214)
at java.lang.Thread.run(Thread.java:748)

What is solution?

Thanks

View Answers

December 27, 2018 at 12:58 AM

Hi,

This error comes when your Spark master and other nodes are not accessible due to some reason.

I re-started spark cluster and it solved.

Thanks

Ads









Related Tutorials/Questions & Answers:
pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext
pyspark : An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext  Hi I am running pyspark code and it was running fine yesterday. Now its giving the error: pyspark : An error occurred while calling
Error in calling javascript function from java
Error in calling javascript function from java  I am callin javascriot function from applet and getting error netscape.javascript.JSException: Unexpected error: This method should not be used unless loaded from plugin.jar
Advertisements
getting error while inserting values in database
) { out.println("An Error Had occurred while accessing the database...getting error while inserting values in database  AddUser.java..."); if (envContext == null)throw new Exception("Error: No Context
i got an error while compile this program manually.
i got an error while compile this program manually.  import javax.servlet.http.*; import org.apache.struts.action.*; public class ActionOne{ public...,struts jar files and i got an error in saveErrors() error Heading cannot find
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
Error while SQL Server connection to Java
Error while SQL Server connection to Java  import java.sql.*; public class OdbcSqlServerConnection { public static void main(String args[]) throws... this code, i am getting an error as OdbcSqlServerConnection.java:29: class,interface
error while running a jsp page in netbeans
error while running a jsp page in netbeans  this is error that come under column "java db processes" in netbeans Exception in thread "main" java.lang.ExceptionInInitializerError
Im getting this error while running JPA project
Im getting this error while running JPA project  Exception in thread "main" javax.persistence.PersistenceException: [PersistenceUnit: examplePersistenceUnit] Unable to configure EntityManagerFactory
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new to maven... I created java spring hibernate project.. and i kept all .java files... on the index page it shows 500 error.. My pOM.xml is 4.0.0
Error with Maven while deploying the war file
Error with Maven while deploying the war file  Hi, I am new... any link on the index page it shows 500 error.. My pOM.xml is <project...; </build> </project> But after deploying that i got this error
i have got error while compiling simple tag handler
i have got error while compiling simple tag handler   javac.servlet.jsp not found! tell me what are the jar files required to run simple tag handler...;it is : javax.servlet.jsp only but getting error wt is reason
error of HTTP Status 404 while running servlet on apache tomcat server
error of HTTP Status 404 while running servlet on apache tomcat server  i have followed the steps given here.Also hava put servlet-api in lib folder and have set classpath properly. on typing "http://localhost:8080" i do get
I had this error while deploying a web services in jboss
I had this error while deploying a web services in jboss  Error configuring application listener of class com.sun.xml.ws.transport.http.servlet.WSServletContextListener: java.lang.ClassNotFoundException
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
http status 500 error in tomcat 6 while using eclipse helios
http status 500 error in tomcat 6 while using eclipse helios   package com.lala.servlets; import javax.servlet.*; import javax.servlet.http.... The server encountered an internal error () that prevented it from fulfilling
error
error  When I deploye the example I have this message cannot Deploy HelloWorld Deployment Error for module: HelloWorld: Error occurred during deployment: Exception while deploying the app [HelloWorld
JSF error
JSF error  some of the users are not able to update the db. getting the error "An Error Occurred: Error calling action method of component with id CreateorManageOffer:jidjsp134312524923 Caused by: java.lang.NullPointerException
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
video calling
video calling  how to implement video calling using java? i am a final year mca student please give me some samplecodes
Calling a function
Calling a function  Hi, I have a function xyz() in php code. When a button is clicked it should execute that particular function for that i have written as <form action="<?=$_SERVER['PHP_SELF'];?>" method="post">
Calling Destructor
Calling Destructor  How can i call destructor in java using System.gc() or manually. Please anyone give me a example program   Java is a garbage collected language therefore you cannot predict when (or even
Error-
Error-   Hello, I would like to know about XSD file. I try to print XML file but I am getting error SAXException-- says Content is not allowed in prolog. Please help me
error
error  i have 404 error in my program plz tell me yhe solution about
error
error  i have 404 error in my program plz tell me yhe solution about
error
/ServletUserEnquiryForm.shtml getting an error given below SQLException caught: [Microsoft][ODBC SQL Server Driver]COUNT field incorrect or syntax error please suggest
Error
Error  I have created ajax with php for state and city. When I change state then city will not come in dropdown list and it give me error as 'Unknown Runtime Error'. This error come only in IE browser, but in other brower
error
error
error!!!!!!!!!
error!!!!!!!!!   st=con.createStatement(); int a=Integer.parseInt(txttrno.getText()); String b=txttname.getText(); String c=txtfrom.getText(); String d=txtto.getText
error!!!!!!!!!
error!!!!!!!!!   st=con.createStatement(); int a=Integer.parseInt(txttrno.getText()); String b=txttname.getText(); String c=txtfrom.getText(); String d=txtto.getText
error!!!!!!!!!
error!!!!!!!!!   st=con.createStatement(); int a=Integer.parseInt(txttrno.getText()); String b=txttname.getText(); String c=txtfrom.getText(); String d=txtto.getText
Error
Error  Hi. I am getting error in the following code after the line I have commented as ERROR. How to solve this. Thanks in advance. package...;"); // ERROR out.println(" var pattern
Error
Error  Hi. I am getting error in the following code after the line I have commented as ERROR. How to solve this. Thanks in advance. package...;"); // ERROR out.println(" var pattern
Error
Error  Hi. I am getting error in the following code after the line I have commented as ERROR. How to solve this. Thanks in advance. package...;"); // ERROR out.println(" var pattern
Error
Error  Hi. I am getting error in the following code after the line I have commented as ERROR. How to solve this. Thanks in advance. package...;"); // ERROR out.println(" var pattern = /^\d{3,5
error
error  whats the error.............. import java.util.Scanner; public class g { public static void main(String[] args) { Scanner s=new Scanner(System.in); int d,x,y; System.out.println("Enter the first number
calling servlet from jsp in netbeans ide
calling servlet from jsp in netbeans ide  I have tried to call servlet from jsp code in netbeans for checking the database values . but while running it showing the error that the resource not available. i dono wat mistake i did
calling servlet from jsp
calling servlet from jsp  how to call a servlet from jsp
calling a java file in java
calling a java file in java  how to call a another java file in java
ModuleNotFoundError: No module named 'django-countries-with-calling-codes'
-with-calling-codes' error will be solved. Thanks...ModuleNotFoundError: No module named 'django-countries-with-calling-codes'  Hi, My Python program is throwing following error
ModuleNotFoundError: No module named 'sequana-variant-calling'
: No module named 'sequana-variant-calling' error? Thanks   ...-calling' error will be solved. Thanks...ModuleNotFoundError: No module named 'sequana-variant-calling'  Hi
ModuleNotFoundError: No module named 'seaborn-calling-function'
the ModuleNotFoundError: No module named 'seaborn-calling-function' error? Thanks  ...-calling-function' error will be solved. Thanks...ModuleNotFoundError: No module named 'seaborn-calling-function'  Hi
Calling from JSP
Calling from JSP  how can we call a class file from JSP   Hi, Do you want to call a servlet or a Java Bean through JSP? Please clarify this. For more information, visit the following link: JSP Tutorials Thanks
Calling servlet from servlet .
Calling servlet from servlet .  How to call a servlet from another... ServletException, IOException { System.out.println("Calling another servlet by using...); System.out.println("Calling another servlet by using SendRedirect
The while and do
While and do-while       Lets try to find out what a while statement does. In a simpler language, the while statement continually executes a block of statements while
While and do-while
While and do-while       Nested classes Here is another advantage of the Java, object-oriented programming language that allows us to define a class within another
calling setInterval() on onclick event
calling setInterval() on onclick event  Hi all, I am trying to call setInterval() on onclick event. But it is executing the code only once. Following is my code. <script type="text/javascript" language="javascript">
Erron while
Erron while   Hi, i'm doing a project regarding xml. I want... with that data.Here is my coding and error showing on that coding.Could anybody help to know my error? coding: public class Test { public static void main(String

Ads