java.lang.RuntimeException: Initialize ConfOptimizer class occur error, javax.naming.AuthenticationException: Cannot get job queue name

This error occurred during the recent expansion of livyserver on a cluster, and the creation of remote client failed

Remembering that the cluster seems to have white list restrictions, log in to the livyserver host and run the spark sample

./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-cluster ./examples/jars/spark-example

Access is restricted. Just add a white list

Similar Posts: