ava.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

Question

 windows idea 运行 本地模式people测试时报错 

Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties

18/06/07 17:44:30 INFO SparkContext: Running Spark version 2.1.1

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration

at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:38)

at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:36)

at org.apache.hadoop.security.UserGroupInformation$UgiMetrics.create(UserGroupInformation.java:99)

at org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:192)

at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2391)

at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2391)

at scala.Option.getOrElse(Option.scala:121)

at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2391)

at org.apache.spark.SparkContext.<init>(SparkContext.scala:295)

at com.scala.study.Sparkstudy.SqlContext$.delayedEndpoint$com$scala$study$Sparkstudy$SqlContext$1(SqlContext.scala:12)

at com.scala.study.Sparkstudy.SqlContext$delayedInit$body.apply(SqlContext.scala:6)

at scala.Function0$class.apply$mcV$sp(Function0.scala:34)

at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)

at scala.App$$anonfun$main$1.apply(App.scala:76)

at scala.App$$anonfun$main$1.apply(App.scala:76)

at scala.collection.immutable.List.foreach(List.scala:381)

at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35)

at scala.App$class.main(App.scala:76)

at com.scala.study.Sparkstudy.SqlContext$.main(SqlContext.scala:6)

at com.scala.study.Sparkstudy.SqlContext.main(SqlContext.scala)

Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration

at java.net.URLClassLoader.findClass(URLClassLoader.java:381)

at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)

at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

... 20 more

代码如下  

object SqlContext extends App {
 //1创建响应的Context

 val path = args(0)
 val sparkConf = new SparkConf()
 sparkConf.setAppName("hello world").setMaster("local[2]")
 val sc = new SparkContext(sparkConf)
 val sqlContext = new SQLContext(sc)
 val peop1e = sqlContext.read.format("json").load(path)
 peop1e.printSchema()
 peop1e.show()

 sc.stop()
}

Answer 1

Michael_PK 2018-06-07 18:34:33

你的dependency加了哪些

• 提问者 慕尼黑1121184 #1

  <dependencies>
      <dependency>
        <groupId>org.scala-lang</groupId>
        <artifactId>scala-library</artifactId>
        <version>${scala.version}</version>
      </dependency>
      <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.11</artifactId>
        <version>${spark.version}</version>
      </dependency>
        <dependency>
            <groupId>org.apache.spark</groupId>
            <artifactId>spark-sql_2.11</artifactId>
            <version>${spark.version}</version>
        </dependency>
    </dependencies>

• 提问者 慕尼黑1121184 #2

  <scala.version>2.11.8</scala.version>
      <spark.version>2.1.1</spark.version>

• 提问者 慕尼黑1121184 #3

  在服务器上没有问题的 可以运行的 老师

点开查看后面6条评论