問題重現如下：
?

error: missing or invalid dependency detected while loading class file 'RDD.class'. Could not access term hadoop in package org.apache, because it (or its dependencies) are missing. Check your build definition for missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) A full rebuild may help if 'RDD.class' was compiled against an incompatible version of org.apache. error: missing or invalid dependency detected while loading class file 'RDD.class'. Could not access term io in value org.apache.hadoop, because it (or its dependencies) are missing. Check your build definition for missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) A full rebuild may help if 'RDD.class' was compiled against an incompatible version of org.apache.hadoop. warning: Class com.fasterxml.jackson.annotation.JsonInclude not found - continuing with a stub. warning: Class com.fasterxml.jackson.annotation.JsonInclude not found - continuing with a stub. warning: While parsing annotations in self_jars/spark-core_2.11-2.3.1.jar(org/apache/spark/rdd/RDDOperationScope.class), could not find NON_NULL in enum <none>. This is likely due to an implementation restriction: an annotation argument cannot refer to a member of the annotated class (SI-7014). warning: Class com.fasterxml.jackson.annotation.JsonPropertyOrder not found - continuing with a stub. error: missing or invalid dependency detected while loading class file 'RDDOperationScope.class'. Could not access term fasterxml in package com, because it (or its dependencies) are missing. Check your build definition for missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) A full rebuild may help if 'RDDOperationScope.class' was compiled against an incompatible version of com. error: missing or invalid dependency detected while loading class file 'RDDOperationScope.class'. Could not access term jackson in value com.fasterxml, because it (or its dependencies) are missing. Check your build definition for missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) A full rebuild may help if 'RDDOperationScope.class' was compiled against an incompatible version of com.fasterxml. error: missing or invalid dependency detected while loading class file 'RDDOperationScope.class'. Could not access term annotation in value com.jackson, because it (or its dependencies) are missing. Check your build definition for missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) A full rebuild may help if 'RDDOperationScope.class' was compiled against an incompatible version of com.jackson. error: missing or invalid dependency detected while loading class file 'RDDOperationScope.class'. Could not access term JsonInclude in value com.annotation, because it (or its dependencies) are missing. Check your build definition for missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.) A full rebuild may help if 'RDDOperationScope.class' was compiled against an incompatible version of com.annotation. four warnings found 6 errors found

導入hadoop-common-2.7.3.jar即可

scalac的導入方式就是在classpath后面的路徑對應的文件夾中放入上述的jar包,例如：

scalac -classpath $(echo *.jar self_jars/*.jar | tr ' ' ':') ?TestRdd.scala

?

總結

以上是生活随笔為你收集整理的error: missing or invalid dependency detected while loading class file 'RDD.class'.的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。