SparkStreaming 异常:java.lang.NoSuchMethodError: scala.Predef scope()Lscala/xml/TopScope
生活随笔
收集整理的這篇文章主要介紹了
SparkStreaming 异常:java.lang.NoSuchMethodError: scala.Predef scope()Lscala/xml/TopScope
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
SparkStreaming運行報錯?
19/05/05 22:35:18 INFO SparkEnv: Registering OutputCommitCoordinator Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.$scope()Lscala/xml/TopScope$;at org.apache.spark.ui.jobs.AllJobsPage.<init>(AllJobsPage.scala:39)at org.apache.spark.ui.jobs.JobsTab.<init>(JobsTab.scala:38)at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:65)at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:82)at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:220)at org.apache.spark.ui.SparkUI$.createLiveUI(SparkUI.scala:162)at org.apache.spark.SparkContext.<init>(SparkContext.scala:452)版本問題:
?之前將依賴寫成了2.10 ,而我用的版本是2.11,修改解決
<dependency><groupId>org.scala-lang.modules</groupId><artifactId>scala-xml_2.11</artifactId><version>1.2.0</version></dependency><dependency><groupId>org.scala-lang</groupId><artifactId>scala-library</artifactId><version>${scala.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-core_2.11</artifactId><version>${spark.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-sql_2.11</artifactId><version>${spark.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-streaming_2.11</artifactId><version>${spark.version}</version><exclusions><exclusion><artifactId>scala-library</artifactId><groupId>org.scala-lang</groupId></exclusion></exclusions></dependency><dependency><groupId>org.scala-lang</groupId><artifactId>scala-library</artifactId><version>${scala.version}</version></dependency><dependency><groupId>org.apache.spark</groupId><artifactId>spark-core_2.11</artifactId><version>${spark.version}</version></dependency>?
總結
以上是生活随笔為你收集整理的SparkStreaming 异常:java.lang.NoSuchMethodError: scala.Predef scope()Lscala/xml/TopScope的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: identifier __ldg is
- 下一篇: CDH中文文档下载,Cloudera中文