illegal cyclic reference involving object InterfaceAudience

最近开发Spark应用程序，用到了scala反射，但是却一直报错循环引用 InterfaceAudience，感觉很奇怪，后来排查错因才发现，原来FileSystem类不可以作为反射的方法的参数，一旦作为参数就会报错循环引用。具体测试代码如下所示。

package myreflectimport scala.reflect.runtime.universe._
import org.apache.hadoop.fs.FileSystem
import org.apache.hadoop.security.UserGroupInformation.HadoopConfiguration
import org.apache.hadoop.conf.Configurationclass Person(name:String,age:Int){def printPerson={println(s"${name}<-//->${age}")}def myTest(hdfs:FileSystem):Unit = {println(hdfs)}
}object foo{def main(args:Array[String]):Unit ={val a = typeTag[Person]getInstance[Person](a)}def getInstance[T](t:TypeTag[T]):Unit = {val classSymbol = t.tpe.typeSymbol.asClassval mirror = runtimeMirror(getClass.getClassLoader)val classMirror = mirror.reflectClass(classSymbol)val methodConstructor = t.tpe.decl(termNames.CONSTRUCTOR).asMethodval methodMirror = classMirror.reflectConstructor(methodConstructor)val p = methodMirror("jack",12)val methodx = t.tpe.decl(TermName("printPerson")).asMethodval methody = t.tpe.decl(TermName("myTest")).asMethodval person1 = mirror.reflect(p)val methodPrint = person1.reflectMethod(methodx)methodPrint()val myTest = person1.reflectMethod(methody)myTest( FileSystem.get( new Configuration() ) )}}

它的报错异常栈为：

jack<-//->12
Exception in thread "main" scala.reflect.internal.Symbols$CyclicReference: illegal cyclic reference involving object InterfaceAudienceat scala.reflect.internal.Symbols$Symbol$$anonfun$info$3.apply(Symbols.scala:1523)at scala.reflect.internal.Symbols$Symbol$$anonfun$info$3.apply(Symbols.scala:1521)at scala.Function0$class.apply$mcV$sp(Function0.scala:34)at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)at scala.reflect.internal.Symbols$Symbol.lock(Symbols.scala:567)at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1521)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$2.scala$reflect$runtime$SynchronizedSymbols$SynchronizedSymbol$$super$info(SynchronizedSymbols.scala:171)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anonfun$info$1.apply(SynchronizedSymbols.scala:127)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anonfun$info$1.apply(SynchronizedSymbols.scala:127)at scala.reflect.runtime.Gil$class.gilSynchronized(Gil.scala:19)at scala.reflect.runtime.JavaUniverse.gilSynchronized(JavaUniverse.scala:16)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$class.gilSynchronizedIfNotThreadsafe(SynchronizedSymbols.scala:123)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$2.gilSynchronizedIfNotThreadsafe(SynchronizedSymbols.scala:171)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$class.info(SynchronizedSymbols.scala:127)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$2.info(SynchronizedSymbols.scala:171)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$coreLookup$1(JavaMirrors.scala:992)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$lookupClass$1(JavaMirrors.scala:998)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$classToScala1(JavaMirrors.scala:1003)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$classToScala$1.apply(JavaMirrors.scala:980)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$classToScala$1.apply(JavaMirrors.scala:980)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$toScala$1.apply(JavaMirrors.scala:97)at scala.reflect.runtime.TwoWayCaches$TwoWayCache$$anonfun$toScala$1.apply(TwoWayCaches.scala:38)at scala.reflect.runtime.Gil$class.gilSynchronized(Gil.scala:19)at scala.reflect.runtime.JavaUniverse.gilSynchronized(JavaUniverse.scala:16)at scala.reflect.runtime.TwoWayCaches$TwoWayCache.toScala(TwoWayCaches.scala:33)at scala.reflect.runtime.JavaMirrors$JavaMirror.toScala(JavaMirrors.scala:95)at scala.reflect.runtime.JavaMirrors$JavaMirror.classToScala(JavaMirrors.scala:980)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaAnnotationProxy.<init>(JavaMirrors.scala:163)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaAnnotationProxy$.apply(JavaMirrors.scala:162)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaAnnotationProxy$.apply(JavaMirrors.scala:162)at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$copyAnnotations(JavaMirrors.scala:683)at scala.reflect.runtime.JavaMirrors$JavaMirror$FromJavaClassCompleter.load(JavaMirrors.scala:733)at scala.reflect.runtime.JavaMirrors$JavaMirror$FromJavaClassCompleter.complete(JavaMirrors.scala:744)at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1535)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$2.scala$reflect$runtime$SynchronizedSymbols$SynchronizedSymbol$$super$info(SynchronizedSymbols.scala:171)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anonfun$info$1.apply(SynchronizedSymbols.scala:127)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anonfun$info$1.apply(SynchronizedSymbols.scala:127)at scala.reflect.runtime.Gil$class.gilSynchronized(Gil.scala:19)at scala.reflect.runtime.JavaUniverse.gilSynchronized(JavaUniverse.scala:16)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$class.gilSynchronizedIfNotThreadsafe(SynchronizedSymbols.scala:123)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$2.gilSynchronizedIfNotThreadsafe(SynchronizedSymbols.scala:171)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$class.info(SynchronizedSymbols.scala:127)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$2.info(SynchronizedSymbols.scala:171)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$coreLookup$1(JavaMirrors.scala:992)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$lookupClass$1(JavaMirrors.scala:998)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$classToScala1(JavaMirrors.scala:1003)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$classToScala$1.apply(JavaMirrors.scala:980)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$classToScala$1.apply(JavaMirrors.scala:980)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$toScala$1.apply(JavaMirrors.scala:97)at scala.reflect.runtime.TwoWayCaches$TwoWayCache$$anonfun$toScala$1.apply(TwoWayCaches.scala:38)at scala.reflect.runtime.Gil$class.gilSynchronized(Gil.scala:19)at scala.reflect.runtime.JavaUniverse.gilSynchronized(JavaUniverse.scala:16)at scala.reflect.runtime.TwoWayCaches$TwoWayCache.toScala(TwoWayCaches.scala:33)at scala.reflect.runtime.JavaMirrors$JavaMirror.toScala(JavaMirrors.scala:95)at scala.reflect.runtime.JavaMirrors$JavaMirror.classToScala(JavaMirrors.scala:980)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaAnnotationProxy.<init>(JavaMirrors.scala:163)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaAnnotationProxy$.apply(JavaMirrors.scala:162)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaAnnotationProxy$.apply(JavaMirrors.scala:162)at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$copyAnnotations(JavaMirrors.scala:683)at scala.reflect.runtime.JavaMirrors$JavaMirror$FromJavaClassCompleter.load(JavaMirrors.scala:733)at scala.reflect.runtime.JavaMirrors$JavaMirror$FromJavaClassCompleter.complete(JavaMirrors.scala:744)at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1535)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$8.scala$reflect$runtime$SynchronizedSymbols$SynchronizedSymbol$$super$info(SynchronizedSymbols.scala:168)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anonfun$info$1.apply(SynchronizedSymbols.scala:127)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anonfun$info$1.apply(SynchronizedSymbols.scala:127)at scala.reflect.runtime.Gil$class.gilSynchronized(Gil.scala:19)at scala.reflect.runtime.JavaUniverse.gilSynchronized(JavaUniverse.scala:16)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$class.gilSynchronizedIfNotThreadsafe(SynchronizedSymbols.scala:123)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$8.gilSynchronizedIfNotThreadsafe(SynchronizedSymbols.scala:168)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$class.info(SynchronizedSymbols.scala:127)at scala.reflect.runtime.SynchronizedSymbols$SynchronizedSymbol$$anon$8.info(SynchronizedSymbols.scala:168)at scala.reflect.internal.Symbols$Symbol.initialize(Symbols.scala:1680)at scala.reflect.internal.Symbols$Symbol.hasFlag(Symbols.scala:735)at scala.reflect.internal.Symbols$Symbol.hasFlag(Symbols.scala:738)at scala.reflect.internal.Symbols$Symbol.isDerivedValueClass(Symbols.scala:823)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$isValueClassParam(JavaMirrors.scala:308)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$scala$reflect$runtime$JavaMirrors$JavaMirror$$mkMethodMirror$2.apply(JavaMirrors.scala:317)at scala.reflect.runtime.JavaMirrors$JavaMirror$$anonfun$scala$reflect$runtime$JavaMirrors$JavaMirror$$mkMethodMirror$2.apply(JavaMirrors.scala:317)at scala.collection.LinearSeqOptimized$class.exists(LinearSeqOptimized.scala:93)at scala.collection.immutable.List.exists(List.scala:84)at scala.reflect.runtime.JavaMirrors$JavaMirror.existsParam$1(JavaMirrors.scala:315)at scala.reflect.runtime.JavaMirrors$JavaMirror.scala$reflect$runtime$JavaMirrors$JavaMirror$$mkMethodMirror(JavaMirrors.scala:317)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaInstanceMirror.reflectMethod(JavaMirrors.scala:248)at scala.reflect.runtime.JavaMirrors$JavaMirror$JavaInstanceMirror.reflectMethod(JavaMirrors.scala:233)at myreflect.foo$.getInstance(foo.scala:40)at myreflect.foo$.main(foo.scala:21)at myreflect.foo.main(foo.scala)

可以看到第一行输出了，说明我写的反射是没有错误的，仅仅是仅为把FileSystem作为了参数才开始报错的。

解决方法，我最后采用了传参的时候传来sc:SparkContext作为参数，这样的话可以使用FileSystem.get(sc.hadoopConfiguration)方法获取FileSystem。算是绕路而行吧。

illegal cyclic reference involving object InterfaceAudience相关推荐

【scala使用spark报错】illegal cyclic inheritance involving trait Iterable val df = Seq(
报错信息 illegal cyclic inheritance involving trait Iterable val df = Seq( 原因 scala和spark版本不相符笔者报错版本 sp ...
illegal cyclic inheritance involving trait Iterable val wordRDD: RDD[String] = fileRDD.flatMap(
illegal cyclic inheritance involving trait Iterable val wordRDD: RDD[String] = fileRDD.flatMap( _.sp ...
idea运行spark程序报错scalac: Error: illegal cyclic inheritance involving trait Iterable
执行一个spark的scala写的类,报错 scalac: Error: illegal cyclic inheritance involving trait Iterable scala.refle ...
scala illegal cyclic inheritance involving trait Iterable val data= input.flatMap(_.split(“ “))
最近在搭建flink 项目的时候 ,出现上述问题试了很多方式,已经决.在此记录下. 在项目上右键选择 open module settings ,进行如下操作即可. 问题解决,看下效果.
scala illegal cyclic inheritance involving trait iterable
最近在学习spark的时候,编译Scala很简单的程序都会遇到这个问题,甚至能在命令行运行得好好地程序 ,拿到idea里面报了一对错,通过我在网上找,然后翻墙去谷歌,发现这其实是Scala自身的bug ...
【Android】错误Cyclic inheritance involving(循环继承问题)
编译工程时,遇到"Cyclic inheritance involving",翻译过来就是, 实际代码: package itbird.com.myapplication33;im ...
Java 异常java.lang.IllegalArgumentException: Illegal group reference
Java 异常java.lang.IllegalArgumentException: Illegal group reference 参考文章: (1)Java 异常java.lang.Illegal ...
The projects in the reactor contain a cyclic reference
图中模块C依赖于模块B,模块B依赖于模块A,而模块A又依赖于模块C,这样就出现了相互依赖情况,如果运行mvn comp ...
不错的 Illegal group reference解决方法
解决:java.lang.IllegalArgumentException: Illegal group reference 当使用String中的replaceAll方法时,如果替换的值中包含有$符 ...

illegal cyclic reference involving object InterfaceAudience

illegal cyclic reference involving object InterfaceAudience相关推荐

最新文章

热门文章