版本
Streamsets3.16.1（core）
CDH6.3.2

一、问题

Streamsets安装包名为streamsets-datacollector-core-3.16.1.tgz，安装好后下载CDH6.3的包报错

1 操作

通过Streamsets UI安装CDH6.3.0的包报错

点击show error

2 完整报错内容

java.io.EOFExceptionat org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.read(GzipCompressorInputStream.java:303)at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read(TarArchiveInputStream.java:608)at java.io.InputStream.read(InputStream.java:101)at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1792)at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1769)at org.apache.commons.io.IOUtils.copy(IOUtils.java:1744)at com.streamsets.datacollector.restapi.StageLibraryResource.installLibraries(StageLibraryResource.java:363)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:160)at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)at org.glassfish.jersey.internal.Errors.process(Errors.java:315)at org.glassfish.jersey.internal.Errors.process(Errors.java:297)at org.glassfish.jersey.internal.Errors.process(Errors.java:267)at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:473)at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:427)at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:760)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1617)at com.streamsets.datacollector.http.GroupsInScopeFilter.lambda$doFilter$0(GroupsInScopeFilter.java:82)at com.streamsets.datacollector.security.GroupsInScope.execute(GroupsInScope.java:34)at com.streamsets.datacollector.http.GroupsInScopeFilter.doFilter(GroupsInScopeFilter.java:81)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)at com.streamsets.datacollector.restapi.rbean.rest.RestResourceContextFilter.doFilter(RestResourceContextFilter.java:42)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:310)at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:264)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)at com.streamsets.datacollector.http.LocaleDetectorFilter.doFilter(LocaleDetectorFilter.java:39)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)at org.eclipse.jetty.servlets.HeaderFilter.doFilter(HeaderFilter.java:117)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)at com.streamsets.pipeline.http.MDCFilter.doFilter(MDCFilter.java:47)at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:501)at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1592)at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1296)at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1562)at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1211)at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:221)at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)at org.eclipse.jetty.server.Server.handle(Server.java:500)at com.streamsets.lib.security.http.LimitedMethodServer.handle(LimitedMethodServer.java:41)at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:386)at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:562)at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:378)at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:270)at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:388)at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)at java.lang.Thread.run(Thread.java:748)

3 sdc.log关键报错

2021-11-02 11:02:04,278 [user:admin] [pipeline:] [runner:] [thread:webserver-48] [stage:] INFO  StageLibraryResource - Installing stage library streamsets-datacollector-cdh_6_3-lib from http://archives.streamsets.com/datacollector/3.16.1/tarball/streamsets-datacollector-cdh_6_3-lib-3.16.1.tgz
2021-11-02 11:21:13,324 [user:admin] [pipeline:] [runner:] [thread:webserver-48] [stage:] ERROR ExceptionToHttpErrorProvider - REST API call error: java.io.EOFException
java.io.EOFExceptionat org.apache.commons.compress.compressors.gzip.GzipCompressorInputStream.read(GzipCompressorInputStream.java:303)at org.apache.commons.compress.archivers.tar.TarArchiveInputStream.read(TarArchiveInputStream.java:608)at java.io.InputStream.read(InputStream.java:101)at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1792)at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1769)

二、定位

1 思路A

根据日志看是从http://archives.streamsets.com/datacollector/3.16.1/tarball/streamsets-datacollector-cdh_6_3-lib-3.16.1.tgz下载 streamsets-datacollector-cdh_6_3-lib
尝试浏览器访问一下这个地址，发现可以下载，尝试手动把包下载下来放到目标目录

ssh连接服务器，发现网络很慢，尝试用pc下载这个包，解压后发现streamsets-datacollector-3.16.1\streamsets-libs\streamsets-datacollector-cdh_6_3-lib\lib目录下都是jar包，将这些放到Streamsets下载的目标目录streamsets-datacollector-3.16.1/streamsets-libs/streamsets-datacollector-cdh_6_3-lib/lib中去
去看已安装的包时发现任然没有

这个方法不太行，可能安装过程除jar包外会写一些其他配置，这些我们就没办法手动搞了。换个思路

2 思路B（可行）

该版本安装包为core版本，考虑重新安装full版本
在官方网站下载streamsets-datacollector-all-3.22.3.tgz
安装步骤参考官方文档

可以看到重新安装后，需要的包已经是Installed状态

参考资料

官方文档

Streamsets 安装额外Stage包——CDH6.3.0包报错REST API call error: java.io.EOFException相关推荐

CCS编写F28335定时器0测试程序报错unresolved symbols remain error解决方法
CCS编写F28335定时器程序,普中开发板,出现如下报错 error #10234-D: unresolved symbols remain error #10010: errors encount ...
mysql8没有cmakelist_CentOS7安装mysql8.0编译报错集合
以下都是我安装mysql8.0遇到的一些报错和解决方法 1.does not appear to contain CMakeLists.txt. 原因:mysql下载的源码包不对解决方法:下载正确的 ...
RedHat5.5_X64 Linux安装oracle 11.2.0.3 报错
[javascript] view plaincopy REDHAT linux 安装 11G 11.2.0.3 报错 oracle用户执行./runinstaller后直接报错查看日志后 ...
cmd输入pip报错_安装虚拟环境+pip安装XXX包的常见操作与报错解决
安装虚拟环境+pip安装XXX包的常见操作与报错解决blog.csdn.net 文章目录: 一.开始前提二.安装虚拟环境的常见操作三.pip 的命令的常见操作:安装.更新.卸载.指定源四.安装 ...
01-路由跳转安装less this.$router.replace(path) 解决vue/cli3.0语法报错问题
01-路由跳转安装less this.$router.replace(path) 解决vue/cli3.0语法报错问题参考文章: (1)01-路由跳转安装less this.$router.re ...
树莓派4 安装OPENCV3全过程（各种踩坑和报错）
树莓派4 安装OPENCV3全过程(各种踩坑和报错) 说明第一步更换源第二部:存储空间的一些说明和操作第三步:增加交换空间第四步:下载工具及包第五步:设置编译编译参数第六步:开始编译第六 ...
linux oracle bad elf,oracle11g安装到red hat6.2 64位系统报错：/lib/ld-linux.so.2: bad ELF interpreter...
oracle11g安装到red hat6.2 64位系统报错:/lib/ld-linux.so.2: bad ELF interpreter 1.问题如下: [oracle@just ~]$ cd d ...
python 安装 pyinstaller 报错Preparing wheel metadata ... error
python 安装 pyinstaller 报错Preparing wheel metadata ... error ERROR: Command errored out with exit stat ...
Springboot 项目金蝶中间件AAS-9.0启动报错 javax.persistence.Table.indexes()[Ljavax/persistence/Index 问题解决
Springboot 项目金蝶中间件AAS-9.0启动报错 java.lang.NoSuchMethodError: javax.persistence.Table.indexes()[Ljavax/ ...

Streamsets 安装额外Stage包——CDH6.3.0包报错REST API call error: java.io.EOFException