Exception in thread main java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi
该错误和我的上一篇博文ERROR [org.apache.hadoop.util.Shell] - Failed to locate the winutils binary in the hadoop binary path一样是由于缺少文件引起的,错误日志如下:
2018-04-11 16:32:28,514 INFO [org.apache.hadoop.mapreduce.JobSubmitter] - Submitting tokens for job: job_local1975654255_0001 2018-04-11 16:32:28,561 WARN [org.apache.hadoop.conf.Configuration] - file:/tmp/hadoop-Zimo/mapred/staging/Zimo1975654255/.staging/job_local1975654255_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 2018-04-11 16:32:28,562 WARN [org.apache.hadoop.conf.Configuration] - file:/tmp/hadoop-Zimo/mapred/staging/Zimo1975654255/.staging/job_local1975654255_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. 2018-04-11 16:32:28,663 DEBUG [org.apache.hadoop.security.UserGroupInformation] - PrivilegedAction as:Zimo (auth:SIMPLE) from:org.apache.hadoop.fs.FileContext.getAbstractFileSystem(FileContext.java:329) 2018-04-11 16:32:28,758 INFO [org.apache.hadoop.mapreduce.JobSubmitter] - Cleaning up the staging area file:/tmp/hadoop-Zimo/mapred/staging/Zimo1975654255/.staging/job_local1975654255_0001 Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Zat org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)at org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:435)at org.apache.hadoop.fs.FileUtil.canRead(FileUtil.java:977)at org.apache.hadoop.util.DiskChecker.checkAccessByFileMethods(DiskChecker.java:177)at org.apache.hadoop.util.DiskChecker.checkDirAccess(DiskChecker.java:164) at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:98)at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:285)at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:344)at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:131) at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:157)at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:636)at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:430)at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)at com.hadoop.phoneStatistics.ExcelPhoneStatistics.run(ExcelPhoneStatistics.java:117)at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)at com.hadoop.phoneStatistics.ExcelPhoneStatistics.main(ExcelPhoneStatistics.java:128) 2018-04-11 16:32:28,767 DEBUG [org.apache.hadoop.ipc.Client] - Stopping client 2018-04-11 16:32:28,767 DEBUG [org.apache.hadoop.ipc.Client] - IPC Client (1166151249) connection to centpy/192.168.86.134:9000 from Zimo: closed 2018-04-11 16:32:28,768 DEBUG [org.apache.hadoop.ipc.Client] - IPC Client (1166151249) connection to centpy/192.168.86.134:9000 from Zimo: stopped, remaining connections 0
解决方法是下载https://github.com/srccodes/hadoop-common-2.2.0-bin文件然后将其中的hadoop.dll文件放到hadoop安装路径的bin文件夹下(配置好HADOOP_HOME的环境变量),然后重启电脑,这样问题就能得到解决了!
以上就是博主为大家介绍的这一板块的主要内容,这都是博主自己的学习过程,希望能给大家带来一定的指导作用,有用的还望大家点个支持,如果对你没用也望包涵,有错误烦请指出。如有期待可关注博主以第一时间获取更新哦,谢谢!
版权声明:本文为博主原创文章,未经博主允许不得转载。
Exception in thread main java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Wi相关推荐
- Exception in thread main java.lang.UnsatisfiedLinkError: org.apache.hadoop.io .nativeio.NativeIO$W
在eclipse 调试mapreduce程序会报以下错误: Exception in thread "main" java.lang.UnsatisfiedLinkError: o ...
- Exception in thread “main“ java.lang.NoClassDefFoundError: org/apache/ibatis/io/Resources
项目场景: 在学习mybatis框架的时候,刚刚学习如果查询数据库user表中的信息时 问题描述: 所有步骤都是按照教程上走的,但是运行后里面就出现了 Exception in thread &quo ...
- Exception in thread main java.lang.RuntimeException: org.apache.hadoop.security.AccessControlExcep
hadoop在使用时,由于权限问题,没有解决,导致报错,如下,是我使用hive时,导致的错误. Exception in thread "main" java.lang.Runti ...
- java.lang.UnsatisfiedLinkError:org.apache.hadoop.io.nativeio.NativeIO$Windows.access0
java.lang.UnsatisfiedLinkError:org.apache.hadoop.io.nativeio.NativeIO$Windows.access0 出现这个错误之前,我的 Ha ...
- Exception in thread main java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
spark-env.sh中加入 export SPARK_DIST_CLASSPATH=$(${HADOOP_HOME}/bin/hadoop classpath)
- PySpark用saveAsTextFile写入Windows本地文件系统失败java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio
output_rdd.saveAsTextFile(path=r'../datas/word_rep_output') 写入Windows本地文件系统文件报错 22/07/16 15:23:07 ER ...
- 报错!Exception in thread “main“ java.lang.UnsatisfiedLinkError: ilog.cplex.Cplex.CPXopenCPLEX([I)J
在idea中配置cplex,用代码测试是否配置成功时,出现如下报错: java.lang.UnsatisfiedLinkError: no cplex2210 in java.library.path ...
- maven:Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/maven/cli/MavenC
小编今天学习maven时遇到关于版本的问题,百度了许多资料,都说需要更换jdk的版本: 小编在开发中使用的myelcipse2010编译器,最高自带jdk版本是1.6;但是在小编的努力不断尝试下,终于 ...
- Exception in thread “main“ java.lang.NoClassDefFoundError: org/apache/velocity/context/Context at c
11:41:33.067 [main] DEBUG com.baomidou.mybatisplus.generator.AutoGenerator - ======================= ...
最新文章
- GCC 链接 xxx:No such file or directory 及运行可执行文件 error while loading shared libraries: xxx.so 解决方案
- 独家 | 人工智能不能忽视符号逻辑以及原因
- 信息系统项目管理师-论文专题(四)进度管理论文写作
- HDU 4339 Query
- HTML5 + CSS 左右排版自适应高
- netty系列之:netty对SOCKS协议的支持
- Win 11 真的要来了!微软宣布 Win10 将于 2025 年终止支持!
- 组件化开发_思维导图
- [导入]正则表达式学习心得体会(2)
- Chrome升级 76.0.3809.87后 GreenChrome无法使用的办法
- linux中磁盘阵列说明,常用磁盘阵列说明
- Windows10系统EFI分区和OEM分区的删除方法
- 小米MIUI12.5手机降级教程,线刷
- [转载]你手里期权值多少钱?写给上市公司的同学
- 牛客网 - 小乐乐打游戏(BFS)
- python 报错in module,Centos 7 python 编译报错 ImportError: No module named six 解决办法
- word 标尺排版使用技巧
- 重定向(Redirect)
- ARIS BPA(业务流程分析)系列二: 如何达到运营卓越
- 世界地图可以无限放大_尼康显微镜CFI60无限远光学系统的结构图