Sqoop执行命令：

./sqoop  import  --connect jdbc:oracle:thin:@10.112.101.251:1621:crmadbmr --username bass_etl --password 75!n!u6J --table DBPMSADM.PD_USERSVC_INFO_00 -m 4 --target-dir /ext/ods/PD_USERSVC_INFO_00/2014071906

执行日志：

crmd3n:/d2_data0/user/ocdc/bin/sqoop-1.4.2-cdh4.2.1/bin> 4 --target-dir /ext/ods/PD_USERSVC_INFO_00/2014071906 <

14/07/19 15:31:30 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.

14/07/19 15:31:30 INFO manager.SqlManager: Using default fetchSize of 1000

14/07/19 15:31:30 INFO tool.CodeGenTool: Beginning code generation

14/07/19 15:31:31 INFO manager.OracleManager: Time zone has been set to GMT

14/07/19 15:31:31 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM DBPMSADM.PD_USERSVC_INFO_00 t WHERE 1=0

14/07/19 15:31:31 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /d2_data0/user/ocdc/bin/hadoop-2.0.0-mr1-cdh4.2.1

注意：/tmp/sqoop-ocdc/compile/f2f2da5cca8a7ec0811e1390418222a8/DBPMSADM_PD_USERSVC_INFO_00.java 使用或覆盖了已过时的 API。

注意：要了解详细信息，请使用 -Xlint:deprecation 重新编译。

14/07/19 15:31:33 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-ocdc/compile/f2f2da5cca8a7ec0811e1390418222a8/DBPMSADM.PD_USERSVC_INFO_00.jar

14/07/19 15:31:33 INFO manager.OracleManager: Time zone has been set to GMT

14/07/19 15:31:33 WARN manager.OracleManager: The table DBPMSADM.PD_USERSVC_INFO_00 contains a multi-column primary key. Sqoop will default to the column SVC_ID only for this job.

14/07/19 15:31:33 INFO manager.OracleManager: Time zone has been set to GMT

14/07/19 15:31:33 WARN manager.OracleManager: The table DBPMSADM.PD_USERSVC_INFO_00 contains a multi-column primary key. Sqoop will default to the column SVC_ID only for this job.

14/07/19 15:31:33 INFO mapreduce.ImportJobBase: Beginning import of DBPMSADM.PD_USERSVC_INFO_00

14/07/19 15:31:33 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

14/07/19 15:31:33 INFO manager.OracleManager: Time zone has been set to GMT

14/07/19 15:31:34 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.

14/07/19 15:31:36 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(SVC_ID), MAX(SVC_ID) FROM DBPMSADM.PD_USERSVC_INFO_00

14/07/19 15:31:37 WARN db.TextSplitter: Generating splits for a textual index column.

14/07/19 15:31:37 WARN db.TextSplitter: If your database sorts in a case-insensitive order, this may result in a partial import or duplicate records.

14/07/19 15:31:37 WARN db.TextSplitter: You are strongly encouraged to choose an integral split column.

14/07/19 15:31:38 INFO mapred.JobClient: Running job: job_201407151514_3489

14/07/19 15:31:39 INFO mapred.JobClient: map 0% reduce 0%

14/07/19 15:31:50 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000000_0, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:31:51 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000001_0, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception:The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:31:51 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000003_0, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:31:53 INFO mapred.JobClient: map 25% reduce 0%

14/07/19 15:31:58 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000001_1, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:31:58 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000000_1, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception:The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:31:59 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000003_1, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:32:05 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000000_2, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:32:06 INFO mapred.JobClient: Task Id : attempt_201407151514_3489_m_000003_2, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:167)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:636)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:415)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLException: Io exception: The Network Adapter could not establish the connection

at org.apache.sqoop.mapreduce.db.DBInputFormat.getConnection

14/07/19 15:32:08 INFO mapred.JobClient: map 50% reduce 0%

14/07/19 15:32:17 INFO mapred.JobClient: Job complete: job_201407151514_3489

14/07/19 15:32:17 INFO mapred.JobClient: Counters: 24

14/07/19 15:32:17 INFO mapred.JobClient: File System Counters

14/07/19 15:32:17 INFO mapred.JobClient: FILE: Number of bytes read=0

14/07/19 15:32:17 INFO mapred.JobClient: FILE: Number of bytes written=369072

14/07/19 15:32:17 INFO mapred.JobClient: FILE: Number of read operations=0

14/07/19 15:32:17 INFO mapred.JobClient: FILE: Number of large read operations=0

14/07/19 15:32:17 INFO mapred.JobClient: FILE: Number of write operations=0

14/07/19 15:32:17 INFO mapred.JobClient: HDFS: Number of bytes read=256

14/07/19 15:32:17 INFO mapred.JobClient: HDFS: Number of bytes written=8

14/07/19 15:32:17 INFO mapred.JobClient: HDFS: Number of read operations=2

14/07/19 15:32:17 INFO mapred.JobClient: HDFS: Number of large read operations=0

14/07/19 15:32:17 INFO mapred.JobClient: HDFS: Number of write operations=2

14/07/19 15:32:17 INFO mapred.JobClient: Job Counters

14/07/19 15:32:17 INFO mapred.JobClient: Failed map tasks=1

14/07/19 15:32:17 INFO mapred.JobClient: Launched map tasks=12

14/07/19 15:32:17 INFO mapred.JobClient: Total time spent by all maps in occupied slots (ms)=91182

14/07/19 15:32:17 INFO mapred.JobClient: Total time spent by all reduces in occupied slots (ms)=0

14/07/19 15:32:17 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0

14/07/19 15:32:17 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0

14/07/19 15:32:17 INFO mapred.JobClient: Map-Reduce Framework

14/07/19 15:32:17 INFO mapred.JobClient: Map input records=0

14/07/19 15:32:17 INFO mapred.JobClient: Map output records=0

14/07/19 15:32:17 INFO mapred.JobClient: Input split bytes=256

14/07/19 15:32:17 INFO mapred.JobClient: Spilled Records=0

14/07/19 15:32:17 INFO mapred.JobClient: CPU time spent (ms)=8910

14/07/19 15:32:17 INFO mapred.JobClient: Physical memory (bytes) snapshot=698327040

14/07/19 15:32:17 INFO mapred.JobClient: Virtual memory (bytes) snapshot=7732314112

14/07/19 15:32:17 INFO mapred.JobClient: Total committed heap usage (bytes)=2022703104

14/07/19 15:32:17 INFO mapreduce.ImportJobBase: Transferred 8 bytes in 43.3403 seconds (0.1846 bytes/sec)

14/07/19 15:32:17 INFO mapreduce.ImportJobBase: Retrieved 0 records.

14/07/19 15:32:17 ERROR tool.ImportTool: Error during import: Import job failed!

昨天发了从DB2中导入数据的错误日志，后来定位为JDBC驱动包的问题，但是替换之后还是没用，然后又定位为是由于JDBC线程未关闭，然后换成了从Oracle中导入数据，又来了另外一个问题：连接有时能通，有时不能通，对于-m 4是基本通不了，原因在于Mapreduce是自动分发匹配的，所以有些结点可能是不可见的，这样对我们连接又会出现网络不通的问题，初步解决方案：自行修改源代码，找到任务分发代码，直接指定一个专门用来做数据导入的结点。正在实践ing。。。。

sqoop connect oracle,Sqoop从Oracle导出数据出错：The Network Adapter could not establish the connection...相关推荐

  1. oracle出现The Network Adapter could not establish the connection的问题

    原文链接:https://blog.csdn.net/wohuozheng/article/details/80525094 如果你确定你的监听,服务,使用sql developer能登陆上,但是使用 ...

  2. 在使用DBeaver连接虚拟机上的Oracle数据库时，报错IO 错误: The Network Adapter could not establish the connection The Netw

    在使用DBeaver连接虚拟机上的Oracle数据库时,报错IO 错误: The Network Adapter could not establish the connection The Netw ...

  3. Oracle the network adapter could not establish the connection

    这个问题折腾我时间比较长,网上很多资料都不太适合我的情况.不过最后还是被找到了 花了很多时间在其他方面没有锁定问题根源. 1 开始以为是防火墙 server client端都排除 2 oracle c ...

  4. oracle sql developer 出现 ： 适配器无法建立连接问题解决方案 The Network Adapter could not establish the connection...

    直接上图比较直观 tips one:先看看自己 控制台的 SQLplus 可以登录不 可以直接往下面走 ,如果不可以就现在服务里面找到 Oracle 开头的服务启动就好 实在不会可以百度 注:由于该步 ...

  5. Oracle出现 The Network Adapter could not establish the connection

    错误截图如下 排障 首先确保你的Oracle实例和监听服务是开启的,如下 然后,产生问题的原因就是你的主机名写错了 解决 打开listener.ora文件 D:\SoftwareDevelopment ...

  6. oracle连接报08006,oracle数据库无法连接 The Network Adapter could not establish

    今天在测试的时候,http访问远程应用,却报出500错误. 部署后一直是正常的,后来服务器关闭了一次,就成这样了. 所以问题的可能性集中在服务器的配置环境上,先查看中间件日志,发现如下错误: Caus ...

  7. Oracle数据库操作命令 导入导出数据 实用分区

    使用spool导出: 1).新建spool.sql文件 set colsep , set feedback off set heading off set trimout on spool D:\DB ...

  8. oracle 根据分隔符提取,oracle使用指定分隔符导出数据到文件

    最近有需求要导出一个专业的详单,用于倒入sqlserver系统,要求用分隔符隔开各字段.一开始准备用toad查询出来在save as,但发现表太多,要一张一张表盯着,而且由于详单数据量大,查询导出占用 ...

  9. ORACLE使用DBLINK导入导出数据

    场景: ORACLE数据库A:172.18.169.81:1521/orcl ORACLE数据库B:127.0.0.1:1521/orcl 要将数据库A的所有数据导入到数据库B. 由于数据量极大,所以 ...

  10. zbb20170824 oracle expdp/impdp 导入导出数据

    databasebackup.sh #! /bin/bash#数据库备份echo '###################################################'`date ...

最新文章

  1. 阿里云 centos 6.9 安装 mysql 5.7
  2. Java必须了解的“递归”与“IO流”！！！
  3. python冒泡排序_5种python方法实现冒泡排序可视化：Bubble Sort Visualizer
  4. PAT ---- 1029. 旧键盘(20)
  5. word文档打印 自动编码_职场老油条才知道的3个Word打印技巧，一年能节省几百张打印纸！...
  6. Logisim实验一
  7. Android签名 (二) 制作签名文件
  8. Jtopo对象属性大全
  9. 完美数——C++代码及思路分析 leetcode507
  10. CSS a:hover
  11. 【验证码逆向专栏】某片滑块、点选验证码逆向分析
  12. 淘宝首页链接跳转，非taobao.com域名下的链接处理
  13. 我的世界Mod整合包中的Mod下载
  14. sql子表求和在总表中显示，并参与搜索
  15. HDMI2.0RE驱动控制方案AG7120和AG7220性能参数对比
  16. 神码ai人工智能写作机器人_从云到设备到边缘的人工智能和机器学习的未来
  17. [开源工具]小鸟云虚拟主机+wordpress搭建个人博客(不喜勿喷)
  18. 第二篇 基础篇—燃烧吧！我的雌雄双股剑！ 第5回 二弟呀，面子工程很重要
  19. SQL Server 2012 导出数据及分离MDF、LDF
  20. linux真他X的难搞!!!

热门文章

  1. CSS： 对background: url(“~assets/img/common/collect.svg“) 0 0/14px 14px 的理解
  2. 高速光耦6N137用于RS485通信的总结
  3. C#调用C++类库dll，无法找到函数入口（无法在“***.dll“中找到名为“***“的入口点）
  4. UI设计需要使用哪些软件？推荐这5款
  5. Pwn level题目
  6. oceanbase安装
  7. 最近一段时间的找工作计划
  8. select标签 selected 选中状态动态查询
  9. python 读写pcd
  10. 《远见》的读后感作文1000字范文