os: ubuntu 16.04
db: postgresql 10.6

pg_bulkload – it provides high-speed data loading capability to PostgreSQL users.

这个插件就是快

版本

# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 16.04.5 LTS
Release:    16.04
Codename:   xenial
#
# su - postgres
$ psql -c "select version();"version
-----------------------------------------------------------------------------------------------------------------PostgreSQL 10.6 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 5.4.0-6ubuntu1~16.04.11) 5.4.0 20160609, 64-bit
(1 row)

下载安装

# su - postgres
$ git clone https://github.com/ossc-db/pg_bulkload.git
$ cd pg_bulkload/
$ git branch -a
$ git checkout VERSION3_1_15

仔细阅读 ~/pg_bulkload/docs/index.html 内附详细说明

此时需要将 pg_store_plans 目录放置到编译通过的PG工程的"…/contrib/"目录下
或者使用 USE_PGXS=1

$ cd ~/pg_bulkload
$ USE_PGXS=1 make all
$ USE_PGXS=1 make install

详细输出日志附后,安装了两个 extension:pg_timestamp,pg_bulkload

$ ls -l /usr/pgsql-10/lib |egrep -Ei "timestamp|bulkload"
-rwxr-xr-x 1 postgres postgres  723520 Apr  3 17:40 pg_bulkload.so
-rwxr-xr-x 1 postgres postgres   29840 Apr  3 17:40 pg_timestamp.so$ ls -l /usr/pgsql-10/share/extension/ |egrep -Ei "timestamp|bulkload"
-rw-r--r-- 1 postgres postgres   590 Apr  3 17:40 pg_bulkload--1.0.sql
-rw-r--r-- 1 postgres postgres   184 Apr  3 17:40 pg_bulkload.control
-rw-r--r-- 1 postgres postgres   530 Apr  3 17:40 pg_bulkload.sql
-rw-r--r-- 1 postgres postgres   267 Apr  3 17:40 pg_bulkload--unpackaged--1.0.sql
-rw-r--r-- 1 postgres postgres   197 Apr  3 17:40 uninstall_pg_bulkload.sql$ ls -l /usr/pgsql-10/share/contrib/ |egrep -Ei "timestamp|bulkload"
-rw-r--r-- 1 postgres postgres 509 Apr  3 17:40 pg_timestamp.sql
-rw-r--r-- 1 postgres postgres 325 Apr  3 17:40 uninstall_pg_timestamp.sql

使用

postgres=# select * from pg_available_extensions where name like '%bulk%';name     | default_version | installed_version |                             comment
-------------+-----------------+-------------------+-----------------------------------------------------------------pg_bulkload | 1.0             |                   | pg_bulkload is a high speed data loading utility for PostgreSQL
(1 row)postgres=# \dxList of installed extensionsName        | Version |   Schema   |                        Description
--------------------+---------+------------+-----------------------------------------------------------plpgsql            | 1.0     | pg_catalog | PL/pgSQL procedural language
(1 rows)postgres=# create extension pg_bulkload;
CREATE EXTENSION
postgres=# \dxList of installed extensionsName        | Version |   Schema   |                           Description
--------------------+---------+------------+-----------------------------------------------------------------pg_bulkload        | 1.0     | public     | pg_bulkload is a high speed data loading utility for PostgreSQLplpgsql            | 1.0     | pg_catalog | PL/pgSQL procedural language
(2 rows)
$ which pg_bulkload
/usr/pgsql-10/bin/pg_bulkload$ pg_bulkload --version
pg_bulkload 3.1.15$ pg_bulkload --help

参考 ~/pg_bulkload/bin/data 下面有相关的文件

$ pg_bulkload -d postgres ~/pg_bulkload/bin/data/bin2.ctl
NOTICE: BULK LOAD START
ERROR: query failed: ERROR:  relation "customer" does not exist
DETAIL: query was: SELECT * FROM pgbulkload.pg_bulkload($1)

需要在 postgres 数据库下创建个 customer 表

$ psql -d postgres -c "create table customer (  \
c_id            CHAR(10), \
c_d_id          CHAR(4), \
c_w_id          CHAR(1), \
c_first         CHAR(16), \
c_middle        CHAR(2), \
c_last          CHAR(16), \
c_street_1      CHAR(90), \
c_street_2      VARCHAR(70), \
c_city          CHAR(90), \
c_state         CHAR(111), \
c_zip           CHAR(9), \
c_phone         CHAR(16), \
c_since         CHAR(19), \
c_credit        CHAR(2), \
c_credit_lim    int4, \
c_discount      int4, \
c_balance       int8, \
c_ytd_payment   float(4), \
c_payment_cnt   float, \
c_delivery_cnt  CHAR(10), \
c_data          CHAR(39) \
) "

再次运行

$ pg_bulkload -d postgres ~/pg_bulkload/bin/data/bin2.ctl
NOTICE: BULK LOAD START
NOTICE: BULK LOAD END0 Rows skipped.10 Rows successfully loaded.0 Rows not loaded due to parse errors.0 Rows not loaded due to duplicate errors.0 Rows replaced with new rows.

参考:
https://github.com/ossc-db/pg_bulkload
~/pg_bulkload/docs/index.html
~/pg_bulkload/docs/pg_bulkload.html

make 日志

postgres@pg10node1:~/pg_bulkload$ USE_PGXS=1 make
make[1]: Entering directory '/home/postgres/pg_bulkload/bin'
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pg_bulkload.o pg_bulkload.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o recovery.o recovery.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pgut/pgut.o pgut/pgut.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pgut/pgut-fe.o pgut/pgut-fe.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pgut/pgut-list.o pgut/pgut-list.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 pg_bulkload.o recovery.o pgut/pgut.o pgut/pgut-fe.o pgut/pgut-list.o  -L/usr/pgsql-10/lib   -Wl,--as-needed -Wl,-rpath,'/usr/pgsql-10/lib',--enable-new-dtags -Wl,--build-id  -L/usr/pgsql-10/lib -lpq -lpgcommon -lpgport -lpthread -lpam -lssl -lcrypto -lgssapi_krb5 -lz -lreadline -lrt -lcrypt -ldl -lm -o pg_bulkload
make[1]: Leaving directory '/home/postgres/pg_bulkload/bin'
make[1]: Entering directory '/home/postgres/pg_bulkload/lib'
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o binary.o binary.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o logger.o logger.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o parser_binary.o parser_binary.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o parser_csv.o parser_csv.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o parser_function.o parser_function.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o parser_tuple.o parser_tuple.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pg_btree.o pg_btree.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pg_bulkload.o pg_bulkload.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pg_strutil.o pg_strutil.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o reader.o reader.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o source.o source.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o writer.o writer.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o writer_binary.o writer_binary.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o writer_buffered.o writer_buffered.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o writer_direct.o writer_direct.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o writer_parallel.o writer_parallel.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pgut/pgut-be.o pgut/pgut-be.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I/usr/pgsql-10/include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pgut/pgut-ipc.o pgut/pgut-ipc.c
( echo '{ global:'; gawk '/^[^#]/ {printf "%s;\n",$1}' exports.txt; echo ' local: *; };' ) >exports.list
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -shared -Wl,--version-script=exports.list -o pg_bulkload.so binary.o logger.o parser_binary.o parser_csv.o parser_function.o parser_tuple.o pg_btree.o pg_bulkload.o pg_strutil.o reader.o source.o writer.o writer_binary.o writer_buffered.o writer_direct.o writer_parallel.o pgut/pgut-be.o pgut/pgut-ipc.o -L/usr/pgsql-10/lib    -Wl,--as-needed -Wl,-rpath,'/usr/pgsql-10/lib',--enable-new-dtags -Wl,--build-id  -L/usr/pgsql-10/lib -lpq -lpthread
sed 's,MODULE_PATHNAME,$libdir/pg_bulkload,g' pg_bulkload.sql.in >pg_bulkload.sql
make[1]: Leaving directory '/home/postgres/pg_bulkload/lib'
make[1]: Entering directory '/home/postgres/pg_bulkload/util'
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -I../include -I. -I./ -I/usr/pgsql-10/include/server -I/usr/pgsql-10/include/internal  -D_GNU_SOURCE -I/usr/include/libxml2   -c -o pg_timestamp.o pg_timestamp.c
gcc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after-statement -Wendif-labels -Wmissing-format-attribute -Wformat-security -fno-strict-aliasing -fwrapv -fexcess-precision=standard -g -O2 -fPIC -shared -o pg_timestamp.so pg_timestamp.o -L/usr/pgsql-10/lib    -Wl,--as-needed -Wl,-rpath,'/usr/pgsql-10/lib',--enable-new-dtags
sed 's,MODULE_PATHNAME,$libdir/pg_timestamp,g' pg_timestamp.sql.in >pg_timestamp.sql
make[1]: Leaving directory '/home/postgres/pg_bulkload/util'

make install 日志

postgres@pg10node1:~/pg_bulkload$ USE_PGXS=1 make install
make[1]: Entering directory '/home/postgres/pg_bulkload/bin'
make[1]: Nothing to be done for 'all'.
make[1]: Leaving directory '/home/postgres/pg_bulkload/bin'
make[1]: Entering directory '/home/postgres/pg_bulkload/lib'
make[1]: Nothing to be done for 'all'.
make[1]: Leaving directory '/home/postgres/pg_bulkload/lib'
make[1]: Entering directory '/home/postgres/pg_bulkload/util'
make[1]: Nothing to be done for 'all'.
make[1]: Leaving directory '/home/postgres/pg_bulkload/util'
make[1]: Entering directory '/home/postgres/pg_bulkload/bin'
/bin/mkdir -p '/usr/pgsql-10/bin'
make[1]: Leaving directory '/home/postgres/pg_bulkload/bin'
make[1]: Entering directory '/home/postgres/pg_bulkload/lib'
/bin/mkdir -p '/usr/pgsql-10/lib'
/bin/mkdir -p '/usr/pgsql-10/share/extension'
/bin/mkdir -p '/usr/pgsql-10/share/extension'
make[1]: Leaving directory '/home/postgres/pg_bulkload/lib'
make[1]: Entering directory '/home/postgres/pg_bulkload/util'
/bin/mkdir -p '/usr/pgsql-10/lib'
/bin/mkdir -p '/usr/pgsql-10/share/contrib'
make[1]: Leaving directory '/home/postgres/pg_bulkload/util'
make[1]: Entering directory '/home/postgres/pg_bulkload/bin'
/bin/mkdir -p '/usr/pgsql-10/bin'
/usr/bin/install -c  pg_bulkload '/usr/pgsql-10/bin'
/usr/bin/install -c -m 755 .//postgresql '/usr/pgsql-10/bin/'
make[1]: Leaving directory '/home/postgres/pg_bulkload/bin'
make[1]: Entering directory '/home/postgres/pg_bulkload/lib'
/bin/mkdir -p '/usr/pgsql-10/lib'
/bin/mkdir -p '/usr/pgsql-10/share/extension'
/bin/mkdir -p '/usr/pgsql-10/share/extension'
/usr/bin/install -c -m 755  pg_bulkload.so '/usr/pgsql-10/lib/pg_bulkload.so'
/usr/bin/install -c -m 644 .//pg_bulkload.control '/usr/pgsql-10/share/extension/'
/usr/bin/install -c -m 644 .//pg_bulkload--1.0.sql .//pg_bulkload--unpackaged--1.0.sql .//uninstall_pg_bulkload.sql pg_bulkload.sql '/usr/pgsql-10/share/extension/'
make[1]: Leaving directory '/home/postgres/pg_bulkload/lib'
make[1]: Entering directory '/home/postgres/pg_bulkload/util'
/bin/mkdir -p '/usr/pgsql-10/lib'
/bin/mkdir -p '/usr/pgsql-10/share/contrib'
/usr/bin/install -c -m 755  pg_timestamp.so '/usr/pgsql-10/lib/pg_timestamp.so'
/usr/bin/install -c -m 644 .//uninstall_pg_timestamp.sql pg_timestamp.sql '/usr/pgsql-10/share/contrib/'
make[1]: Leaving directory '/home/postgres/pg_bulkload/util'

pg_bulkload相关推荐

  1. MogDB秘籍 之 乾坤大挪移

    MogDB秘籍 之 乾坤大挪移 引子 前文"MogDB企业应用 之 七种武器"介绍了MogDB客户端七种驱动,文章末尾提到"除了武器之外MogDB的一些拳脚功夫" ...

  2. PostgreSQL 常用工具

    文章目录 管理/开发工具 备份与恢复 集群和复制 驱动和接口 PostgreSQL 衍生版 PostgreSQL 扩展插件 外部数据库 存储过程相关 管理/开发工具 pgAdmin4,基于 Web 的 ...

  3. 大数据时代,数据实时同步解决方案的思考—最全的数据同步总结

    1. 早期关系型数据库之间的数据同步 1).全量同步 比如从oracle数据库中同步一张表的数据到Mysql中,通常的做法就是 分页查询源端的表,然后通过 jdbc的batch 方式插入到目标表,这个 ...

  4. Sqoop-1.4.5用户手册

    本文以Sqoop User Guide (v1.4.5)为主,对Sqoop-1.4.5的用户手册进行翻译,同时会结合一些实际操作中的注意事项一并写入.由于原文档很长,本文首先会以实际使用到的部分为主, ...

  5. openGauss/MogDB脚本源码浅析(2)—— gs_install_plugin/gs_install_plugin_local

    摘要 MogDB提供了gs_install_plugin/gs_install_plugin_local工具用于安装插件,目前支持安装的插件包括pg_repack.pg_trgm.dblink.wal ...

  6. 两万字讲全数据实时同步方案(附代码及架构图)(建议收藏)

    一.早期关系型数据库之间的数据同步 二.大数据时代下的数据同步 三.总结 一.早期关系型数据库之间的数据同步 1).全量同步 比如从oracle数据库中同步一张表的数据到Mysql中,通常的做法就是 ...

  7. POSTGRESQL COPY 命令导入数据,你还另一个更快的方案!

    POSTGRESQL 数据库数据导入的核心一般都使用COPY 命令,熟悉POSTGRESQL 的同学应该对这个命令不陌生,相对于MYSQL 去一条条的执行insert命令来说,COPY 命令是POST ...

  8. 两万字讲全数据实时同步方案

    kettle 插入更新 数据增量_两万字讲全数据实时同步方案(附代码及架构图)(建议收藏)..._陌念念的博客-CSDN博客 一.早期关系型数据库之间的数据同步 二.大数据时代下的数据同步 三.总结 ...

  9. sqoop-使用文档

    该项目已退役.详情请参阅其 阁楼页面. 文档主页 Sqoop 用户指南 (v1.4.7) Sqoop 用户指南 (v1.4.7) 目录 一.简介 2. 支持的版本 3. Sqoop 发布 4. 先决条 ...

最新文章

  1. Coursera课程Python for everyone:Quiz: Reading Web Data From Python
  2. html日期写入数据库,javascript – 在HTML5 Web SQL数据库中对日期时间进行排序
  3. LiveVideoStackCon 2018社区编辑门票兑换启动
  4. python和C语言分别实现插入排序
  5. PHP数组加表格_php数组输出html表格的操作方法
  6. 实现Parcelable接口
  7. win7 'IIS APPPOOL\Classic .NET AppPool' 登录失败
  8. 前端学习(2182):keep-alive及其他问题
  9. OpenCV辅助对象(help objects)(6)_InputArray和OutputArray
  10. Java 面向对象:多态的理解
  11. 数据 3 分钟 | Oracle 首度失去榜首位置、PingCAP 发布 TiDB 荣耀体验官活动、华为召开开发者大会 2021
  12. 使用构造方法注入和setter注入的配置文件
  13. BCH码(BCH code)详细分析
  14. 运维排查篇 | 访问nginx出现403错误
  15. 二本学历,3年软件测试点点点,25K入职阿里巴巴
  16. Android 隐藏虚拟按键
  17. MTL多目标学习介绍综述等
  18. idea怎么设置热启动
  19. Android设置网络访问权限
  20. 湛蓝代码自动生成工具有感

热门文章

  1. Linux命令之ssh基本用法
  2. GeoServer 图层访问控制身份验证
  3. RocksDB 架构
  4. Node入门 (转载)--个人觉得写的不错,赞!
  5. 21、22、23、53、80、123、161、1433、3306、3389 端口的用途或协议
  6. 《数据库应用系统实践》------ 超市管理系统
  7. 简单易懂 LNMP 架构详解适合入门级别可跟做
  8. 从零开始的Android:Android应用程序开发概述
  9. 信号与系统(二):拉普拉斯变换的意义:谈H(s)、h(t)、δ(t)
  10. Windows11原版镜像