🌀 技术人生
凡事有交代,件件有着落,事事有回音
Sqoop导入数据到HDFS的一些常用设置

/*只导入表中数据的某些列 bin/sqoop import \ –connect jdbc:mysql://192.168.83.112:3306/test \ –username root \ –password root \ –table student \ –target-dir /user/root/sqoop/import/student \ –num-mappers 1 \ –columns id,username

/*对要导入的mysql中的数据加上where条件

bin/sqoop import \ –connect jdbc:mysql://192.168.83.112:3306/test \ –username root \ –password root \ –table student \ –target-dir /user/root/sqoop/import/student \ –where “passwd=‘admin’” \ –num-mappers 1

/*使用query进行数据过滤

bin/sqoop import \ –connect jdbc:mysql://192.168.83.112:3306/test \ –username root \ –password root \ –query ‘select id,passwd from student where $CONDITIONS’ \ –target-dir /user/root/sqoop/import/student \ –num-mappers 1

/*文件的存储格式(parquetfile avrodatafile textfile)

默认的是textfile bin/sqoop import \ –connect jdbc:mysql://192.168.83.112:3306/test \ –username root \ –password root \ –table student \ –target-dir /user/root/sqoop/import/student \ –where “passwd=‘admin’” \ –num-mappers 1 \ –as-parquetfile

/*压缩格式

bin/sqoop import \ –connect jdbc:mysql://192.168.83.112:3306/test \ –username root \ –password root \ –query ‘select id,passwd from student where $CONDITIONS’ \ –target-dir /user/root/sqoop/import/student \ –num-mappers 1


最后修改于 2018-07-16

知识共享许可协议
本作品采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。