hive> select *
> from t441;
OK
30 beijing dongdong man
40 shanghai lisi woman
Time taken: 0.078 seconds
hive> desc formatted t441;
OK
# col_name data_type comment
id int None
city string None
name string None
sex string None
# Detailed TableInformation
Database: fdm
Owner: root
CreateTime: Mon May 0109:09:36 PDT 2017
LastAccessTime: UNKNOWN
ProtectMode: None
Retention: 0
Location: hdfs://hadoop:9000/warehouse/fdm.db/t441
Table Type: MANAGED_TABLE
从上面我们可以获取到旧表的Location。
而后我们在获取新表的Location。
hive> desc formatted t444;
OK
# col_name data_type comment
id int None
city string None
name string None
sex string None
# Detailed TableInformation
Database: fdm
Owner: root
CreateTime: Mon May 0109:56:57 PDT 2017
LastAccessTime: UNKNOWN
ProtectMode: None
Retention: 0
Location: hdfs://hadoop60:9000/warehouse/fdm.db/t444
Table Type: MANAGED_TABLE
最后我们进行拷贝数据操作:
[root@hadoop local]# hadoop distcp -update -skipcrccheck hdfs://hadoop:9000/warehouse/fdm.db/t441 hdfs://hadoop60:9000/warehouse/fdm.db/t444 ; 17/05/0110:09:10 INFO tools.DistCp: srcPaths=[hdfs://hadoop:9000/warehouse/fdm.db/t441]
17/05/0110:09:10 INFO tools.DistCp: destPath=hdfs://hadoop60:9000/warehouse/fdm.db/t444
17/05/0110:09:10 INFO tools.DistCp: sourcePathsCount=217/05/0110:09:10 INFO tools.DistCp: filesToCopyCount=117/05/0110:09:10 INFO tools.DistCp: bytesToCopyCount=47.017/05/0110:09:11 INFO mapred.JobClient: Running job: job_201705010710_0010
17/05/0110:09:12 INFO mapred.JobClient: map 0% reduce 0%
17/05/0110:09:17 INFO mapred.JobClient: map 100% reduce 0%
17/05/0110:09:17 INFO mapred.JobClient: Job complete: job_201705010710_0010
17/05/0110:09:17 INFO mapred.JobClient: Counters: 2217/05/0110:09:17 INFO mapred.JobClient: Map-Reduce Framework
17/05/0110:09:17 INFO mapred.JobClient: Spilled Records=017/05/0110:09:17 INFO mapred.JobClient: Virtual memory (bytes) snapshot=28937420817/05/0110:09:17 INFO mapred.JobClient: Map input records=117/05/0110:09:17 INFO mapred.JobClient: SPLIT_RAW_BYTES=15217/05/0110:09:17 INFO mapred.JobClient: Map output records=017/05/0110:09:17 INFO mapred.JobClient: Physical memory (bytes) snapshot=3879731217/05/0110:09:17 INFO mapred.JobClient: Map input bytes=13017/05/0110:09:17 INFO mapred.JobClient: CPU time spent (ms)=13017/05/0110:09:17 INFO mapred.JobClient: Total committed heap usage (bytes)=1625292817/05/0110:09:17 INFO mapred.JobClient: distcp
17/05/0110:09:17 INFO mapred.JobClient: Bytes copied=4717/05/0110:09:17 INFO mapred.JobClient: Bytes expected=4717/05/0110:09:17 INFO mapred.JobClient: Files copied=117/05/0110:09:17 INFO mapred.JobClient: File Input Format Counters
17/05/0110:09:17 INFO mapred.JobClient: Bytes Read=23017/05/0110:09:17 INFO mapred.JobClient: FileSystemCounters
17/05/0110:09:17 INFO mapred.JobClient: HDFS_BYTES_READ=42917/05/0110:09:17 INFO mapred.JobClient: FILE_BYTES_WRITTEN=5378617/05/0110:09:17 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=4717/05/0110:09:17 INFO mapred.JobClient: File Output Format Counters
17/05/0110:09:17 INFO mapred.JobClient: Bytes Written=017/05/0110:09:17 INFO mapred.JobClient: Job Counters
17/05/0110:09:17 INFO mapred.JobClient: Launched map tasks=117/05/0110:09:17 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=017/05/0110:09:17 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=017/05/0110:09:17 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=493917/05/0110:09:17 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
我们随后查看一下数据:
hive> select *
> from t444;
OK
30 beijing dongdong man
40 shanghai lisi woman
Time taken: 0.069 seconds