设为首页 加入收藏

TOP

hive排序特性研究(四)
2014-11-24 07:25:19 来源: 作者: 【 】 浏览:3
Tags:hive 排序 特性 研究
05 17:15:38,244 Stage-1 map = 0%, reduce = 0%
2013-08-05 17:15:40,258 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:41,269 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:42,275 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:43,281 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:44,286 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:45,292 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:46,298 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:47,305 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.3 sec
2013-08-05 17:15:48,311 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 3.07 sec
2013-08-05 17:15:49,317 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 3.07 sec
2013-08-05 17:15:50,323 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 3.07 sec
MapReduce Total cumulative CPU time: 3 seconds 70 msec
Ended Job = job_201307151509_15434
MapReduce Jobs Launched:
Job 0: Map: 1 Reduce: 1 Cumulative CPU: 3.07 sec HDFS Read: 559 HDFS Write: 72 SUCCESS
Total MapReduce CPU Time Spent: 3 seconds 70 msec
OK
1 121212
2 131313
3 141414
4 151515
5 161616
6 171717
8 191919
8 191919
Time taken: 15.969 seconds
---开启hive.mapred.mode为strict模式
hive> set hive.mapred.mode=strict;
hive> select * from tb_in_base order by devid; //注:测试set hive.mapred.mode=strict;是否生效
FAILED: Error in semantic analysis: 1:34 In strict mode, if ORDER BY is specified, LIMIT must also be specified. Error encountered near token 'devid'
---开启hive.mapred.mode为strict模式,查询时未指定分区
hive> select * from tb_in_base sort by devid;
FAILED: Error in semantic analysis: No partition predicate found for Alias "tb_in_base" Table "tb_in_base"
---开启hive.mapred.mode为strict模式,查询时指定分区
hive> select id,devid,job_time from tb_in_base where job_time=030729 sort by devid;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks not specified. Estimated from input data size: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=
In order to set a constant number of reducers:
set mapred.reduce.tasks=
Starting Job = job_201307151509_15438, Tracking URL = http://mwtec-50:50030/jobdetails.jsp jobid=job_201307151509_15438
Kill Command = /home/hadoop/hadoop-0.20.2/bin/hadoop job -Dmapred.job.tracker=mwtec-50:9002 -kill job_201307151509_15438
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2013-08-05 17:22:02,631 Stage-1 map = 0%, reduce = 0%
2013-08-05 17:22:05,645 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.89 sec
2013-08-05 17:22:06,651 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.89 sec
2013-08-05 17:22:07,656 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.89 sec
2013-08-05 17:22:08,662 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.89 sec
2013-08-05 17:22:09,668 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.89 sec
2013-08-05 17:22:10,673 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 0.89 sec
2013-08-05 17:22:11,679 Stage-1 map = 100%, reduce
首页 上一页 1 2 3 4 5 6 7 下一页 尾页 4/10/10
】【打印繁体】【投稿】【收藏】 【推荐】【举报】【评论】 【关闭】 【返回顶部
分享到: 
上一篇Redis批量导入数据 下一篇如何优化单表大批量数据提取插入..

评论

帐  号: 密码: (新用户注册)
验 证 码:
表  情:
内  容:

·Libevent C++ 高并发 (2025-12-26 00:49:30)
·C++ dll 设计接口时 (2025-12-26 00:49:28)
·透彻理解 C 语言指针 (2025-12-26 00:22:52)
·C语言指针详解 (经典 (2025-12-26 00:22:49)
·C 指针 | 菜鸟教程 (2025-12-26 00:22:46)