设为首页 加入收藏

TOP

Mac下Hive安装和使用
2018-11-29 02:03:10 】 浏览:93
Tags:Mac Hive 安装 使用
版权声明:本文为博主康小小原创文章,转载请声明转载出处:http://blog.csdn.net/u010429286 https://blog.csdn.net/u010429286/article/details/70054118

1.Hive安装

1.1下载

官网下载地址apache.fayea.com/hive/,目前最新版为1.2.2,选择 apache-hive-1.2.2-bin.tar.gz文件下载。

1.2 配置hive-env.sh

解压文件至本地文件夹,进入/conf文件夹,编辑hive-env.sh

# Set HADOOP_HOME to point to a specific hadoop install directory
 HADOOP_HOME=/Users/kk/hadoop/hadoop-2.6.5

# Hive Configuration Directory can be controlled by:
 export HIVE_CONF_DIR=/Users/kk/hadoop/hive-1.2.0/conf

# Folder containing extra ibraries required for hive compilation/execution can be controlled by:
 export HIVE_AUX_JARS_PATH=/Users/kk/hadoop/hive-1.2.0/lib

HADOOP_HOME:Hadoop根目录

HIVE_CONF_DIR:Hive配置文件夹

HIVE_AUX_JARS_PATH:Hive依赖jar包的路径

1.3 配置hive-site.xml

编辑hive-site.xml文件,修改以下参数

 <property>
    <name>hive.exec.scratchdir</name>
    <value>/Users/kangkang/hadoop/warehouse</value>
    <description>HDFS root scratch dir for Hive jobs which gets created with write all (733) permission. For each connecting user, an HDFS scratch dir: ${hive.exec.scratchdir}/&lt;username&gt; is created, with ${hive.scratch.dir.permission}.</description>
  </property>
  <property>
    <name>hive.exec.local.scratchdir</name>
    <value>/Users/kangkang/hadoop/hive-1.2.0/tmp/${user.name}</value>
    <description>Local scratch space for Hive jobs</description>
  </property>
  <property>
    <name>hive.downloaded.resources.dir</name>
    <value>/Users/kangkang/hadoop/hive-1.2.0/tmp/${hive.session.id}_resources</value>
    <description>Temporary local directory for added resources in the remote file system.</description>
  </property>
  ...
  <property>
    <name>hive.metastore.warehouse.dir</name>
    <value>/Users/kangkang/hadoop/warehouse</value>
    <description>location of default database for the warehouse</description>
  </property>
  ...
  <property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>root</value>
    <description>password to use against metastore database</description>
  </property>
  ...
  <property>
    <name>hive.hwi.listen.port</name>
    <value>9999</value>
    <description>This is the port the Hive Web Interface will listen on</description>
  </property>
  ...
  <property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:mysql://localhost:3306/hivedbcreateDatabaseIfNotExist=true&amp;useUnicode=true&amp;characterEncoding=UTF-8&amp;useSSL=false</value>
    <description>JDBC connect string for a JDBC metastore</description>
  </property>
  ...
   <property>
    <name>javax.jdo.option.ConnectionDriverName</name>
    <value>com.mysql.jdbc.Driver</value>
    <description>Driver class name for a JDBC metastore</description>
  </property>
  ...
    <property>
    <name>hive.querylog.location</name>
    <value>/Users/kangkang/hadoop/hive-1.2.0/tmp/${system:user.name}</value>
    <description>Location of Hive run time structured log file</description>
  </property>
  ...

1.4 添加依赖包

拷贝mysql的驱动jar包(mysql-connector-java-5.1.38.jar)到hive的/lib文件夹

拷贝/hive/lib/jline-2.12.jar 文件拷贝至 /hadoop-2.6.5/share/hadoop/yarn/lib/下

创建一个缓存文件夹/hive-1.2.2/tmp/

2.启动Hive

在保证本机mysql服务开启的情况下,启动Hive命令:

bin/hive
bin/hiveserver2

注意:这里是两个服务同时启动

hiveserver2是启动服务,为jdbc的访问提供服务。

3.Hive操作数据

创建表格:

create table table_name(id int primary key, name varchar);

删除表格:

drop table table_name;

查询

select * from table_name where id = 1;

Hive导入文件内容

load data local inpath '/Users/kk/dim_area.txt' into table dim_area;
】【打印繁体】【投稿】【收藏】 【推荐】【举报】【评论】 【关闭】 【返回顶部
上一篇Hive学习之Hive Web接口 下一篇Hive简介、应用场景

最新文章

热门文章

Hot 文章

Python

C 语言

C++基础

大数据基础

linux编程基础

C/C++面试题目