Create ODPI-Hadoop-Installation.md

Added first Content for ODPi Hadoop installation

Signed-off-by: Robert Wolff <robert.wolff@linaro.org>
This commit is contained in:
Robert Wolff 2016-06-03 11:49:39 -07:00
parent fb7326b0e0
commit dce7bcede0

View file

@ -0,0 +1,82 @@
This post concentrates on installing ODPi components built using Apache BigTop. These steps configure and run the components on a single node.
# Prerequisites:
* Java 7 (e.g. openjdk-7-jre)
# Repo:
ODPi deb and rpm packages can be found on Linaro repositories:
* Debian Jessie - http://repo.linaro.org/ubuntu/linaro-overlay/
* CentOS 7 - http://repo.linaro.org/rpm/linaro-overlay/centos-7/
# Installation :
### On Debian:
Add to repo source list (**not required if you are using the installer from the Reference Platform**):
```shell
echo "deb http://repo.linaro.org/ubuntu/linaro-overlay jessie main" | sudo tee /etc/apt/sources.list.d/linaro-overlay-repo.list
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys E13D88F7E3C1D56C
```
Update the source list and install the dependencies:
```shell
sudo apt-get update
sudo apt-get install openssh-server rsync openjdk-7-jre openjdk-7-jdk
sudo apt-get build-dep build-essential
```
Install Hadoop packages:
```shell
sudo apt-get install -ft jessie bigtop-tomcat bigtop-utils hadoop* spark* hue* zookeeper* hive* hbase* oozie* pig* mahout*
```
### On CentOS:
```shell
sudo wget http://repo.linaro.org/rpm/linaro-overlay/centos-7/linaro-overlay.repo -O /etc/yum.repos.d/linaro-overlay.repo
sudo yum update
sudo yum -y install openssh-server openssh-clients java-1.7.0-openjdk*
sudo yum install -y bigtop-tomcat bigtop-utils hadoop* spark* hue* zookeeper* hive* hbase* oozie* pig* mahout*
```
### Verifying Installation
Packages would get installed in /usr/lib
Type hadoop to check if hadoop is installed:
```shell
hadoop
```
And you should see the following:
```shell
linaro@debian:~$ hadoop
Usage: hadoop [--config confdir] COMMAND
where COMMAND is one of:
fs run a generic filesystem user client
version print the version
jar <jar> run a jar file
checknative [-a|-h] check native hadoop and compression libraries availability
distcp <srcurl> <desturl> copy file or directories recursively
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
classpath prints the class path needed to get the
credential interact with credential providers
Hadoop jar and the required libraries
daemonlog get/set the log level for each daemon
trace view and modify Hadoop tracing settings
or
CLASSNAME run the class named CLASSNAME
```
Most commands print help when invoked w/o parameters.
Next Step: [Setup, Configuration and Running Hadoop](https://github.com/linaro/documentation/wiki/ODPi-BigTop-Hadoop-configuration-and-Running)