Create ODPI-Hadoop-Installation.md
Added first Content for ODPi Hadoop installation Signed-off-by: Robert Wolff <robert.wolff@linaro.org>
This commit is contained in:
parent
fb7326b0e0
commit
dce7bcede0
1 changed files with 82 additions and 0 deletions
|
@ -0,0 +1,82 @@
|
||||||
|
This post concentrates on installing ODPi components built using Apache BigTop. These steps configure and run the components on a single node.
|
||||||
|
|
||||||
|
# Prerequisites:
|
||||||
|
|
||||||
|
* Java 7 (e.g. openjdk-7-jre)
|
||||||
|
|
||||||
|
# Repo:
|
||||||
|
|
||||||
|
ODPi deb and rpm packages can be found on Linaro repositories:
|
||||||
|
|
||||||
|
* Debian Jessie - http://repo.linaro.org/ubuntu/linaro-overlay/
|
||||||
|
* CentOS 7 - http://repo.linaro.org/rpm/linaro-overlay/centos-7/
|
||||||
|
|
||||||
|
|
||||||
|
# Installation :
|
||||||
|
|
||||||
|
### On Debian:
|
||||||
|
|
||||||
|
Add to repo source list (**not required if you are using the installer from the Reference Platform**):
|
||||||
|
|
||||||
|
```shell
|
||||||
|
echo "deb http://repo.linaro.org/ubuntu/linaro-overlay jessie main" | sudo tee /etc/apt/sources.list.d/linaro-overlay-repo.list
|
||||||
|
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys E13D88F7E3C1D56C
|
||||||
|
```
|
||||||
|
|
||||||
|
Update the source list and install the dependencies:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
sudo apt-get update
|
||||||
|
sudo apt-get install openssh-server rsync openjdk-7-jre openjdk-7-jdk
|
||||||
|
sudo apt-get build-dep build-essential
|
||||||
|
```
|
||||||
|
|
||||||
|
Install Hadoop packages:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
sudo apt-get install -ft jessie bigtop-tomcat bigtop-utils hadoop* spark* hue* zookeeper* hive* hbase* oozie* pig* mahout*
|
||||||
|
```
|
||||||
|
|
||||||
|
### On CentOS:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
sudo wget http://repo.linaro.org/rpm/linaro-overlay/centos-7/linaro-overlay.repo -O /etc/yum.repos.d/linaro-overlay.repo
|
||||||
|
sudo yum update
|
||||||
|
sudo yum -y install openssh-server openssh-clients java-1.7.0-openjdk*
|
||||||
|
sudo yum install -y bigtop-tomcat bigtop-utils hadoop* spark* hue* zookeeper* hive* hbase* oozie* pig* mahout*
|
||||||
|
```
|
||||||
|
|
||||||
|
### Verifying Installation
|
||||||
|
|
||||||
|
Packages would get installed in /usr/lib
|
||||||
|
|
||||||
|
Type hadoop to check if hadoop is installed:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
hadoop
|
||||||
|
```
|
||||||
|
|
||||||
|
And you should see the following:
|
||||||
|
|
||||||
|
```shell
|
||||||
|
linaro@debian:~$ hadoop
|
||||||
|
Usage: hadoop [--config confdir] COMMAND
|
||||||
|
where COMMAND is one of:
|
||||||
|
fs run a generic filesystem user client
|
||||||
|
version print the version
|
||||||
|
jar <jar> run a jar file
|
||||||
|
checknative [-a|-h] check native hadoop and compression libraries availability
|
||||||
|
distcp <srcurl> <desturl> copy file or directories recursively
|
||||||
|
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
|
||||||
|
classpath prints the class path needed to get the
|
||||||
|
credential interact with credential providers
|
||||||
|
Hadoop jar and the required libraries
|
||||||
|
daemonlog get/set the log level for each daemon
|
||||||
|
trace view and modify Hadoop tracing settings
|
||||||
|
or
|
||||||
|
CLASSNAME run the class named CLASSNAME
|
||||||
|
```
|
||||||
|
|
||||||
|
Most commands print help when invoked w/o parameters.
|
||||||
|
|
||||||
|
Next Step: [Setup, Configuration and Running Hadoop](https://github.com/linaro/documentation/wiki/ODPi-BigTop-Hadoop-configuration-and-Running)
|
Loading…
Add table
Add a link
Reference in a new issue