Added first Content for ODPi Hadoop installation Signed-off-by: Robert Wolff <robert.wolff@linaro.org>
82 lines
2.6 KiB
Markdown
82 lines
2.6 KiB
Markdown
This post concentrates on installing ODPi components built using Apache BigTop. These steps configure and run the components on a single node.
|
||
|
||
# Prerequisites:
|
||
|
||
* Java 7 (e.g. openjdk-7-jre)
|
||
|
||
# Repo:
|
||
|
||
ODPi deb and rpm packages can be found on Linaro repositories:
|
||
|
||
* Debian Jessie - http://repo.linaro.org/ubuntu/linaro-overlay/
|
||
* CentOS 7 - http://repo.linaro.org/rpm/linaro-overlay/centos-7/
|
||
|
||
|
||
# Installation :
|
||
|
||
### On Debian:
|
||
|
||
Add to repo source list (**not required if you are using the installer from the Reference Platform**):
|
||
|
||
```shell
|
||
echo "deb http://repo.linaro.org/ubuntu/linaro-overlay jessie main" | sudo tee /etc/apt/sources.list.d/linaro-overlay-repo.list
|
||
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys E13D88F7E3C1D56C
|
||
```
|
||
|
||
Update the source list and install the dependencies:
|
||
|
||
```shell
|
||
sudo apt-get update
|
||
sudo apt-get install openssh-server rsync openjdk-7-jre openjdk-7-jdk
|
||
sudo apt-get build-dep build-essential
|
||
```
|
||
|
||
Install Hadoop packages:
|
||
|
||
```shell
|
||
sudo apt-get install -ft jessie bigtop-tomcat bigtop-utils hadoop* spark* hue* zookeeper* hive* hbase* oozie* pig* mahout*
|
||
```
|
||
|
||
### On CentOS:
|
||
|
||
```shell
|
||
sudo wget http://repo.linaro.org/rpm/linaro-overlay/centos-7/linaro-overlay.repo -O /etc/yum.repos.d/linaro-overlay.repo
|
||
sudo yum update
|
||
sudo yum -y install openssh-server openssh-clients java-1.7.0-openjdk*
|
||
sudo yum install -y bigtop-tomcat bigtop-utils hadoop* spark* hue* zookeeper* hive* hbase* oozie* pig* mahout*
|
||
```
|
||
|
||
### Verifying Installation
|
||
|
||
Packages would get installed in /usr/lib
|
||
|
||
Type hadoop to check if hadoop is installed:
|
||
|
||
```shell
|
||
hadoop
|
||
```
|
||
|
||
And you should see the following:
|
||
|
||
```shell
|
||
linaro@debian:~$ hadoop
|
||
Usage: hadoop [--config confdir] COMMAND
|
||
where COMMAND is one of:
|
||
fs run a generic filesystem user client
|
||
version print the version
|
||
jar <jar> run a jar file
|
||
checknative [-a|-h] check native hadoop and compression libraries availability
|
||
distcp <srcurl> <desturl> copy file or directories recursively
|
||
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
|
||
classpath prints the class path needed to get the
|
||
credential interact with credential providers
|
||
Hadoop jar and the required libraries
|
||
daemonlog get/set the log level for each daemon
|
||
trace view and modify Hadoop tracing settings
|
||
or
|
||
CLASSNAME run the class named CLASSNAME
|
||
```
|
||
|
||
Most commands print help when invoked w/o parameters.
|
||
|
||
Next Step: [Setup, Configuration and Running Hadoop](https://github.com/linaro/documentation/wiki/ODPi-BigTop-Hadoop-configuration-and-Running)
|