Setup Single-Node(Standalone) Hadoop

* Prerequisite

- Ubuntu Linux 11.10

1. JDK 1.6, must be installed

- download JDK   ( http://www.oracle.com/technetwork/java/javase/downloads/index.html , 32bit, tar.gz )

- uncompress JDK

$  tar xvf jdk-7u3-linux-i586.tar.gz

- move the JDK directory

$ sudo mv ./jdk1.7.0_03 /usr/lib/jvm/jdk1.7.0

- Create symbolic link for java

$ sudo update-alternatives --install "/usr/bin/java" "java" "/usr/lib/jvm/jdk1.7.0/bin/java" 1

$ sudo update-alternatives --install "/usr/bin/javac" "javac" "/usr/lib/jvm/jdk1.7.0/bin/javac" 1

$ sudo update-alternatives --install "/usr/bin/javaws" "javaws" /usr/lib/jvm/jdk1.7.0/bin/javaws" 1

- Configure basic java

$ sudo update-alternatives --config java

$ sudo update-alternatives --config javac

$ sudo update-alternatives --config javaws

- Confirm java version

$ java -version

$ javac -version

- Set up a mozilla plugin

$ ln -s /usr/lib/jvm/jdk1.7.0/jre/lib/i386/libnpjp2.so ~/.mozilla/plugins/

2. Installing Software

- install ssh 

$ sudo apt-get install ssh

- install rsync

$ sudo apt-get install rsync

3. Install the newest Hadoop distribution

- download Hadoop ( http://www.apache.org/dyn/closer.cgi/hadoop/common/ , 1.0.2, tar.gz )

- Uncompress

$ tar xvf hadoop-1.0.2.tar.gz

- Move directory

$ mv ./hadoop-1.0.2~/hadoop

- Edit JAVA_HOME environment 

$ vi ~/hadoop/etc/hadoop-env.sh

- Try the Hadoop 

$ cd ~/hadoop

$ bin/hadoop

- Confirm the Hadoop version

$ bin/hadoop version

4. Standalone Operation

- Prepare input files and Start the Hadoop

$ mkdir input

$ cp conf/*.xml input

$ bin/hadoop jar hadoop-examples-1.0.2.jar grep input output 'dfs[a-z.]+'

- Confirm result

$ cat output/*

Configure MagicMouse, Magic TrackPad and Macbook Trackpad

Almost alway mac users use the magic mouse or the magic trackpad. All users who have the macbook also use the magic trackpad. but I can tell you what is the mouse uncomfortable than the windows, It is that can't use a middle button of mouse. Than Mac OS X, provides an introduction to one of the required application.

MagicPrefs (Version 2.3.2 ) - http://magicprefs.com/

Mac OS X Lion(10.7) compatible to the support can be used without problems. If the first run, you can view the screen shown below.

System Preferences is also added the setting icon.

Click below for each device can set your own.

Installing Ubuntu using VirtualBox on MacOSX

It is a how-to document to install Ubuntu linux on the Mac OS X using Oracle's VirtualBox.
If you manage some operating systems, you should clean up how-to the document.

Prerequisites :
  - Mac OS X 10.7.3 (Mac bundle)
  - Oracle VirtualBox 4.1.12 ( https://www.virtualbox.org/wiki/Downloads )
  - Ubuntu desktop i386 11.10 ISO file ( http://www.ubuntu.com/download/ubuntu/download )

1. Running VirtualBox than make new virtual machine and insert Ubuntu desktop i386 ISO file to DVD(CD)-ROM.

2. Starting the virtual machine which you made, so Ubuntu is run to install.
 
3. (Optional) If you have a japanese keyboard, you should set Japanese-Japanese on the keyboard layout window.

4. Updating Ubuntu software after installing Ubuntu is ended.

5. Set applications as the Terminal application in the left panel.

Package Management

 

You’ll install many times on Ubuntu server when testing. Then you should memorize commands which is package management software. Try to clean up.

a dpkg is the software of the base of the debian package management system. It is used to install, remove and provide information about .deb package. An APT is a higher tool than the dpkg.

Java Language

I haven’t used Java language for a few years, but I need to it now.

I adjusted it by mind map.

Mac OS X + Eclipse + Java

I tried to organize information about how to install eclipse on the mac.

It's very simple, but I'll continue to organize.

1. Running the Terminal.app. Then to check a version. (Version higher then 1.6)

2. Running the Safari.app. Then to access an Eclipse website. (http://www.eclipse.org/)

3. Downloading the latest Eclipse. (Eclipse IDE for Java Developers, 32bit)

4. Moving download file to desktop area.

5. Double-Click to restore an archive file.

6. Verifying an eclipse directory which was completed restoring.

7. Moving an eclipse directory to Application area.

8. Copying a Eclipse.app to dock area for easy running.

9. Running an eclipse.

10. Verifying an eclipse display.

11. Setting an eclipse preferences.

 

What's NoSQL?

NoSQL is a DBMS(DataBase Management System). They typically scale horizontally. NoSQL and leading softwares was expressed as a simple image below.

Memcached : http://memcached.org/

Apache Cassandra : http://cassandra.apache.org/

MongoDB : http://www.mongodb.org/

Apache CouchDB : http://couchdb.apache.org/

How is scalability achieved?

Vertical scalability(Scale-Up) is adding more memory and CPUs to a single box, or scaling up. Vertical scalability or scaling up is well suited for database tier.

Horizontal scalability(Scale-Out) is adding more boxes of similar memory and CPU, or scaling out. Scale out is ideal for web-tier.

What is big data?

Big Data, You feel like represented as an image.