Install Pentaho Data Integration (a.k.a. Kettle) in Ubuntu

Tutorial index

• Introduction
• Install Sun Java 6
• Setup java home
• Install Pentaho Kettle
• Setup Pentaho Kettle

Introduction

This is a brief tutorial on how to install Kettle in Ubuntu.

Pentaho Data Integration (a.k.a. Kettle) is a powerful multiplatform, metadata-driven ETL tool, that looks very promising.

I wrote this tutorial for Ubuntu 9.10 "the Karmic Koala", but it should work for other versions also.

Install Sun Java 6

1. First think we need to do is install Sun Java 6. Maybe is already installed in our Ubuntu.
   
   To check if its installed run:
   
   # update-java-alternatives --list
   


2. If you dont have the command update-java-alternatives run:
   
   # sudo apt-get install java-common
   


3. After running update-java-alternatives --list, if Sun Java 6 is already installed you will have a line that starts with java-6-sun as part of the output.
   
   If you dont see the line execute the next command:
   
   # sudo apt-get install sun-java6-bin sun-java6-jre sun-java6-jdk sun-java6-plugin sun-java6-fonts ant
   


4. Select Sun Java 6 as default jre/sdk:
   
   # sudo update-java-alternatives -s java-6-sun
   

Setup java home

1. You also need to setup JAVA_HOME and PATH variable. Open your $HOME/.bashrc configuration:
   
   # gedit $HOME/.bashrc
   
   
2. And add the following lines at the end of the file:
   
   export JAVA_HOME=/usr/lib/jvm/java-6-sun
   export PATH=$PATH:$JAVA_HOME/bin
   

Install Pentaho Kettle 3.2.2

1. For this step you need to have subversion comand line tool installed. If you don't have it run:
   
   # sudo apt-get install subversion
   


2. Create a temporary directory to build kettle:
   
   # mkdir /tmp/kettle_src
   # cd /tmp/kettle_src
   


3. Export Kettle stable source code from the project repository:
   
   # svn export http://source.pentaho.org/svnkettleroot/Kettle/tags/3.2.2/ kettle
   # cd kettle/
   


4. Comment JAVA_HOME on the top of autobuild.sh file.
   
   To do that run:
   
   # gedit autobuild.sh
   


5. And search for the lines:
   
   JAVA_HOME=/usr/java/j2sdk1.4.2_13
   export JAVA_HOME
   


6. And add a character # in front of the 2 lines of the previous item to have something like:
   
   #JAVA_HOME=/usr/java/j2sdk1.4.2_13
   #export JAVA_HOME
   


7. To build Kettle run:
   
   # chmod +x autobuild.sh
   # source $HOME/.bashrc
   # ./autobuild.sh
   


8. In this example we are installing Kettle for your current user in $HOME/opt/kettle, but you can change this location to any location you like.
   
   For example to: /opt/kettle or /usr/local/kettle
   
   # mkdir $HOME/opt
   # mv distrib/ $HOME/opt/kettle
   # chmod +x $HOME/opt/kettle/*.sh
   


9. Remove Kettle source files:
   
   # cd
   # rm -R /tmp/kettle_src
   

Setup Pentaho Kettle

1. Add Kettle directory to PATH variable. To do so open your $HOME/.bashrc file:
   
   # gedit $HOME/.bashrc
   


2. And add the following line at the end of the file:
   
   export PATH=$PATH:$HOME/opt/kettle
   


3. Update terminal environment to read new PATH:
   
   source $HOME/.bashrc
   


4. Now you can run Spoon GUI application executing:
   
   # spoon.sh
   


5. Pan and Kitchen can also be executed running command pan.sh or kitchen.sh.
   

by Jeronimo Albi

Installing Ubuntu 10.04 Desktop with RAID 1 (mirror) Using the Graphic Installer

Last weekend I spend some considerable time trying to install the Lucid Lynx in my computer using RAID 1 and in the end it works :)

To write this how to I’ll be redo the installation using two USB memory sticks as hard drives. The sticks, with 4GB capacity each one, are from different manufacturers but this should not affect the results.

So, let’s start:

1. Boot in the Live CD (or USB) and choose to try without install


2. Using GParted (System -> Administration -> GParted) create the partitions with the sizes you wish. Make sure the partitions you will use in RAID has exactly the same size. The file system type is not important because you will format the RAID array afterwards.


3. Now, using apt-get, the application mdadm (don’t forget to run apt-get update first). That what will manage the array for us.
   
   
   
   • During the installation process postfix (mail server) will also be installed. To configure it just choose Local only and answer the questions of the wizard.


4. That’s an easy but important step, here we are going to create out array. To do that I used the following command:

# mdadm --create /dev/md1 --verbose --level=1 --raid-devices=2 /dev/sdb1 /dev/sdc1

Explainig the command:



• --create is creating the array /dev/md1
• --verbose gives you better idea what’s going on in case you have a problem
• --level=1 sets RAID 1
• --raid-devices=2 is the number of devices we want in the array
• /dev/sdb1 /dev/sdc1 are the devices members of the created array

Executing that command you probably get a message similar to that:

mdadm: /dev/sda1 appears to contain an ext2fs file system
size=3927860K mtime=Thu Jan 1 01:00:00 1970
mdadm: size set to 3909248K
Continue creating array?

Type “yes“ and press enter. Your array should be created.


5. To format the new array with the file system you want use the command line. In the following example I’m using ext4 but it could be ext2, ext3, xfs, etc.

# mkfs.ext4 /dev/md1


6. Open the Ubuntu Installer using the shortcut in the desktop. Choose the language you prefer, the time zone you are located and your keyboard layout. After that you should be in the step 4: Prepare disk space. Choose the last option “Specify partitions manually (advanced)“. Select the RAID array to be used by the mount point you want. In my case I’m using as / (root). Click in forward, configure you user, recheck the information and client in install.


7. Wait until the installation in finished.

The following steps are the most tricky and took me a while to find out the problem. Our new ubuntu installation doesn’t have mdadm installed on it so when you try boot the array can’t be assemble and, obviously, you can’t boot on it. So let’s install mdadm.


8. Mount the installation (and also proc, sys and dev on it) and chroot to the directory:

# mount /dev/md1 /target/
# mount --bind /dev/ /target/dev/
# mount --bind /sys/ /target/sys/
# mount --bind /proc/ /target/proc/
# chroot /target


9. Install mdadm with apt-get (like you did in the step 3):

# apt-get update
# apt-get install mdadm


10. At this point you should be able to boot in your new system, but WAIT! The Ubuntu installer usually install the boot loader (GRUB2) in just one of your disks, if this disk fails you won’t be able to boot your system. To avoid that let’s install it in both disks:

# grub-install /dev/sdb
# grub-install /dev/sdc


11. Reboot your system, remove the CD and enjoy your redundancy. ;)

PS: If you want to check the status of the syncronization of your disc check the file /proc/mdstat

root@ubuntu:/# cat /proc/mdstat
Personalities : [raid1]
md1 : active raid1 sdb1[1] sdc1[0]
3909248 blocks [2/2] [UU]

by seocam - (Sergio Oliveira)

Gloket

YouTube Video 1.
YouTube Video 2.
YouTube Video 3.

Check it out in gloket.net.

By Alex & Joan