Overview
Version 0.5 of IKANOW requires that CDH5 be installed. This will enable applications such as Storm and Spark to be run on the YARN framework.
Unfortunately CDH5 and CDH3 are very non-backwards compatible with one another - therefore CDH5 must be installed before IKANOW v0.5. This is enforced by requiring that hadoop-installer-v0.5 be present before infinit.e-processing-engine-v0.5 can be updated (and hence also infinit.e-interface-engine-v0.5).
This page describes the steps necessary to do this. If installing CDH5 on a new IKANOW install, the "Upgrading from CDH3" step can be ignored.
This documentation describes how to get set up with MRv1 running under CDH5.
The IKANOW platform is not currently compatible with YARN - but moving between MRv1 and YARN requires no significant re-installation, just shutdown MRv1 and start YARN in the Cloudera Manager.
Upgrading from CDH3
It is not possible to upgrade from CDH3. Instead CDH3 must be removed and then CDH5 installed.
All jobs must be stopped before this occurs - create the empty file "/opt/infinite-home/bin/STOP_CUSTOM" and wait for all jobs to complete in the jobtracker ("ROOT:8090/monitoring/<jobtracker-hostname>/50030/jobtracker.jsp") before continuing.
All files in HDFS that you don't want to lose must be copied off (eg to S3) and then copied back again when the upgrade is complete.
You should check whether you have any scripts that import data into HDFS and turn them off temporarily.
To uninstall CDH3 TODO
Installing CDH5 (MRv1)
TODO
Installing CDH5 (YARN)
TODO