Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Overview

Version 0.5 of IKANOW requires that CDH5 be installed. This will enable applications such as Storm and Spark to be run on the YARN framework.

Unfortunately CDH5 and CDH3 are very non-backwards compatible with one another - therefore CDH5 must be installed before IKANOW v0.5. This is enforced by requiring that hadoop-installer-v0.5 be present before infinit.e-processing-engine-v0.5 can be updated (and hence also infinit.e-interface-engine-v0.5).

This page describes the steps necessary to do this. If installing CDH5 on a new IKANOW install, the "Upgrading from CDH3" step can be ignored.

Upgrading from CDH3

It is not possible to upgrade from CDH3. Instead CDH3 must be removed and then CDH5 installed.

All jobs must be stopped before this occurs - create the empty file "/opt/infinite-home/bin/STOP_CUSTOM" and wait for all jobs to complete in the jobtracker ("ROOT:8090/monitoring/<jobtracker-hostname>/50030/jobtracker.jsp") before continuing.

All files in HDFS that you don't want to lose must be copied off (eg to S3) and then copied back again when the upgrade is complete.

You should check whether you have any scripts that import data into HDFS and turn them off temporarily.

  • No labels