...
Code Block |
---|
#-------------------------------------------------------------------------------
# 1.12] Hadoop properties
#-------------------------------------------------------------------------------
# This limits the number of jobs that can be concurrently submitted to the Hadoop cluster
# by the custom processing engine (other jobs remain at pending until a slot is available)
# There is no default, 10 is recommended as a sensible value until the size of your cluster is known.
hadoop.max_concurrent=10
# If this is set to true then custom (Hadoop) plugins will run locally on this node, without
# a Hadoop cluster needing to be set up (which is complicated to do) - the downside of course is that
# jobs will not scale across many nodes. Set this to true for single-node clusters and before Hadoop
# has been installed.
hadoop.local_mode=false |
1.13 Entity Extractor Properties
...