Making Hadoop Java process heap larger?

In Hadoop 2.5.0, I use 'ps -aux' and find the Java process has options:

-Xmx1000m

However, my nodes have 32GB memory.

How to make Hadoop Java process heap larger?

asked Sep 18, 2014 by Eric Z Ma (44,280 points)

1 Answer

 
Best answer

In yarn-env.sh, you can find:

# For setting YARN specific HEAP sizes please use this
# Parameter and set appropriately
# YARN_HEAPSIZE=1000

In hadoop-env.sh, you can find:

# The maximum amount of heap to use, in MB. Default is 1000.
#export HADOOP_HEAPSIZE=
#export HADOOP_NAMENODE_INIT_HEAPSIZE=""

So, uncomment them and change them to the required values you want. Restart Hadoop and it will go.

answered Sep 18, 2014 by Eric Z Ma (44,280 points)

Please log in or register to answer this question.

Copyright © SysTutorials. User contributions licensed under cc-wiki with attribution required.
Hosted on Dreamhost

...