yarn.scheduler.minimum-allocation-mb

Hi,

I am submitting an Java Spark job on yarn cluster.

It is throwing error:

Can't allocate enough ram as it outside max allowed.

yarn.scheduler.minimum-allocation-mb

How to solve this?

Thanks

April 26, 2018 at 4:40 AM

Hi,

You should reduce following values during spark submit it:

--driver-memory 1665m \
--driver-cores 2 \
--executor-memory 4g

thanks