yarn.scheduler.minimum-allocation-mb

yarn.scheduler.minimum-allocation-mb

Hi,

I am submitting an Java Spark job on yarn cluster.

It is throwing error:

Can't allocate enough ram as it outside max allowed.

yarn.scheduler.minimum-allocation-mb

How to solve this?

Thanks

View Answers

April 26, 2018 at 4:40 AM

Hi,

You should reduce following values during spark submit it:

--driver-memory 1665m \
--driver-cores 2 \
--executor-memory 4g

thanks

Ads









Related Tutorials/Questions & Answers:
yarn.scheduler.minimum-allocation-mb
yarn.scheduler.minimum-allocation-mb  Hi, I am submitting an Java Spark job on yarn cluster. It is throwing error: Can't allocate enough ram as it outside max allowed. yarn.scheduler.minimum-allocation-mb How to solve

Ads