We've been running some of our bigger jobs our MapR cluster and I've been noticing that it's possible for the "Running Map Tasks" count to be greater than Map Task Capacity. How do we make the cluster enforce the capacity?
Thanks in advance for any help that anyone can provide.
asked 27 Apr '12, 10:33
Interesting topic... I've noticed this as well.
sxsnyc, in your real-world tests, have you come to a conclusion of an optimal prefect.maptasks value, or some other sort of general conclusion on the matter? I assume the prefetch feature was introduced to improve performance on map tasks, but I have not played around with the number and benchmarked yet.
answered 13 Jul '12, 12:48