The mushrooms seem to grow larger towards the center of the island (from the tiniest thing to the size of a (European) football), and there is one especially big one (this one about the size of a car) at the center of the whole thing. It'd take him a number of scouting trips to happen upon that center mushroom though.