With my mouse I find it difficult to hit perfect shot. When I see extremely low scores I wonder how that may be possible. At least they have to hit perfect.
As you say the shot may vary even when you hit perfect. That is my experience in real golf too. A perfect shot sometimes ends up as an unlucky shot in real life, so I accept that in the game too. But the variation in length as a fixed yardage +/- is not as in real life. It is really more like a percentage of the distance you try to hit.
But of course, when you aim against the wind, and hit it on the "wind side" of "perfect" and the ball still goes on the other side, something is wrong. But this release is only a beta, so hopefully that will be changed.