To quote the instruction leaflet: "In order to obtain the best results do not hold the razor flat against the face, or at right angles to the face."
That said, I do agree it does seem to provide a better shave with the cap flat to skin... It gives me a ton of irritation if I use it any other way (with the modern GEM blades.)