The iPhone 3G S documentation indicates that "The icon at the bottom of the Compass screen lets you find your current location in Maps. Maps also takes advantage of the built-in compass to show which way you’re facing."

Initially I couldn't make it work as unfortunately there is no more information presented on how to make that work!

Here's the secret.