When to shoot vertical vs when to shoot horizontal?

Camera orientation is way more fun to play with using a Ricoh and LCD screen for framing. I find that you can become fluid with composing shots and determining where to place yourself and the camera.