I want to start exercising. What are some things to know and where do I start?

I want to do some exercises to start getting my body working. I'd like to work all of my major muscles (torso, arms, legs) and be pretty fit all-over. I vaguely remember that you shouldn't exercise on a full stomach, is that true? What are some other such tips, and what are some good exercise regimens? Thank you!