While in Amsterdam, I always rent a bike for the duration of my stay and lock it to a "staple" (as the bike hitching racks here are called) in front of my hotel. A three-minute pedal away from the busy center puts me in the lazy, scenic and mellow Jordaan district where I always find myself more at ease.
One of the great things about Amsterdam that really separates it as a city is the degree to which its neighborhoods have different personalities. The Jordaan's personality suits me well so it always feel like visiting an old friend, playing catch up or simply playing around.
Follow Rick Steves on Twitter: www.twitter.com/RickSteves