http://www.brita.com/us/products/water-pitchers/

There's nothing I like better than a very cold glass of water from the fridge (except maybe a very cold bottle of beer after sundown). But my spouse doesn't like or trust the water coming from our tap. She puts our drinking water in a Brita water filtering pitcher. The result is clear, clean water that tastes great for very low cost. It is free of any funky taste, odor or appearance, and is a helluva lot cheaper than bottled water.

There's lots of good options for turning city water into something that tastes better. Glad to hear Brita is working for you. It's a popular choice and doesn't require any plumbing work...

I've got a fridge that has ice/water in the door, and it's got a built in purifier. I've also got a Seagull water purifier in the sink area.