Anyway, I found a bunch of sites that show you how to clean your mats without having to buy special cleaner which I've heard is hard to find at stores. Online you can get it for $10 - $20.
3 Healthy Chicks has instructions on how to deep clean your yoga mat, make a spray cleaner, a lavender spray, and a water/vinegar spray. So lots of options for any budget!!
I also like this post on how to make a yoga mat cleaner spray with a how-to video!