I would use a cleaning brush, some cleaning solvent and a rag. Use the brush to get the bulky chunks of dirt off, and then wipe it down with a damp rag. Check out <a href="http://bikeride.com/chain-lubrication/">this video</a> for some wipe-down tips.