That fresh-off-the-rack feeling may come with dyes, finishing chemicals, and germs picked up along the way.