Hundreds of Cape Town municipal workers who downed tools for a day over allegations of racism will return to work.