South African retailer Massmart said on Thursday it had decided to close all of its non-performing stores.