Try editing their details in the Community Builder User Manager, and, under the Contact Info tab, setting Block User to Yes.
When they try to login they'll get an error message explaining that thier login has been blocked.
(PS, if they're logged in, you might want to log them out first, otherwise they'll still have access to your site).