Ok, looks like it's a bug in CB not respecting the published state value for fields added by plugins. Have added a bug ticket for further investigation.
forge.joomlapolis.com/issues/7465
Note the field can not re-enabled. Certainly not after a Joomla update. Once unpublished or set to not display on profile edit it'll continue to stay that way.