Ah, was able to duplicate and confirm your issue. Appears to be some sort of bug with having multiple captchas on the same page. It only appears to affect guests however and is probably due to the way it stores captcha code to session. Have created the below bug ticket for further investigation.
forge.joomlapolis.com/issues/3656