You don't need a massive library to match phone number. It can be done relatively easily using REGEXP. Have added a feature ticket to extend the built in pre-configured REGEXP dropdown with some more options.
forge.joomlapolis.com/issues/7362
If you're not familiar with REGEX the below site is a good tool to help learn as well as quickly test your REGEX.
regexr.com/
Additionally you should be able to use any of the available REGEX sites to find pre-made REGEX.
regexlib.com/
Quick search also finds the below stackoverflow page with a pretty solid example.
stackoverflow.com/a/16699507/2449290
We're also still exploring the possibility of adding support for input masks.