HTML and special characters can be used in the choice text, but should not be used in the choice value. This is mentioned on the documentation pages of the choice-based field types:
The submitted value is sanitized, which can remove some HTML and special characters, resulting in it not matching the values of the configured choices. This can result in a validation error.