Search notes:

Python library: ftfy

ftfy fixes text for you, especially text with broken Unicode.

See also

ftfy was used to clean text for the study of Radford et al. (Improving Language Understanding by Generative Pre-Training)

Index