Check if file contains multibyte character

问题

I have some subtitle files in UTF-8. Sometimes there are some sporadic multibyte characters in these files which cause problem in some applications.

How do I check in linux (and possibility locate these) if a certain file contains any multibyte character.

回答1:

You can use file command

chalet16$ echo test > a.txt
chalet16$ echo testก >  b.txt #One of Thai characters
chalet16$ file *.txt
a.txt: ASCII text
b.txt: UTF-8 Unicode text

回答2:

You can use file or chardet command.

来源：https://stackoverflow.com/questions/10373258/check-if-file-contains-multibyte-character