UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 7240: character maps to

Question

I am student doing my master thesis. As part of my thesis, I am working with python. I am reading a log file of .csv format and writing the ext

Answer 1

with open('input.tsv','rb') as f:
for ln in f:
    decoded=False
    line=''
    for cp in ('cp1252', 'cp850','utf-8','utf8'):
        try:
            line = ln.decode(cp)
            decoded=True
            break
        except UnicodeDecodeError:
            pass
    if decoded:
        # use 'line'

Answer 2

i have solved this issue. we can use this code

import codecs
types_of_encoding = ["utf8", "cp1252"]
for encoding_type in types_of_encoding:
    with codecs.open(filename, encoding = encoding_type, errors ='replace') as csvfile:
        your code
        ....
        ....

Answer 3

I have solved this issue by simply adding a parameter in open()

with open(filename, encoding = 'cp850') as csv_file:
    csv_reader = csv.reader(csv_file, delimiter=',')