Better text encoding detection based on AI, constraints, expected output

Question

At work, we receive a variety of large text/CSV/flatfiles from different clients with inventory and pricing information in it that need to be imported into our system. We al