How to split the large size .txt file data into small portion and insert into database?

Question

Below is my code to read and split the text file content.

  try {

        br = new BufferedReader(new FileReader(\"F:\\\\Test.txt\"));
        final char[] cbuf         


        

Answer 1

 try (Scanner read = new Scanner(new File("/tmp/datafile.txt"));) {
        read.useDelimiter("@");
        while (read.hasNext()) {
            String splitedPacket = read.next();
            System.out.println(splitedPacket);
            // Perform DB Operation
        }
    } catch (FileNotFoundException e) {
        e.printStackTrace();
    }

1. Dont read the entire file.
2. Use Scanner to read and hold only one read @ any give time - to avoid OOM
3. If Possible Perform Db Operation as bulk . If you are running in one transaction, read 1000 records and process as separate bulk insert.