How to split the large size .txt file data into small portion and insert into database?

Question

Below is my code to read and split the text file content.

  try {

        br = new BufferedReader(new FileReader(\"F:\\\\Test.txt\"));
        final char[] cbuf         


        

Answer 1

Your doing it the hard way by not using readLine

    try {
        FileInputStream fis = new FileInputStream("F:\\Test.txt");
        reader = new BufferedReader(new InputStreamReader(fis));          
        String line = reader.readLine();
        while(line != null){

            //process your line here, it's just a String...   

            line = reader.readLine();
        }           

    } catch (FileNotFoundException ex) {
        ...
    } catch (IOException ex) {

Answer 2

 try (Scanner read = new Scanner(new File("/tmp/datafile.txt"));) {
        read.useDelimiter("@");
        while (read.hasNext()) {
            String splitedPacket = read.next();
            System.out.println(splitedPacket);
            // Perform DB Operation
        }
    } catch (FileNotFoundException e) {
        e.printStackTrace();
    }

1. Dont read the entire file.
2. Use Scanner to read and hold only one read @ any give time - to avoid OOM
3. If Possible Perform Db Operation as bulk . If you are running in one transaction, read 1000 records and process as separate bulk insert.