Scala Read and Filter file that does not meet criteria from AWS S3

Question

i have lots of csv in S3 where i want to load files with total 5 columns and ignore others, the code i do below however read line by line after consolidating files which has per