I have a .csv file with data for different chromosomes. The chromosomes names are stored in the first column(column name: Chr). My aim is to separate the data for each chrom
One way is to read the input file one line at a time and append the line to the correct outfile based on the first x characters of the line:
con <- file('yourInputFile', 'r')
while (length(input <- readLines(con, n=1) > 0){
outputfile <- paste(substr(input, 1, 5), ".csv", sep="" )
### assuming first 5 characters are new file name
outfile <- file(outputfile, 'a')
writeLines(output, con=outfile)
close(outfile)
}
The advantage of this approach is that it works even if yourInputFile is too big to read into memory. The downside is that this approach is slow as it does a lot of opening/closing of files.
Illustrating a one liner using plyr
and the dataset iris
plyr::d_ply(iris, .(Species), function(x) write.csv(x,
file = paste(x$Species, ".csv", sep = "")))
Read Data
fn <- dir(pattern="csv")
data_in <- do.call(rbind,lapply(fn,read.csv))
Split by chromosome
data_out <- split(data_in,data_in[[1]])
Write by chromosome
chn <- unlist(lapply(data_out,"[",1,1))
for(i in seq_along(chn)) write.csv(data_out[[i]],file=paste(chn[i],"csv",sep="."))