Is there any option to preserve line breaks within quotation marks when reading multiline CSV files in Spark?
问题 I have some CSV file with line break within quotation marks in third line (first line is CSV header). data/testdata.csv "id", "description" "1", "some description" "2", "other description with line break" Regardless if its correct CSV or not, I must parse it into valid records. That's what I tried public class Main2 { public static void main(String[] args) { SparkSession spark = SparkSession.builder() .master("local[4]") .getOrCreate(); Dataset<Row> rows = spark .read() .format("csv") .option