Updating values in apache parquet file

Question

I have a quite hefty parquet file where I need to change values for one of the column. One way to do this would be to update those values in source text files and recreate parqu

Answer 1

You must re-create the file, this is the Hadoop way. Especially if the file is compressed.

Another approach, (very common in Big-data), is to do the update on another Parquet (or ORC) file, then JOIN / UNION at query time.