Pyspark: Load similar parquets from different directories and combine into one DataFrame with the folder name as a column

Question

I have several parquets in a similar folder structure:

\'/raw-files/17001/result.parquet\'
\'/raw-files/17002/result.parquet\'
\'/raw-files/...../result.parquet\'