Spark / Scala : fill consecutive missing values in a row of a dataframe using preceding and following values

Question

Using Databricks, Spark 3.0.1

To use the legacy format, I have set: spark.conf.set("spark.sql.legacy.timeParserPolicy","LEGACY")