Null value for column when selecting using dot or bracket notation but not when using UDF

Question

I\'m trying to clean up some nested data and extract the fields I care about.

My schema for the nested value is:

 |-- maritalstatus: struct (nullable =