Why is the C# 9.0 “with expression” exclusive to records?

Question

Reading through the spec for C# 9.0 I came across record and the new with expression. Immediately I thought this was great for all my immutable structs, such as