Postgres query for DISTINCT for either of 2 columns

Question

I have a messages table

messages
 - id
 - from_id
 - to_id
 - text
 - inserted_at

I want to retrieve the last message that was either sent or