Handle duplicates in Structured Streaming Databricks [PySpark]

Question

I am developing an application with Structured Streaming in Databricks in which I would like to control repeated events. So far the application does:

• Reads an XML f