How should I use BERT for clustering or classification ( for a un-supervised task)

Question

I have multiple types of logs and I want to cluster or classify them I done all this as a supervised problem but the main focus is to deal with this problem as an unsupervis