Remove entries of matrix where both row and column are all zeros

Question

For spectral clustering I am building a small similarity matrix like this:

[0.         0.         0.         0.         0.        ]
[0.         0.         0.