C# RSA Decryption Issue with Smart Card - Padding not removed from the result

Question

I\'m using the RSACryptoServiceProvider to encrypt and decrypt simple strings and while it works with normal certificates, I\'m facing troubles when it comes with smart card