Why does where soft_delete make the query slower by factor 5?

Question

I have a users table using Laravels Soft Delete which is essentially a null-able deleted_at column. If deleted_at is null, then the user w