How to swap smart pointers when one is const

Question

I have the following problem

Buffer buffer1;
Buffer buffer2;

std::unique_ptr hotBuffer;
std::unique_ptr backBuffer;