I usually type :bd
to remove the buffer, however, it results in undesirable side-effect of the window being closed which I do NOT want.
I usually use :bn
(next buffer) followed by :bd#
(delete alternate buffer). You could create a mapping or command for this, of course.
I'm not sure if icecrime's bufclose plugin link is based on the same thing, but the Vim Tips Wiki shows a couple of different approaches via a script. Check them out.
nmap <leader>d :bprevious<CR>:bdelete #<CR>
Works as it should until one buffer is open in several windows. Good enough unless you want to use the bigger scripts out there.
Try kwbdi(Keep Window on Buffer Delete) plugin. Worked well for me.