You might try using SVG instead of canvas. There's a fantastic library called Raphaël that makes working with SVG a breeze. It works in all browsers too, including IE6.
With SVG each shape is its own element that can be moved, transformed, or removed.