Ok so for future reference heres what needs to be done.
In your .gems file you need:
rmagick
and then in your config/environment.rb file you need:
config.gem "rmagick",
:lib => "RMagick"
Because its already preinstalled with heroku - this does the trick.