a few days ago I started to see
Would have removed best_in_place (2.0.2) Would have removed thor (0.16.0)
in my heroku deploy output.
This issue has now been fixed with the release of Bundler 1.3.2, which is now in use on Heroku in the latest official Ruby buildpack.