Rails 3.2.1
ruby 1.9.3p0 (2011-10-30) [x86_64-linux]
openssl-0.9.8e-20.el5 opens
I had the same problem, but with a different environment. Openssl tool was already installed by default. Ruby 1.9.2p320 was also installed by default at /usr/local and I was using rbenv installing other rubies at a custom location. Using Rails with the rbenv's ruby 1.8.7 and its openssl produced the undefined symbol: d2i_ECPKParameters error.
To fix it, I overrode my system default ruby and installed ruby 1.8.7 to /usr/local and installed its openssl via:
# after installing ruby 1.8.7 to /usr/local
# make sure the recent install ruby 1.8.7 is the default ruby
cd ruby-1.8.7-pXXX/ext/openssl
ruby extconf.rb
make
make install
Then I created a symbolic link from the recent install openssl.so in /usr/local to my rbenv's ruby 1.8.7's lib/ruby/site_ruby/1.8/x86_64-linux/openssl.so
Rails started up with no more d2i_ECPKParameters error.