Python: handling a large set of data. Scipy or Rpy? And how?

Question

In my python environment, the Rpy and Scipy packages are already installed.

The problem I want to tackle is such:

1) A huge set of financial data are stored in

Answer 1

Since this has the R tag I'll give some R solutions:

• Overview http://www.r-bloggers.com/r-references-for-handling-big-data/
• bigmemory package http://www.cybaea.net/Blogs/Data/Big-data-for-R.html
• XDF format http://blog.revolutionanalytics.com/2011/03/analyzing-big-data-with-revolution-r-enterprise.html
• Hadoop interfaces to R (RHIPE, etc.)