I need a way to do key-value lookups across (potentially) hundreds of GB of data. Ideally something based on a distributed hashtable, that works nicely with Java. It should be
You should probably specify if it needs to be persistent or not, in memory or not, etc. You could try: http://www.danga.com/memcached/