I can\'t use boost:hash because I have to stick with C and can\'t use C++.
But, I need to hash a large number (10K to 100k) of tokens strings (5 to 40 bytes length) so t
You can find a good (and fast) hash function, and an interesting read, at http://www.azillionmonkeys.com/qed/hash.html
The only time you should not check for collisions, is if you use a perfect hash -- a good old fashioned lookup table, like gperf.
xxhash is quite fast and easy option. A simple code would use XXH32
function:
unsigned int XXH32 (const void* input, int len, unsigned int seed);
It is 32 bit hash. Since len
is int
, for larger data more than 2^31-1
bytes use these:
void* XXH32_init (unsigned int seed);
XXH_errorcode XXH32_update (void* state, const void* input, int len);
unsigned int XXH32_digest (void* state);
Here is a nice overview of the most notable known hash functions.
32bits should work just fine.
You always need to check for collisions, unless you want to write a funny hashtable :)
A general hash function for hash table lookup. It specifies Do NOT use for cryptographic purposes, but since you specified that you have no intent for that then you should be ok.
It Included is A Survey of Hash Functions to try out
If you're on a posix alike system and sticking to plain C, I would simply use what the system already has to offer. man 3 hcreate offers you all details or you can find an online version here http://linux.die.net/man/3/hcreate
Try Adler32 for long strings or Murmur2 for short strings.