It value constructs the value for a new key. Take a look at some documentation:
A call to this function is equivalent to:
insert(
make_pair(x,T())
);
This will translate into
insert(make_pair("Key", int()));
So yes: your values will be zero at first.