A RequiredFieldValidator only checks if the field is filled in. It doesn't care what with.
You will need an extra CompareValidator with it's Operator set to DataTypeCheck and it's Type set to Integer.
Note you need both: the CompareValidator will ignore an empty input.