MATLAB division… should 29/128 return 0?

问题

I really don't think this is a precision problem, the answer should be about 0.226. Here's the exact code:

val = I(i,j)
bucketSize    
pos = val / bucketSize

I is just a matrix I'm taking values from. Here is the output from MATLAB:

val =

   29

bucketSize =

   128

pos =

   0

What am I missing?

回答1:

My guess would be that your matrix I is pixel data loaded from an image file, which will have values that are typically unsigned 8-bit integers. As already mentioned, converting both integer values to a double precision value will ensure that MATLAB performs floating point division instead of integer division (which will round off the result).

Converting one value to double precision is insufficient:

For all binary operations in which one operand is an array of integer data type (except 64-bit integers) and the other is a scalar double, MATLAB computes the operation using elementwise double-precision arithmetic, and then converts the result back to the original integer data type.

If you'd like to find out more about the different numeric data types in MATLAB, you can check out this documentation.

回答2:

try:

double(val)/double(bucketSize)

回答3:

I got it, the problem is that my matrix for some reason contained uint8's, not doubles. Just changed val=I(i,j) to val=double( I(i,j) ) and all is well. Thanks.

回答4:

These variables are probably ints rather than doubles or longs. Does 1/2 return .5? Do other operations work?

来源：https://stackoverflow.com/questions/3689575/matlab-division-should-29-128-return-0