@Diggsey - That confuses me even. Sowwy!
If a height map was in colour then you would either get RGB or ARGB or maybe even RGBA, depending on format. Either way, what you are reading in is the values...
A normal height map is RGB or ARGB or RGBA, oh god, back to that again... (other forums for that) Which gives you a value 0-255? Yup...?
RGB is 3 bytes... 3 times the accuracy... (Red, green and blue)
However you are reading the values, if the initial value is the red, then the next is the so on and so on....
Kezzla: RGB = (RED*65536) + (green*256) + blue (You knew that anyway!)
I think accuracy got a bit lost here myself. And if I was doing accurate height maps I would go the same way. (Cheat!)
EDIT: @IanM - You given me an idea there...
Warning! May contain Nuts!