Ok, i might gone a bit far here but i spent almost a hour on this
You could create a (virtual) grid of smaller then the size of the ball. Then create a baseline with small physical dots.
When you move the pointer to a dot, the dot dissapears and new dots are placed on the gridpoints around the pointer.
Placing the pointer in the middle of the earth would just create a circle of dots around the pointer.
Because the grid is smaller then the ball you can use plain physics for the ball to roll around. The smaller the grid the more detailed the movement will be ofcourse
edit:
Sorry the grid is a bit off in the image but you probably get the concept.
edit2:
The dots in game would be invisible but do force physics on the ball. And removing earth could be a parellel painting on an image. So you got the visual and the physical as two seperate.