I think you can avoid using intersect object when you simply want to check the terrain / matrix.
If you are interested whether your object is visible from your position and not behind the terrain, then simply "think" a line from your position to the object, and check the ground heights at discrete points. if they are higher than the "line of sight" at this position, the object is hidden. If you manage to reach the object then it is visible. Using the bresenham algorithm for calculating lines using discrete points you will get a pritty fast result I think.
Have a try!