I've looked on net and apparently there have been a few tries by universities in visual basic using the approach that I suggested earlier.
What they do, instead of doning a VR glove as
David89 suggested, is actually use an ordinary glove that is just coloured. I think their programs just searches for that colour and, after calculating, draws the outline, and from that works out the center co-ord of it.
Eyetoy uses a different principle - it takes regular picures of what it can see and anything that changes [i.e your body (as there is no way to not move the slightest) ] is used as a mask and what ever is in that maks gets displayed on screen. In an eyetoy game you can use any part of your body as it makes up the mask and uses that to perform collisons etc. This is often quicker.
In theory this could be used for the idea. If we can set the range for a webcamera then only when your hands enter that range would it register. The only problem would be the sleaves, as they could affect it. However going back to the ordinary glove thing, we could tell it that if it detects a certain colour then it would create the mask from that colour (still quick).
With the mask, you could intheory say that if an object is within the outline on screen then it is being affected by it. e.g you could control a virtual steering wheel and gearstick etc. The gearstick could work by if you put your hand in range and on the gearstick then it would drag with your hand. Once your hand goes out of range then you would no longer be dragging it and it would settle into that gear.
Oh yes,
Kentaree - it would be hard to initially program it, but once the fundamentals are down it should then become easier. This would be especially true if it is put in an addon DLL, as then you could just call up the commands in one go. You could then either develope new commands ones in the DLL or use the ones in the DLL to produce speciallised ones in the user functions in your program.
what do you think? any suggestions and thoughts on how this might be programmed?
RED GENERAL
My computer melts regulary - perhaps it likes being fondue