It might be possible with movies...
I played with this a long long time ago and didn't get very far.
Perhaps instead you look at html and image maps using coordinates across static images in php pages in a web viewer...
If you get your measures and proportions right you can just have a 10x10 grid with a third dimension of height if required. I did this with a recreation park plan once but ended up using the google apis.