Augmented virtuality(AV) is a kind of technology which can be used to describe very complex models and accelerate rendering with images based modeling and rendering(IBMR) under the framework of graphics based modeling and rendering(GBMR). It can decrease the conflict between realism display and real-time rendering in virtual reality. The major work about augmented virtuality was classified into three categories according to the proportion of geometric information in the scene image objects, with no geometry, implicit geometry and using IBMR to accelerate rendering. Some representative work in these categories was surveyed and compared to the theory,method,process. Five problems in future research were provied and possible way to solved them were present.