Vanis Kvabebi is a cave monastery near the town of Aspindza, and the famous cave city of Vardzia. The complex dates back to the 8th century, and consists of a defensive wall built in 1204 and a maze of tunnels running on several levels inside the mountain. There are also two churches in the complex. A newer stone church stands near the top of the wall, and a smaller, domed church which clings to the rock.
Vanis Kvabebi contains hundreds of caves carved into the rock on sixteen different floors. On the cave walls of the upper floors, are the remains of the 15th century inscriptions made by women who took refuge here. They transferred fragments taken from ancient Georgian poetry and prose. The date of its construction is unknown, but the architectural style is unique and can hardly be found among other Georgian churches.