The Mtskheta monasteries outside of Tbilisi, an easy daytrip from the city. And also a trip to the David Gareja Monastery, a UNESCO site on the border with Azerbaijan.
The David Gareja Monastery is a UNESCO world heritage site outside of Tbilisi, Georgia. It's just on the border between Azerbaijan and Georgia and has hundreds of caves and old Christian paintings.