Mithraic temple caves would be the best, but they're hard to find, so let's visit some other ones we can tour.
Damlataş: Literally "dripping stone", which is very well illustrated in the picture on the right. It's located near Damlataş Beach and is the most accessible cave.
Phosphorescent cave is supposedly quite beautiful, if you can get to it with a small boat. Then there's Pirate's Cave (left). You need a boat for this one too- and if you're a pirate, you might like to hide yours in there. :) However, nearby Lover's Cave is known as the place where pirates kept their loot.
Lots of boat tours follow the coastline, allowing people to swim in and out of the caves along the way. Pretty cool, but I just hope all the tourism doesn't wind up ruining the place.