Caverns are the same exact things as caves. You can find them nestled into the wall of Admire Cliff. During high tide they fill up near completely so beware of danger of drowning or being thrown against the damp rock walls by waves. But around are higher levels in which you may climb for safety, or to jump into the water below.
