Just around the corner from the seaside Village of Simons Town turn left off main road to Boulders Visitor Centre to visit the famous colony of African Penguins - once called Jackass Penguins for their hilarious braying call. This is a truly special experience and Table Mountain National Park staff are knowledgeable and offer guided tours.
After you have fallen in love with the penguins head to the secluded Boulders Beach and take a swim in the comparatively warm waters of the False Bay.
Geolocation
-34° 11' 45.5005", 18° 26' 58.1206"
References

 https://www.capepointroute.co.za/moreinfoOther.php?aID=110