Little Bay is a beautiful swimming beach. It's usually flat and might have a gentle roll.
There is a a small cove on the far right of Little Bay (Teeny Bay) which gets cut off by the tide and you may have to come there or back over the rocks (footwear required). A walking track heads up the hill from the middle of the Teeny Bay and offers some stunning views.