I've done this drive quite a few times. Always magnificent once you get out of town and are just hugging the coast. In fact there's a spot not to far up from Leo Carillo there is a turn out and concrete stairs to the bottom where there is a small cove and wonderful picnic and play spot. Its where I proposed to the lovely Mrs September 1988.
Of course half the fun of PCH is driving off into the side canyons. Incredible canyon roads to carve with views that are as unspoiled as when the natives were here alone.
Make the drive. Enjoy a bit of SoCal that few see.