For those with questions from yesterday's post of Waipipi beach, the caves are very shallow. They are made of Papa clay (click for more info) (which makes up much of the New Zealand seacoast) which erodes causing the ground above to become unstable and fall onto the beach--the 'rocks' you see in some of the photos below.
