Turnip Rock
This is near Port Austin, Michigan on Lake Huron. The land is privately owned but you can kayak there.
I don't know who really owns Turnip Rock or what the rules are, but I would guess that trying to climb the rock might be frowned upon. The rock is sandstone and the base has actually been reinforced with? concrete to keep it from falling into the lake.