I was asked that question last week and here is what Wikipedia says:

“Kogarah took its name from Kogarah Bay, a small bay on the northern shore of the Georges River. The suburb originally stretched to the bay but has since been divided up to form the separate suburbs of Kogarah Bay and Beverley Park.”

So now we know.