The registration of births, changes of name, changes of sex and provision of certificates is the responsibility of the state and territory governments in Australia.
2018 "The Conversation" article by Fiona Kelly and Hannah Robert
Australian Registry of Births, Deaths and Marriages (RBDM) online information and link to State and Territory websites.