Hello there Julie,
I am not sure if you are still persuing this man, but I have done a wee bit of research for you on the William Henry Kemp in Bundaberg so you can perhaps confirm or disregard him.
The obituary for the William Henry Kemp in Bundaberg states that he died on the 18 February 1953 in the Bundaberg General Hospital. It states he came to Australia 67 years ago with 60 of those years in Bundaberg. So that would have him going to Australia in about 1886. It also states that he married Agnes Annie Gerhart and was an Engine Driver for the sugar mills. It names 4 sons and 4 daughters. I will not name them as they may still be alive, although one of his daughters is buried beside him and Agnes is buried with him. It does not mention other family.
Now the burial record gives him as being born in England and his age gives a birth of about 1869.
The death register gives his parents as Henry Kemp & Catherine Young.
That's what I have found in regards to the William Henry Kemp who lived in Bundaberg.
If this turns out to be your man, please PM your email address as I have photographed his stone and his daughters. I also have a copy of the burial register and obituary.
Hoping this is your man
Kind regards,
DropBear