Hi Rayinbeds
Welcome to RootsChat
What else do you have about your grandfather John. Did he die in Scotland? Did he marry your grandmother (do you have her name) to be able to search for a marriage certificate for them?
It's normally better to work back with what you know, so that you can verify information and make sure you are following the right line (specially with Smiths!).
Have you got your mother/father's birth cert. which will include details of parents?
Looking at the 1901 census, there is only one possibility showing for a John with father Andrew and an Inverness-shire birth place:
Andrew Smith 38, Tractior Engine Driver, b. Farres, Morayshire
Jessie Smith 36, b. Boharm, Aberdeenshir
Maggy Smith 14, b. Elgin, Morayshire
William Smith 11, b. Boharm, Banffshire
Jane Smith 8, b. Boharm, Banffshire
Andrew Smith 3, b. Blairgairn, Perthshire
Jassie Ann Smith 3, b. Elgin, Morayshire
John Ellen Smith 6 months, b. Beauly, Invernessshire
Duncan Finlyson 24, Wood Worker & Sawmill, boarder
Rodrick McNeil 25, Wood Worker & Sawmill, boarder
Address: Lonben Wood, Kiltarlity Inverness
The above entry is as transcribed on the census index I am looking at, please don't think it's my bad typing
Monica