Barb has his birth year as 1811.
Listed as a farmer in the 1851 census. Lived in Fitzroy, Carleton County at the time. There is a John Story, listed as age 71, in the same area, in the 1881 census (wife Jane, sons John,Samuel,David,George and Milton, and daughters Katherine and Jane). Note that my original notes had his wife as Jane being born in 1825 in Ireland, and the 1881 census has his wife Jane as being born in 1827 in Ireland. Also, original info had Margaret, Sarah and John as kids, with John born in 1849, which also matches the 1881 census, so this is probably the right family.
Listed in the 1871 census as a 60 year old farmer in division 3 of Fitzroy.
1881 census has one child not at home (Margaret). She may have been married by this time.
1891 census he is 80 in Fitroy, North Lanark. Living with wife Jane, and kids John, Catherina, Jane, David, George and Milton (all but Milton are sons/daughters... Milton is listed as a grandson).