Might be worth searching for neighbours as they might have stayed put, do you have a name of who was living there in say 1871(not 61) as having trouble finding reference.
Cathy 
Update found all years 1841 to 1911 and 1939 Register except 1861 known Missing and 1891 Crugiau House not listed may have been let out and Occupants just listed under Parrish village Rhydyfelin.
In 1881 Cardiganshire, Aberystwyth, District 5, page 52 of 53 Occupant is a Caroline Jones of Lledrod a Farmers Wife aged 46
In 1901 it's an Evan H James aged 50