The 1940 Census indicates that David, Caroline, and the children were all living in the same house in 1935, indicating either a divorce or death prior to 1935.
Maybe, since the youngest daughter was born ~ 1935, Janet died in childbirth. (sorry, that was 1930, --saw the 5 on the school grade and misinterpreted it as age)