Pillai had six children, all boys. Karthiyayini Amma, his wife, had a liking for girls and would invite home her nieces, one of whom she eventually adopted. A great lover of dance and music, Karthiyayini Amma made arrangements for the girls to learn dance at Malaya Cottage. Soon many girls from Karthiyayini Amma's extended family joined the music and dance lessons.