The earliest known ancestor of this family is Ramsundar Deo (fl. mid-sixteenth
century) who left his native West Bengal and moved to East Bengal (Bangladesh).
At Serpur, he eventually married the daughter of the ruler of Yasodal.[P12]
Generations later, the family eventually acquired the title of 'majumdar'
(also a surname). Later again, the surname of Ray was adopted.[P12]