He was the son of Louis-Gabriel de Gueulluy, 1st Marquess of Rumigny (1761-1835), created Marquess by Louis XVIII, and Marie-Julie Hatte. His brother was Marie-Théodore Gueilly, vicomte de Rumigny a famous French general, and Aide-de-camp of king Louis Philippe I and his sister was married to viscount Pierre Charles Dejean.