In 1502, Philip, Joanna and a large part of the Burgundian court travelled to Spain to receive fealty from the Cortes of Castile as heirs, a journey chronicled in intense detail by Antoon I van Lalaing (French: Antoine de Lalaing), the Future Stadtholder of Holland and Zeeland. Philip and the majority of the court returned to the Low Countries in the following year, leaving a pregnant Joanna behind in Madrid, where she gave birth to Ferdinand, later Holy Roman Emperor. Although Joanna was deeply in love with Philip, their married life was rendered extremely unhappy by his infidelity and political insecurity, during which time he constantly attempted to usurp her legal birthrights of power. This led in great part to the rumors of her insanity due to reports of depressive or neurotic acts committed while she was being imprisoned or coerced by her husband, rumors that benefited Philip politically. Most historians now agree she was merely clinically depressed at the time, not insane as commonly believed. Before her mother's death, in 1504, husband and wife were already living apart.