Following the death of Jean-Baptiste Jérôme de Bruny, the mansion was left to his son Marie-Jean-Joseph who died shortly afterwards in poverty in Rouen, where he had fled persecution from the revolutionaries. His sister, Pauline, inherited the house. Shortly before this, Pauline had married the Marquis de Caumont, Amable Seytres. The residence once again changed names: it was now the Hôtel de Caumont. Upon his marriage, the Marquis famously boasted of ‘having won Provence's most beautiful girl, its most beautiful mansion, and its largest fortune’.