why not have a copy of your marriage certificate “authorised” (as a copy of the original) by your Mairie… and carry that with you…
that will show the transition of your name… 
I seem to be in luck… my CdSejour (Withdrawal Agreement) issued by France… does bear both names…
Presumably yours is a more recent version…