Let's also note than there is an huge exodus of British people from some areas in the Eastern Townships (and other rural areas in Quebec) since the 60's. They move to Montreal area or to other provinces.
How acute has this exodus been?
Hard to say. Very variable depending on communities and area (and let's not discount the people who married with French people and had french-speaking kids).
For exemple, pretty much all the Jewish community left rural areas in the 60's for Montreal or other provinces.
The 1976 and 1980 scares had a big effect too (first election of PQ and first referendum) as did the closure of military bases and corporate HQs moving to Toronto. Now, it's old English rural people dying and young adultsmoving to cities and/or other provinces.