Yes, at least in Virginia. I would be very surprised if this sort of legal precedent was different in another state, as it applies to loads of different situations that are much more common than ours.
A lawyer I met with had me make a list of everything that has my birth name on it, to include any legal documents (I have a will, some power of attorney documents, etc.). All of these things require a copy of the court order for your name change. Some will need a certified copy, others are fine with a photocopy. I imagine you would need to take them a certified copy. They'll update the records and either amend the original or tie the case number from your name change to your divorce documents.
I had to apply for the name change in the same part of the courthouse than handles marriages and divorces, it would be a good question to ask of a staff person there. As awkward as I felt, the workers at mine were very willing to go back and ask the Clerk of the Court all the questions I had.
