The "washer" is more like a short tube that sits between the two wheel bearings. The washer is smaller in diameter than the inside diameter of the wheel. The washer is made of weak metal.
Using a rod or pipe of sorts, inserted through one of the bearings into the middle of the wheel, you can apply leverage that will bend / deform the washer. This force obviously damages one of the bearings but you are going to trash it anyway. The rod / pipe I used (a video lighting stand) was 5' long stiff steel tube with a solid 5/8" rod on the top. The force was enough to bend the rod, but I was a little frustrated and heavy handed. :yow
Withdraw the pipe and use a flat screwdriver to tap one of the bearings out from the inside. Once the first bearing is out, the second one is much easier to remove.
Do your best to reshape the washer before inserting it back between the two new bearings. Or buy a new one?