I don't see any inserts on the new bearing - all I see is an inner and outer race with a metal seal for the ball bearings.

I don't have a photo of mine in bits but all I did was turn the bearing over and knock the insert out. If your insert is actually an integral part of the bearing case then it is of a type I have never seen before and I can't help. Have you got a photo from the back?