That roll pin has to come out, sometimes they do not want to move but the roll pin in that is a lot easier to remove than the pin in a 320 pumpkin/gearset, they are solid pins and are a BITCH to get out(they come out shaped like a banana), I normally use as large a nail that will fit in the hole with the end ground flat, I just keep tapping away till it starts moving, a good punch made out of harder metal should work WAY better than a nail. an old drill bit might also work.
You cannot use it the way it is, what will happen is the hole that the pin is still in holding that center block in will start to oval, once that happens the whole thing is garbage, I had that pin break on my C200 dually axle and it destroyed the carrier, lucky for me the C200 carrier in the late 4wd Nissan 720 is the same thing and I was able to fix my dually axle with them parts.
Just keep tapping away at that roll pin till it starts moving, I have bent a few large nails over the years but have always got that pin out.
I am sure it would be easier to just buy another pumpkin/gearset, but it will likely cost a lot for shipping.