You did have the key in and turned on (I think that is required) when you were trying to get the core out of the lock, didn't you?
Not sure about Toyota but others I have taken apart had to have the key.
Also remove it slowly and carefully as sometimes springs and other little parts pop out. I spent a long evening trying to determine where some little pieces went after popping out a lock cylinder one time. I got it and it worked fine - it just took time and scared me at the time. I could see myself having the thing towed to a garage and having to admit I screwed it up.

Randy in Winnipeg