Yeah my TO isn't notched, looks like I have the right TO bearing.
Glenn brought up a good point that I had thought of but dismissed earlier: the pilot bushing needed breaking in.
I set the rear wheels back down on the ground, started it up in neutral and could not get it into gear for the life of me. Shut it off and put it in 1st, started it back up and the engine bogged like hell, had trouble getting it out of first. Started it it in neutral again and shoved it into first, engine bogged some more then cleared up after a few seconds.
Now with the wheels on the ground I am able to get in/out of all the gears easily. It still spins the driveshaft a little in neutral while up on stands, but I am still able to get in/out of gear easily. Looks like the fork/slave/TO movement was all fine, just needed to "break in" that new pilot bushing!
I'll report back if I have any issues on the first test drive, need to re-mount my rad and hook the brakes back up before I do...