Practice with what you're really going to carry most of the time. My CCW only allows a maximum of 3 pistols. Therefore I have a Glock 23, a Glock 27, and my 1911. I carry my Glocks most of the time. I'm familiar enough with my listed firearms that I can tell which one I have just by feel. When I'm carrying my 1911, the manual of arms is automatic and I'll click off the safety at a certain point in the draw. When I'm carrying a Glock, I know by feel it isn't my 1911, so I don't search for the safety.
As far as accuracy goes, I'm good enough that I can keep rounds on target at distances less than 25 yards quite reliably. What stops a fight instantly? CNS hits. What takes time? Hits anywhere else. What's seriously difficult to do in a fight? Aim well enough to get CNS hits. So, shoot center of mass and be ready for physical combat because all too often people that are mortally wounded don't know it until they've collapsed. Another fight stopper is a mobility hit. If you end up busting the pelvic ring, standing is impossible.
In any event, handguns are notoriously unreliable at causing mortal wounds. This makes shot placement absolutely key. Placing shots accurately while under stress is also notoriously difficult, but it is easier to do with rifles. I'm not going to be able to conceal a rifle or carry it well, therefore I go with what I will carry...
Also, fortunately I'm pretty recoil insensitive, so pretty much anything in the 9mm-45ACP range in a semi-auto pistol doesn't bother me. Even full-house 10mm loads don't bother me much. I do feel the differences in recoil between the various loads, but it really just doesn't bother me. Interestingly enough, 185gr JHP rounds out of my 1911 tend to feel a bit snappy, much like the 180gr loads in 40S&W. I don't feel a 9mm is a bad choice and I'd carry one. I just haven't found one that I like yet.
As an old instructor of mine used to say: "Speed is fine but Accuracy is final."