The bottom line is what are you going to do if you respond? Aside from CPR, there isn't much a lay person with no equipment can do for a legitimate "man down" call.
It would be hard to justify your response. If you show up and identify yourself as an EMT then you are likely out of Good...