Addressing the Army side only...
For SF, do a web search on SFAS and "Special Forces" - I know of at least one SF unit that has its training program for SFAS candidates up online. The actual "physical requirements" to get into SFAS or the Q Course aren't terribly stringent, but the units obviously recommend being in much better shape than the minimum.
Also of interest may be the 18th Abn Corps physical standards, which are online. Although the elite units may have higher requirements than the minimum on the Army APFT and include other events (ruck marches, swim, longer runs) (for that matter any unit can adopt higher standards), I'm not aware that there exist separate physical training manuals for SF, Rangers, or Abn, other than in an informal format.