The AR and VR TeleRehab and TeleFitness System are intelligent human-computer interaction rehabilitation and fitness training platforms that provide online therapist-designed training exercises with real-time AR/VR visual and audio guidance, for the elderly, stroke survivors and other people in need.