Turn Off Power at the Main Circuit Locate the circuit breaker or fuse that controls the outlet you plan to replace and shut off the power to the circuit. Plug a lamp, radio or the GFCI tester into ...