Yes, simply turning off the
pump should be all you need to do. A simple test will tell whether you're dealing with a clog or some other problem. Disconnect the cold water line from the faucet, stick that hose into a bucket, and turn the
pump back on. If you don't get flow, the problem is in the
plumbing between the pump and the faucet. If you do get flow, the problem is probably in the faucet.