Yes, simply turning off the pump
should be all you need to do. A simple test will tell whether you're dealing with a clog or some other problem. Disconnect the cold water line from the faucet, stick that hose into a bucket, and turn the pump
back on. If you don't get flow, the problem is in the plumbing
between the pump and the faucet. If you do get flow, the problem is probably in the faucet.