How high is the pressure? I assume you have a pressure gauge connected to the fuel supply line to the injector rail.
Remove the return line from the spigot on the fuel tank and direct it into an open container to catch the fuel. Run the fuel pump and see if the pressure is now 35psi and the fuel is flowing into the container.
If the pressure is now 35psi, the check valve in the return line spigot is plugged and blocking the flow back to the tank. While not a common problem, it does occur from time to time.
If the pressure is still high, the regulator is probably bad and not opening to allow the excess flow to return to the tank.