How can you tell if a fuel pump is bad or if it is the fuel pump relay switch?

You can swap relays within the relay center with another relay that matches, but in most cases it is seldom the relay At Fault, it is probably a bad fuel pump.