Like Glen says, you should be looking at a NO relay. Do you by chance have a NC relay? It would be closed when the ignition circuit is off, running the fuel pump as soon as the battery is connected.