Check the alternator output. If the alternator is not charging the fuel pump only runs while cranking the starter.

Doesn't quite fit your symptoms though.