What makes an affiliate keep running an offer after the first test?

When you test a new offer, what actually makes you keep running it after the first results?

Is it mainly payout and conversion rate, or do things like retention, approval consistency, traffic quality and communication with the manager influence the decision just as much?

Curious what you look at before deciding to scale or move on.