If they are bad just fuck em off nicely due to "creative differences".
No harm done then. If you didnt have a contract before you started the job for them paying even if they choose not to use it then you're abit knackered and you will just have to put it down as a learning experience.
perhaps next time do the job using staggered payments.