Yeah I would have already been gone. Don't give them a long explanation, just tell them you don't have the time make this project a priority anymore and you're bowing out.

I would let them have the ability to use the sprite, but not give away all rights so I could not also use it for portfolio purposes.

If you haven't signed a contract and you're working with minors anyway, any agreement is invalid.