If they chargeback and you lose the dispute, you should just pay them back. Not doing so will cause a lot of harassment and may cause a drop in your credit score, which can really come back to bite you.
Be glad it's a relatively small amount and hope for the best. There's lots of legit people too and even if he charges back, there's a chance you'll win.
Good luck!