I definitely wouldn't have surrendered that early. You had the advantage for sure, but I would argue that it was indeed a bit of a premature surrender.
Positional and income disadvantage. You would have to fuck up hard for him to still have a chance. If you played this normally there was no way he could come back. He surrendered at the right point (although most players would probably play one or two more turns. He simply chose not to).