3 Def isn't exactly a major fail however 3 does effect the combat.
2 Def doesn't effect the def, 3 is the level that combat starts being effected.
The stats aren't that hard to get. You could probably get it in a day or two. The only way I would not restart is if you already had mith gloves on it, but by telling from the non-combat skills I highly doubt you do.