It has potential, but it has some points that should be improved in my opinion. The MC is very passive, has no ambition. I understand that caution is necessary, but there is a fine line between caution and cowardice. If the MC had ambition, he would look for more women to marry, so his power would increase. With more power the MC would expand his territory, his fame would increase, and more notable women would appear to be his concubine, so his power would exponentially increase the amount of women he has, like a snowball. Currently the MC just waits for someone to attack, then fight back, his only desire is to keep his rural town. It's really disappointing to see a novel with so much potential go down this path. Without power everything he has can be taken away at the whim of the powerful, ambition is a basic need in this kind of chaotic world.