The Quest Master's purpose is to simply reward you for completing achievements.
Some of the "Quests" can be used more than once, others have been limited to once.
Please note that the Villager has no AI and therefore only faces South, so I personally recommend that you build a place for it to stay facing south-ways.