For best possible build and gear, tag both searching and smarts in the beginning, and set luck to 10. rush smarts to 30 so your books give 5 points instead of 4, and then rush searching to about 70. Helps give you great gear in the early and mid game, and will shower you with extra skill books.
Considering the completely limited nature of gems at this point (1 per rank per girl, 5 for finishing, repeats gain nothing), adding some method to gain gems apart from buying them would be good. Like watching an add for a gem, like the current time skip button, or for getting previous girls to 'lover' again. If you blow your gems on dates, gifts, resets, or any of the consumable methods, the only option is purchasing more or resetting your entire save to use the gems better. Nothing against supporting the game, but a concrete limit makes it look like a move designed to force a purchase rather than encourage one.