During the main story quest "Face Your Fears," this Grimoire can be found inside Ryngrim's Domain. In this place, turn right from the statue of Ryngrim and activate a secret switch on a bookshelf ...

Much like gardening, Grimoire Groves requires a little patience. But once you get past that initial struggle, it’s incredibly rewarding.