I thought it was funny that I’ve just started doing exactly what you said. I passed N4 this December, and I told myself that I’m done with textbooks for awhile, and now I’m going to read and listen and enjoy myself for at least a year before I even think about N3.
I just read Japanese Folktales for Language Learners, Amazon.com: Japanese Folktales for Language Learners: Bilingual Legends and Fables in Japanese and English (Free online Audio Recording) (Stories for Language Learners): 9784805316627: Sato, Eriko, Sato, Anna: Books
And I absolutely loved it. Should have started this sooner, but I’m not sure I could have handled the difficulty level a year ago.

