If you have the money to spare, I would recommend finding a teacher for one-on-one conversations, online (e.g.on italki) or in person. They would be able to cater to your specific level, and would be able to slow down and explain things when necessary. Even if you feel like you’re not ready for conversation-level Japanese, finding a bilingual teacher who also speaks English/whichever language you are comfortable with would mean that you could start listening to actual spoken Japanese at your pace, with perhaps you answering in the other language to begin with to keep the conversation going. After all, I find that having an actual conversation is the best way to pick up all the nuances that are hard to learn from books or other written material.
I’ve done weekly conversation lessons for a few years now, and it’s done wonders for both my listening and speaking skills in Japanese.