I also just signed up for the beta. In terms of just vocab im probably at around n4, maybe a bit higher just considering known words. What is still really lacking for me is grammar and in general output. I may be able to recognize quite a few words, but being able to recall them, maybe even in the short amount of time required for talking in japanese, is still very difficult for me. I decided i would start at N5 due to my grammar and general output shortcomings.
With this app, even having done the 20 sentences once now, i found myself having quite alot of fun applying rules i learned and really thinking about how to construct a sentence and not just trying to understand input sentences. I felt that this really improves my intuitive understanding of grammar in particular, since alot of the time you can usually kind of autocomplete the meaning of a sentence when you listen to it or read it, even if you dont know or understand a particular grammar structure completely.
Also i kinda found myself surprised at the amount of time i sometimes needed to recall some words or phrases i thought i knew pretty well, but again being able to recognize meanings of words in input seems alot easier than also being able to output the words, not to mention in the short time needed for conversation.
I would love to continue using this and i think this shows alot of promise, since i think its an area of language learning that i (and i imagine alot of others as well) kind of neglect, since there is rarely an opportunity to really apply japanese in this way in my life. I love that we can get basically instant feedback on the sentences through LLMs now and the implementation of the particular errors in a sentence being highlighted and explained in more detail i thought was really helpful as well. I really enjoyed this way of being able to get some output in while also getting feedback in basically real time. While it wouldnt replace any other learning tool im currently using, i think this really fills a niche that i havent seen other apps fill yet (though i might just not be aware of them).