Thanks so much for the screenshot, I see what you mean and will bring this issue to our developers since I can see how it's confusing.
I think one reason why I was unsure was that my journey usually is - Site-admin -> Plugin Settings -> Testing the plugin. Because I did not see Videopress settings then I instantly thought it is not there. But I have the role of admin and the way of admin and a lot of old habits.
If you're used to the self-hosted administration area, WordPress.com definitely takes some getting used to. Hopefully that'll happen over time. :-)
Thanks again for your feedback, I appreciate it!