The friction of leaving Wordpress to speed up my site

I'm looking to leave Wordpress to speed-up my site.

Context: 50k unique per month, site build on elementor.

Is there a provider anyone has used that can enable me to transfer the hosting seamlessly without disruptions? One of the options I looked at would require me to uninstall apps and lots of other things which would render my site unusable.

I believe everything else to speed up website (js magnification, image smush, plugins), this is the last thing and I'm ranking 24/100 on mobile & 68 on desktop