Can you guys help me with my Wifi router and connecting 20+ devices?

Like the title says, my current router is struggling mightily under the excessive abuse I put it through. I'm using Charter internet, and the router is just the basic one they provide. Internet access constantly freezes and gets disabled for a few minutes. Clearly, I need to upgrade this router, but I don't know the first thing about routers or how to set one up. Ideally, I would like to just buy a good router that I can plug in, and it will work much better than my current one.

Is it that simple? Can I just buy a good router, and it will be able to handle my needs? What do you guys think I should do? Thanks in advance for your advice and ideas?