OpenDNS

I have a lousy wifi connection. My ISP is Charter. I have my own router, a Linksys router. The modem is Charters. The problem I have is signal strength. I am constantly losing the connection for several seconds, all day long. My signal strength is usually two bars, but most often it is one. I googled my issue and ran across a forum discussing OpenDNS. This sounds like it might solve my problem, but not being very bright when it comes to tech I thought I would ask here. Is it possible that would help me? Is it worth a try? Do I just change it on my router or do I have to change it on all my wifi devices?

Thanks!