What you would ideally do is:
1. Your router uses public DNS servers (your ISP, Google or others);
2. Your router is configured to do DNS caching.
3. All other network devices are configured (by your router using DHCP) to use your router as their DNS server;
This means you don't need to reconfigure all of your myriad devices, just the router. Also once a DNS record is cached by your router, subsequent queries against this record will be much faster from all devices.