Maybe I'm not understanding, however the way that IP address and DNS work is you have a public IP address assigned to the server. Computer all access the server via that public IP address. If you go to http://yourIPaddress it will load your website. Now, that's hard for people, so that's what DNS is for. You setup an A record for IPv4, or a AAAA record for IPv6. You tell it your domain name, and assign it to that IP address. That way if someone types in http://yourdomainname.com then a DNS lookup happens and it knows to go to that IP address. However, you can still access the server via the IP address, as with any server on the Internet.
If I'm misunderstanding you, let me know and we can go forward from there.