Typically this is true as the only performance hit will be due to the initial lookup, and then your resolver will cache the record. However, if your DNS record uses a low TTL (required for things like DNS-based monitoring/failover) like 30 secs or 1 minute, DNS lookups will have a larger impact on site performance because user resolvers will have to frequently re-query the authoritative DNS.