Has anyone seen and fixed this before?
It usually happens if the newly set gateway is not reachable from the host, then the esxi will not set the gateway. Also, check if any vmk portgroups are in use which are actively using the NAS or iscsi traffic.