On both hosts edited the ifcfg file for the two interfaces that we had identified as causing the slow down - p3p1 and p3p2 and set ethtool_options.

This means the setting are now presistent after a reboot

barney # cd /etc/sysconfig/network/

barney:/etc/sysconfig/network # vi ifcfg-p3p1
BOOTPROTO='none'
BROADCAST=''
ETHTOOL_OPTIONS='-K iface rx off tx off sg off tso off gso off gro off lro off rxvlan off txvlan off rxhash off'
IPADDR=''
MTU=''
NAME='Intel Ethernet controller'
NETMASK=''
NETWORK=''
REMOTE_IPADDR=''
STARTMODE='auto'
USERCONTROL='no'