Summary : nxge and jumbo frames

From: Len Zaifman <leonardz_at_sickkids.ca>
Date: Mon Apr 12 2010 - 12:59:40 EDT
RE:  nxge and jumbo frames

William Brown among others replied:

Try setting the nxge.conf to enable on all nxge if you can.  In the past I've
found the syntax very volatile as to what worked at different Solaris
versions.


So setting in  /platform/i86pc/kernel/drv/nxge.conf:
accept_jumbo = 1;
 did the trick. KISS does it again. No point overcomplicating the situation.
Thanks to all who replied.

Len Zaifman
Systems Manager, High Performance Systems
The Centre for Computational Biology
The Hospital for Sick Children
555 University Ave.
Toronto, Ont M5G 1X8

tel: 416-813-5513
email: leonardz@sickkids.ca
________________________________________
From: Len Zaifman
Sent: March 16, 2010 10:37 AM
To: sunmanagers@sunmanagers.org
Subject: nxge and jumbo frames

Briefly: I need to get an nxge (dual port 10 GigE) NIC working with Jumbo
framesf for an NFS server with clients which all use jumbo frames:
No matter what I have tried , I cannot get jumbo frames working on this nic
(the onboard gige nics are fine). I would like to get this working so we can
do load tests on the clients.

Hardware : X4540
Solaris: Solaris 10 10/09 s10x_u8wos_08a X86
driver : SUNWnxge VERSION:  11.10.0,REV=2007.07.08.17.21

use ndd to check if jumbo_frames are set:
ndd -get /dev/nxge0 accept_jumbo
1

 when I plumb the interface it has an mtu of 1500
I then try to set the mtu

root 530>>ifconfig nxge0 plumb
 root 531>>ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232
index 1
        inet 127.0.0.1 netmask ff000000
nxge0: flags=1000842<BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3
        inet 0.0.0.0 netmask 0
        ether 0:21:28:4d:87:ee
root 532>>ifconfig nxge0 mtu 9000
ifconfig: setifmtu: SIOCSLIFMTU: nxge0: Invalid argument
root 533>>ifconfig nxge0 mtu 8000
ifconfig: setifmtu: SIOCSLIFMTU: nxge0: Invalid argument


AS can be seen :  I get an error

modinfo shows the driver is loaded:

root 534>>modinfo -i 146
 Id         Loadaddr   Size Info Rev Module Name
146 ffffffffef649000  67cb0 194   1  nxge (Sun NIU 10Gb Ethernet)
root 535>>modinfo -c | grep nxge
146          1 nxge                             LOADED/INSTALLED

I have run out of ideas on how to configure this: is this a bug or firmware
issue??
Is there a way of configuring this with jumbo frames??

ps I have tried the following in  /platform/i86pc/kernel/drv/nxge.conf

tail -9 /platform/i86pc/kernel/drv/nxge.conf
#
name = "pciex108e,abcd" parent = "/pci@79,0/pci10de,377@a/pci108e,0@0"
unit-address = "0" accept_jumbo = 1;
#
name = "pciex108e,abcd" parent = "/pci@79,0/pci10de,377@a/pci108e,0@0"
unit-address = "0,1" accept_jumbo = 1;
#
name = "pciex108e,abcd" parent = "/pci@79,0/pci10de,377@a/pci108e,0@0"
unit-address = "0,2" accept_jumbo = 1;
#
name = "pciex108e,abcd" parent = "/pci@79,0/pci10de,377@a/pci108e,0@0"
unit-address = "0,3" accept_jumbo = 1;

Upon reboot that does not work either.


Len Zaifman
Systems Manager, High Performance Systems
The Centre for Computational Biology
The Hospital for Sick Children
555 University Ave.
Toronto, Ont M5G 1X8

tel: 416-813-5513
email: leonardz@sickkids.ca

This e-mail may contain confidential, personal and/or health
information(information which may be subject to legal restrictions on use,
retention and/or disclosure) for the sole use of the intended recipient. Any
review or distribution by anyone other than the person for whom it was
originally intended is strictly prohibited. If you have received this e-mail
in error, please contact the sender and delete all copies.
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers
Received on Mon Apr 12 13:04:28 2010

This archive was generated by hypermail 2.1.8 : Thu Mar 03 2016 - 06:44:16 EST