mbufs leak with em(4) carp and pfsync.

[loic_(_at_)_cuguen_(_dot_)_org]

I'm trying to setup a redundant system based on current and test
bandwith and other stuff with pf on a multi gigabit wire.

The problem:

when I issue the following commands on both or one of the host:

----
ifconfig carp0 create
ifconfig carp0 vhid 1 pass test 192.168.2.202
ifconfig carp1 create
ifconfig carp1 vhid 2 pass test 10.1.1.254
ifconfig pfsync0 up syncif bge0
----

The network hangs in a time proportional to the amount of bandwith
going through the vip, no matter who is master of the vip.

The mbufs are consumed and once the NMBCLUSTERS reached, the network
hangs.

I had once this behaviour in 2.8 with the fxp driver.

We have tested with

http://www.idealx.org/prj/idx-tsunami/index.en.html

an http perf scalable like.

but a simple ping -f will do the same.

If someone needs more information or shell, it can be setup.

DMESG of one of the machine this is a IBM x205. and i use two of them
for the redundancy, there is one broadcom on board , and two dual
intel gigabit pci 64 cards.

no changes on -current so i didn't make build today.

-----
OpenBSD 3.4-current (GENERIC) #10: Mon Dec 29 18:32:36 CET 2003
    root_(_at_)_fw1_(_dot_)_cuguen_(_dot_)_org:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel(R) Pentium(R) 4 CPU 2.66GHz ("GenuineIntel" 686-class) 2.67 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,ACPI,MMX,FXSR,SIMD,SIMD2,SS,HTT,TM,SBF,CNXT-ID
real mem  = 536195072 (523628K)
avail mem = 494915584 (483316K)
using 4278 buffers containing 26910720 bytes (26280K) of memory
mainbus0 (root)
bios0 at mainbus0: AT/286+(ff) BIOS, date 07/11/03, BIOS32 rev. 0 @ 0xf0230
pcibios0 at bios0: rev. 2.1 @ 0xf0200/0xb00
pcibios0: PCI IRQ Routing Table rev. 1.0 @ 0xfa940/208 (11 entries)
pcibios0: no compatible PCI ICU found: ICU vendor 0x8086 product 0x24c0
pcibios0: Warning, unable to fix up PCI interrupt routing
pcibios0: PCI bus #2 is the last bus
bios0: ROM list: 0xc0000/0x8000 0xe0000/0xe000
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 vendor 0x8086 product 0x1a30 rev 0x11
ppb0 at pci0 dev 1 function 0 vendor 0x8086 product 0x1a31 rev 0x11
pci1 at ppb0 bus 1
vendor 0x8086 product 0x24c2 (class serial bus subclass USB, rev 0x02) at pci0
dev 29 function 0 not configured
vendor 0x8086 product 0x24c4 (class serial bus subclass USB, rev 0x02) at pci0
dev 29 function 1 not configured
vendor 0x8086 product 0x24cd (class serial bus subclass USB, rev 0x02) at pci0
dev 29 function 7 not configured
ppb1 at pci0 dev 30 function 0 vendor 0x8086 product 0x244e rev 0x82
pci2 at ppb1 bus 2
em0 at pci2 dev 1 function 0 vendor 0x8086 product 0x1010 rev 0x01: irq 5,
address: 00:07:e9:18:3f:e8
em1 at pci2 dev 1 function 1 vendor 0x8086 product 0x1010 rev 0x01: irq 10,
address: 00:07:e9:18:3f:e9
em2 at pci2 dev 2 function 0 vendor 0x8086 product 0x1010 rev 0x01: irq 10,
address: 00:07:e9:1b:0d:74
em3 at pci2 dev 2 function 1 vendor 0x8086 product 0x1010 rev 0x01: irq 10,
address: 00:07:e9:1b:0d:75
bge0 at pci2 dev 3 function 0 vendor 0x14e4 product 0x16a6 rev 0x02: irq 10:
address: 00:09:6b:b7:2b:c4
brgphy0 at bge0 phy 1: BCM5703 10/100/1000baseTX PHY, rev. 2
vga1 at pci2 dev 4 function 0 vendor 0x1002 product 0x4752 rev 0x27
wsdisplay0 at vga1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
pcib0 at pci0 dev 31 function 0 vendor 0x8086 product 0x24c0 rev 0x02
pciide0 at pci0 dev 31 function 1 vendor 0x8086 product 0x24cb rev 0x02: DMA,
channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <IC35L060AVV207-0>
wd0: 16-sector PIO, LBA48, 38162MB, 16383 cyl, 16 head, 63 sec, 78156288
sectors
wd1 at pciide0 channel 0 drive 1: <IC35L060AVV207-0>
wd1: 16-sector PIO, LBA48, 38162MB, 16383 cyl, 16 head, 63 sec, 78156288
sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
wd1(pciide0:0:1): using PIO mode 4, Ultra-DMA mode 5
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
scsibus0 targ 0 lun 0: <HL-DT-ST, CD-ROM GCR-8482B, 1.02> SCSI0 5/cdrom
removable not configured
atapiscsi0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
vendor 0x8086 product 0x24c3 (class serial bus subclass SMBus, rev 0x02) at
pci0 dev 31 function 3 not configured
vendor 0x8086 product 0x24c5 (class multimedia subclass audio, rev 0x02) at
pci0 dev 31 function 5 not configured
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
npx0 at isa0 port 0xf0/16: using exception 16
pccom0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
pccom1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
biomask c040 netmask c460 ttymask c462
pctr: user-level cycle counter enabled
dkcsum: wd0 matched BIOS disk 80
wd1: no disk label
dkcsum: wd1 matched BIOS disk 81
root on wd0a
rootdev=0x0 rrootdev=0x300 rawdev=0x302
-----

--
Loïc

[demime 0.98d removed an attachment of type application/pgp-signature]