[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: nfs stalls and speed issues



On Fri, 20 Aug 2004 17:08:02 -0700
Chuck Yerkes <chuck+obsd_(_at_)_2004_(_dot_)_snew_(_dot_)_com> wrote:

[snip]

OK, here's a load more numbers.

Machines
--------
 - caleb (NFS, FTP, everything else server)
P3-667 (not 1Ghz as in last mail)
512MB
Dual-port fxp
2 x 7200rpm Western Digital (no RAID)
OpenBSD 3.5 release
Runs pf: "pass quick on $int"

 - lucas
AMD XP2500
768MB
fxp
1 x 7200rpm Western Digital
August 19 snapshot

 - drmatt
Via Nemeniah 1Ghz
512MB
vr
1 x 4400rpm Quantum
OpenBSD 3.5 release

> I'd be curious to see what ttcp shows (it's in ports, fairly good quick
> bandwidth testing tool).
 - TCP
 - Server receiving:
drmatt:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  tcp  -> caleb
ttcp-t: socket
ttcp-t: connect
ttcp-t: 104857600 bytes in 11.04 real seconds = 9275.33 KB/sec +++
ttcp-t: 12800 I/O calls, msec/call = 0.88, calls/sec = 1159.42
ttcp-t: 0.0user 2.1sys 0:11real 19% 0i+0d 0maxrss 0+4pf 38296+6373csw

lucas:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  tcp  -> caleb
ttcp-t: socket
ttcp-t: connect
ttcp-t: 104857600 bytes in 8.99 real seconds = 11392.55 KB/sec +++
ttcp-t: 12800 I/O calls, msec/call = 0.72, calls/sec = 1424.07
ttcp-t: 0.0user 0.8sys 0:08real 9% 0i+0d 0maxrss 1+5pf 47843+6369csw

 - Server transmitting
drmatt:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  tcp  -> drmatt
ttcp-t: socket
ttcp-t: connect
ttcp-t: 104857600 bytes in 9.98 real seconds = 10259.37 KB/sec +++
ttcp-t: 12800 I/O calls, msec/call = 0.80, calls/sec = 1282.42
ttcp-t: 0.0user 4.0sys 0:09real 41% 0i+0d 0maxrss 0+4pf 20077+6347csw

lucas:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  tcp  -> lucas
ttcp-t: socket
ttcp-t: connect
ttcp-t: 104857600 bytes in 9.56 real seconds = 10713.79 KB/sec +++
ttcp-t: 12800 I/O calls, msec/call = 0.76, calls/sec = 1339.22
ttcp-t: 0.0user 3.6sys 0:09real 38% 0i+0d 0maxrss 0+4pf 23995+6378csw

 - UDP
 - Server receiving
drmatt:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  udp  -> caleb
ttcp-t: socket
ttcp-t: 104857600 bytes in 10.42 real seconds = 9829.25 KB/sec +++
ttcp-t: 13010 I/O calls, msec/call = 0.82, calls/sec = 1248.81
ttcp-t: 0.0user 1.5sys 0:10real 14% 0i+0d 0maxrss 0+6pf 3301+3212csw

lucas:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  udp  -> caleb
ttcp-t: socket
ttcp-t: 104857600 bytes in 12.38 real seconds = 8274.08 KB/sec +++
ttcp-t: 13216 I/O calls, msec/call = 0.96, calls/sec = 1067.87
ttcp-t: 0.0user 0.4sys 0:12real 3% 0i+0d 0maxrss 0+6pf 4332+2276csw

 - Server transmitting
drmatt:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  udp  -> drmatt
ttcp-t: socket
ttcp-t: 104857600 bytes in 12.40 real seconds = 8257.47 KB/sec +++
ttcp-t: 13187 I/O calls, msec/call = 0.96, calls/sec = 1063.39
ttcp-t: 0.0user 1.4sys 0:12real 11% 0i+0d 0maxrss 0+6pf 3042+3656csw
 
lucas:
ttcp-t: buflen=8192, nbuf=2048, align=16384/0, port=5001  udp  -> lucas
ttcp-t: socket
ttcp-t: 104857600 bytes in 12.40 real seconds = 8261.15 KB/sec +++
ttcp-t: 13192 I/O calls, msec/call = 0.96, calls/sec = 1064.27
ttcp-t: 0.0user 1.3sys 0:12real 10% 0i+0d 0maxrss 0+6pf 3421+3207csw


> As for writes, I'd also be curious how fast you can write to the
> local machine. 
[snip]
These are both the same physical drive on caleb.

$time dd if=/dev/zero of=/tmp/100meg bs=1048576 count=100
100+0 records in
100+0 records out
104857600 bytes transferred in 1.963 secs (53403303 bytes/sec)

real    0m2.198s
user    0m0.000s
sys     0m1.445s

(this one has softdep)
$time dd if=/dev/zero of=/media/tmp/100meg bs=1048576 count=100
100+0 records in
100+0 records out
104857600 bytes transferred in 4.047 secs (25909760 bytes/sec)

real    0m4.485s
user    0m0.008s
sys     0m1.430s

> What happens to writes when that NFS partition in a tmpfs partition?
> (eg. eliminate the spindle from the game).
I set up a mfs tmp partition on the server and exported it, but the client couldn't mount it correctly.  It shows in mount but not in df.  Trying to access the dir gives "input/output error".  I'm sure I've done that before, think I'm mising something obvious.

Other tests:
ftp
---
(100MB file)
drmatt: 9.25 MB/s
lucas: 11.13 MB/s

scp
---
(scp /tmp/100meg caleb:/tmp/out)
drmatt: 3.2MB/s
lucas: 5.0MB/s

Cheers,
Duncan