Re: NFS Cache (?) Issue
Igor,
thanks for your quick reply.
Am Samstag, 29. Dezember 2012, 02:33:29 schrieb Igor Cicimov:
> On Sat, Dec 29, 2012 at 9:06 AM, Mailingliste <ml@bokomoko.de> wrote:
[...]
> acregmin=n The minimum time in seconds that attributes of a regular
> file should be cached before requesting
> fresh information from a server. The default is 3
> seconds.
> acregmax=n The maximum time in seconds that attributes of a
> regular file can be cached before requesting
> fresh information from a server. The default is 60
> seconds.
> acdirmin=n The minimum time in seconds that attributes of a
> directory should be cached before requesting
> fresh information from a server. The default is 30
> seconds.
> acdirmax=n The maximum time in seconds that attributes of a
> directory can be cached before requesting fresh
> information from a server. The default is 60
> seconds. actimeo=n Using actimeo sets all of acregmin, acregmax,
> acdirmin, and acdirmax to the same value. There
> is no default value.
>
> as you can see the default maximum directory attribute cache time is 60
> seconds which doesn't match with your resoults. For both v3 and v4. But in
> v4 there is also:
>
> noac Disable attribute caching, and force synchronous writes.
> This extracts a server perfor-
> mance penalty but it allows two different NFS clients
> to get reasonable good results when
> both clients are actively writing to common
> filesystem on the server.
> fsc Enable the use of persistent caching to the local
> disk using the FS-Cache facility for
> the given mount point.
>
> so are you using maybe fsc option during the mount?
Hmm...not that I am aware of:
dell:/home on /mnt/net/dell/home type nfs
(rw,nosuid,nodev,intr,sloppy,vers=4,addr=192.168.2.23,clientaddr=192.168.2.27)
> What happens if you switch to NFS v3?
I see no visible change, even when mounting without autofs:
root@omjuta:~# mount -o vers=3 dell:/home /mnt/dell
root@omjuta:~# ls -l /mnt/dell/
insgesamt 28
drwxr-x--- 83 dorsch dorsch 4096 28. Dez 22:43 dorsch
drwxr-xr-x 31 kathrin kathrin 4096 8. Jul 12:22 kathrin
drwxr-xr-x 19 2111 2111 4096 21. Dez 2011 kristina
drwxr-xr-x 27 marina marina 4096 4. Mär 2012 marina
drwxr-xr-x 63 rd rd 4096 28. Dez 12:55 rd
drwxrwsr-x 2 1000 users 4096 15. Feb 2010 shared
drwxr-xr-x 27 simon simon 4096 2. Okt 2011 simon
root@omjuta:~#
> Also post the result of:
>
> # cat /proc/mounts
rd@omjuta:~$ cat /proc/mounts
rootfs / rootfs rw 0 0
none /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
none /proc proc rw,nosuid,nodev,noexec,relatime 0 0
none /dev devtmpfs rw,relatime,size=1032652k,nr_inodes=218500,mode=755 0 0
none /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0
/dev/disk/by-uuid/6b00db99-d16d-42a5-adfc-ec4af1a268d5 / ext4
rw,noatime,errors=remount-ro,barrier=1,data=ordered 0 0
tmpfs /lib/init/rw tmpfs rw,nosuid,relatime,mode=755 0 0
tmpfs /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0
tmpfs /tmp tmpfs rw,nosuid,nodev,relatime 0 0
rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
-hosts /mnt/net autofs
rw,relatime,fd=7,pgrp=1220,timeout=60,minproto=5,maxproto=5,indirect 0 0
/etc/auto.sshfs /mnt/sshfs autofs
rw,relatime,fd=13,pgrp=1220,timeout=30,minproto=5,maxproto=5,indirect 0 0
-hosts /mnt/net/dell/home autofs
rw,relatime,fd=7,pgrp=1220,timeout=60,minproto=5,maxproto=5,offset 0 0
dell:/home/ /mnt/net/dell/home nfs4
rw,nosuid,nodev,relatime,vers=4,rsize=65536,wsize=65536,namlen=255,hard,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=192.168.2.27,minorversion=0,addr=192.168.2.23
0 0
rd@omjuta:~$
> # nfsstat -m
root@omjuta:~# nfsstat -m
/mnt/net/dell/home from dell:/home/
Flags:
rw,nosuid,nodev,relatime,vers=4,rsize=65536,wsize=65536,namlen=255,hard,proto=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=192.168.2.27,minorversion=0,addr=192.168.2.23
root@omjuta:~#
> # nfsstat -n -c -v -4
root@omjuta:~# nfsstat -n -c -v 4
Server packet stats:
packets udp tcp tcpconn
0 0 0 0
Server rpc stats:
calls badcalls badauth badclnt xdrcall
0 0 0 0 0
Server reply cache:
hits misses nocache
0 0 0
Server file handle cache:
lookup anon ncachedir ncachedir stale
0 0 0 0 0
Client packet stats:
packets udp tcp tcpconn
0 0 0 0
Client rpc stats:
calls retrans authrefrsh
54 0 0
> # uname -a
root@omjuta:~# uname -a
Linux omjuta 2.6.32-5-686 #1 SMP Sun Sep 23 09:49:36 UTC 2012 i686 GNU/Linux
root@omjuta:~#
>
> on the client and:
>
> # nfsstat -s
dell:~# nfsstat -s
Server rpc stats:
calls badcalls badauth badclnt xdrcall
63 0 0 0 0
Server nfs v2:
null getattr setattr root lookup readlink
4 100% 0 0% 0 0% 0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
Server nfs v3:
null getattr setattr lookup access readlink
5 100% 0 0% 0 0% 0 0% 0 0% 0 0%
read write create mkdir symlink mknod
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
remove rmdir rename link readdir readdirplus
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
fsstat fsinfo pathconf commit
0 0% 0 0% 0 0% 0 0%
Server nfs v4:
null compound
2 3% 52 96%
Server nfs v4 operations:
op0-unused op1-unused op2-future access close commit
0 0% 0 0% 0 0% 4 2% 0 0% 0 0%
create delegpurge delegreturn getattr getfh link
0 0% 0 0% 0 0% 50 34% 20 13% 0 0%
lock lockt locku lookup lookup_root nverify
0 0% 0 0% 0 0% 18 12% 0 0% 0 0%
open openattr open_conf open_dgrd putfh putpubfh
0 0% 0 0% 0 0% 0 0% 50 34% 0 0%
putrootfh read readdir readlink remove rename
2 1% 0 0% 2 1% 0 0% 0 0% 0 0%
renew restorefh savefh secinfo setattr setcltid
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
setcltidconf verify write rellockowner bc_ctl bind_conn
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
exchange_id create_ses destroy_ses free_stateid getdirdeleg getdevinfo
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
getdevlist layoutcommit layoutget layoutreturn secinfononam sequence
0 0% 0 0% 0 0% 0 0% 0 0% 0 0%
set_ssv test_stateid want_deleg destroy_clid reclaim_comp
0 0% 0 0% 0 0% 0 0% 0 0%
dell:~#
Maybe worth mentioning: I run a backports kernel on the server:
dell:~# uname -a
Linux dell 2.6.39-bpo.2-686-pae #1 SMP Thu Aug 4 11:02:22 UTC 2011 i686
GNU/Linux
dell:~#
Thanks,
Rainer
>
> on the server.
>
> > For reference, what I did on the server side:
> >
>> [...]
Reply to: