[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Re: NFS Cache (?) Issue [solved]



I found the problem, much simpler than expected:

On the server /home/shared is a different partition:

dell:~# mount
/dev/sda1 on / type ext3 (rw,errors=remount-ro)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
fusectl on /sys/fs/fuse/connections type fusectl (rw)
nfsd on /proc/fs/nfsd type nfsd (rw)
/dev/sda3 on /home/shared type ext3 (rw)
dell:~# 

On the client the permissions/ownership before mounting was visible, on the 
server the permissions/ownership after mounting.

Adding /home/shared in /etc/exports solved the problem.

Many thanks,
Rainer

Am Samstag, 29. Dezember 2012, 11:21:51 schrieb Rainer Dorsch:
> Igor,
> 
> thanks for your quick reply.
> 
> Am Samstag, 29. Dezember 2012, 02:33:29 schrieb Igor Cicimov:
> > On Sat, Dec 29, 2012 at 9:06 AM, Mailingliste <ml@bokomoko.de> wrote:
> [...]
> 
> > acregmin=n     The minimum time in seconds that attributes of a regular
> > file should be cached before requesting
> > 
> >                       fresh information from a server.  The default is 3
> > 
> > seconds.
> > 
> >        acregmax=n     The maximum time in seconds that attributes of a
> > 
> > regular file can be  cached  before  requesting
> > 
> >                       fresh information from a server.  The default is 60
> > 
> > seconds.
> > 
> >        acdirmin=n     The  minimum  time  in seconds that attributes of a
> > 
> > directory should be cached before requesting
> > 
> >                       fresh information from a server.  The default is 30
> > 
> > seconds.
> > 
> >        acdirmax=n     The maximum time in seconds that attributes of a
> > 
> > directory can be cached before requesting fresh
> > 
> >                       information from a server.  The default is 60
> > 
> > seconds. actimeo=n      Using  actimeo  sets all of acregmin, acregmax,
> > acdirmin, and acdirmax to the same value.  There
> > 
> >                       is no default value.
> > 
> > as you can see the default maximum directory attribute cache time is 60
> > seconds which doesn't match with your resoults. For both v3 and v4. But
> > in
> > 
> > v4 there is also:
> >  noac           Disable  attribute caching, and force synchronous writes.
> > 
> > This extracts a server perfor-
> > 
> >                       mance penalty but it allows two different NFS
> >                       clients
> > 
> > to get reasonable good results when
> > 
> >                       both clients are actively writing to common
> > 
> > filesystem on the server.
> > 
> >   fsc               Enable  the  use  of persistent caching to the local
> > 
> > disk using the FS-Cache facility for
> > 
> >                       the given mount point.
> > 
> > so are you using maybe fsc option during the mount?
> 
> Hmm...not that I am aware of:
> 
> dell:/home on /mnt/net/dell/home type nfs
> (rw,nosuid,nodev,intr,sloppy,vers=4,addr=192.168.2.23,clientaddr=192.168.2.
> 27)
> 
> > What happens if you switch to NFS v3?
> 
> I see no visible change, even when mounting without autofs:
> 
> root@omjuta:~# mount -o vers=3 dell:/home /mnt/dell
> root@omjuta:~# ls -l /mnt/dell/
> insgesamt 28
> drwxr-x--- 83 dorsch  dorsch  4096 28. Dez 22:43 dorsch
> drwxr-xr-x 31 kathrin kathrin 4096  8. Jul 12:22 kathrin
> drwxr-xr-x 19    2111    2111 4096 21. Dez 2011  kristina
> drwxr-xr-x 27 marina  marina  4096  4. Mär 2012  marina
> drwxr-xr-x 63 rd      rd      4096 28. Dez 12:55 rd
> drwxrwsr-x  2    1000 users   4096 15. Feb 2010  shared
> drwxr-xr-x 27 simon   simon   4096  2. Okt 2011  simon
> root@omjuta:~#
> 
> > Also post the result of:
> > 
> > # cat /proc/mounts
> 
> rd@omjuta:~$ cat /proc/mounts
> rootfs / rootfs rw 0 0
> none /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0
> none /proc proc rw,nosuid,nodev,noexec,relatime 0 0
> none /dev devtmpfs rw,relatime,size=1032652k,nr_inodes=218500,mode=755 0 0
> none /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000
> 0 0 /dev/disk/by-uuid/6b00db99-d16d-42a5-adfc-ec4af1a268d5 / ext4
> rw,noatime,errors=remount-ro,barrier=1,data=ordered 0 0
> tmpfs /lib/init/rw tmpfs rw,nosuid,relatime,mode=755 0 0
> tmpfs /dev/shm tmpfs rw,nosuid,nodev,relatime 0 0
> tmpfs /tmp tmpfs rw,nosuid,nodev,relatime 0 0
> rpc_pipefs /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0
> fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0
> -hosts /mnt/net autofs
> rw,relatime,fd=7,pgrp=1220,timeout=60,minproto=5,maxproto=5,indirect 0 0
> /etc/auto.sshfs /mnt/sshfs autofs
> rw,relatime,fd=13,pgrp=1220,timeout=30,minproto=5,maxproto=5,indirect 0 0
> -hosts /mnt/net/dell/home autofs
> rw,relatime,fd=7,pgrp=1220,timeout=60,minproto=5,maxproto=5,offset 0 0
> dell:/home/ /mnt/net/dell/home nfs4
> rw,nosuid,nodev,relatime,vers=4,rsize=65536,wsize=65536,namlen=255,hard,pro
> to=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=192.168.2.27,minorvers
> ion=0,addr=192.168.2.23 0 0
> rd@omjuta:~$
> 
> > # nfsstat -m
> 
> root@omjuta:~# nfsstat -m
> /mnt/net/dell/home from dell:/home/
>  Flags:
> rw,nosuid,nodev,relatime,vers=4,rsize=65536,wsize=65536,namlen=255,hard,pro
> to=tcp,port=0,timeo=600,retrans=2,sec=sys,clientaddr=192.168.2.27,minorvers
> ion=0,addr=192.168.2.23
> 
> root@omjuta:~#
> 
> > # nfsstat -n -c -v -4
> 
> root@omjuta:~# nfsstat -n -c -v 4
> Server packet stats:
> packets    udp        tcp        tcpconn
> 0          0          0          0
> 
> Server rpc stats:
> calls      badcalls   badauth    badclnt    xdrcall
> 0          0          0          0          0
> 
> Server reply cache:
> hits       misses     nocache
> 0          0          0
> 
> Server file handle cache:
> lookup     anon       ncachedir  ncachedir  stale
> 0          0          0          0          0
> 
> Client packet stats:
> packets    udp        tcp        tcpconn
> 0          0          0          0
> 
> Client rpc stats:
> calls      retrans    authrefrsh
> 54         0          0
> 
> > # uname -a
> 
> root@omjuta:~# uname -a
> Linux omjuta 2.6.32-5-686 #1 SMP Sun Sep 23 09:49:36 UTC 2012 i686
> GNU/Linux root@omjuta:~#
> 
> > on the client and:
> > 
> > # nfsstat -s
> 
> dell:~# nfsstat -s
> Server rpc stats:
> calls      badcalls   badauth    badclnt    xdrcall
> 63         0          0          0          0
> 
> Server nfs v2:
> null         getattr      setattr      root         lookup       readlink
> 4       100% 0         0% 0         0% 0         0% 0         0% 0        
> 0% read         wrcache      write        create       remove       rename
> 0         0% 0         0% 0         0% 0         0% 0         0% 0        
> 0% link         symlink      mkdir        rmdir        readdir      fsstat
> 0         0% 0         0% 0         0% 0         0% 0         0% 0        
> 0%
> 
> Server nfs v3:
> null         getattr      setattr      lookup       access       readlink
> 5       100% 0         0% 0         0% 0         0% 0         0% 0        
> 0% read         write        create       mkdir        symlink      mknod
> 0         0% 0         0% 0         0% 0         0% 0         0% 0        
> 0% remove       rmdir        rename       link         readdir     
> readdirplus 0         0% 0         0% 0         0% 0         0% 0        
> 0% 0         0% fsstat       fsinfo       pathconf     commit
> 0         0% 0         0% 0         0% 0         0%
> 
> Server nfs v4:
> null         compound
> 2         3% 52       96%
> 
> Server nfs v4 operations:
> op0-unused   op1-unused   op2-future   access       close        commit
> 0         0% 0         0% 0         0% 4         2% 0         0% 0        
> 0% create       delegpurge   delegreturn  getattr      getfh        link 0
>         0% 0         0% 0         0% 50       34% 20       13% 0        
> 0% lock         lockt        locku        lookup       lookup_root 
> nverify 0         0% 0         0% 0         0% 18       12% 0         0% 0
>         0% open         openattr     open_conf    open_dgrd    putfh      
>  putpubfh 0         0% 0         0% 0         0% 0         0% 50       34%
> 0         0% putrootfh    read         readdir      readlink     remove   
>    rename 2         1% 0         0% 2         1% 0         0% 0         0%
> 0         0% renew        restorefh    savefh       secinfo      setattr  
>    setcltid 0         0% 0         0% 0         0% 0         0% 0        
> 0% 0         0% setcltidconf verify       write        rellockowner bc_ctl
>       bind_conn 0         0% 0         0% 0         0% 0         0% 0     
>    0% 0         0% exchange_id  create_ses   destroy_ses  free_stateid
> getdirdeleg  getdevinfo 0         0% 0         0% 0         0% 0        
> 0% 0         0% 0         0% getdevlist   layoutcommit layoutget   
> layoutreturn secinfononam sequence 0         0% 0         0% 0         0%
> 0         0% 0         0% 0         0% set_ssv      test_stateid
> want_deleg   destroy_clid reclaim_comp
> 0         0% 0         0% 0         0% 0         0% 0         0%
> 
> dell:~#
> 
> Maybe worth mentioning: I run a backports kernel on the server:
> 
> dell:~# uname -a
> Linux dell 2.6.39-bpo.2-686-pae #1 SMP Thu Aug 4 11:02:22 UTC 2011 i686
> GNU/Linux
> dell:~#
> 
> Thanks,
> Rainer
> 
> > on the server.
> > 
> > > For reference, what I did on the server side:
> >> [...]


Reply to: