NFS active/active cluster with gluster and NFS-ganesha, I can create dirs, but not files! Post: 303045800

Sponsored Content

Top Forums UNIX for Advanced & Expert Users NFS active/active cluster with gluster and NFS-ganesha, I can create dirs, but not files! Post 303045800 by Linusolaradm1 on Monday 13th of April 2020 05:52:02 PM

04-13-2020

Registered User

NFS active/active cluster with gluster and NFS-ganesha, I can create dirs, but not files!

Following this fantastic guide I finally setup an active working active/active nfs4 cluster.
The setup is not too difficult: two servers with ganesha+glusterfs other two with haproxy and keepalived.
The cluster works fine, from one client I have mount the nfs share called "nfshare" without problem

Code:

mount -t nfs4

nfsserver:/nfsshare on /mnt type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=10.2.0.170,local_lock=none,addr=10.2.0.7)

I have created some dirs on mnt and works perfect(there are replicated on nfsgluster servers). I have also rebooted for testing the nfs server one or two, and after a very little downtime (2 seconds) the connection is up and working.
The problem is..mkdir works, but every file operation(dd,cp,touch) fails(stuck,freeze until ctrl+c is pressed).

On both the nfs servers and keepalived servers there is no problem with selinux

Code:

grep -i denied /var/log/audit/audit.log

What can be?Why mkdir works and file operation not?

--- Post updated at 05:52 PM ---

Solution found, ganesha was misconfigured, I have forgot to add the ports for services.

Linusolaradm1

View Public Profile for Linusolaradm1

Find all posts by Linusolaradm1

We Also Found This Discussion For You

1. AIX

Very Active NFS and Disk Usage

Here is the scenario... NFS share that is accessed every few minutes by approx 70 systems (AIX 5.3/6.1). Filesystem space is being eaten up rapidly according to df however du numbers really never change. lsof and fuser cannot see any unlinked files on either the NFS server or remote clients. ...

LEARN ABOUT CENTOS

tapset::nfs

tapset::nfs(3stap)														tapset::nfs(3stap)

NAME

       tapset::nfs - systemtap nfs tapset

DESCRIPTION

       nfs.fop.llseek
	      NFS client llseek operation

	       See probe::nfs.fop.llseek(3stap)
	       for details.

       nfs.fop.read
	      NFS client read operation

	       See probe::nfs.fop.read(3stap)
	       for details.

       nfs.fop.write
	      NFS client write operation

	       See probe::nfs.fop.write(3stap)
	       for details.

       nfs.fop.aio_read
	      NFS client aio_read file operation

	       See probe::nfs.fop.aio_read(3stap)
	       for details.

       nfs.fop.aio_write
	      NFS client aio_write file operation

	       See probe::nfs.fop.aio_write(3stap)
	       for details.

       nfs.fop.mmap
	      NFS client mmap operation

	       See probe::nfs.fop.mmap(3stap)
	       for details.

       nfs.fop.open
	      NFS client file open operation

	       See probe::nfs.fop.open(3stap)
	       for details.

       nfs.fop.flush
	      NFS client flush file operation

	       See probe::nfs.fop.flush(3stap)
	       for details.

       nfs.fop.release
	      NFS client release page operation

	       See probe::nfs.fop.release(3stap)
	       for details.

       nfs.fop.fsync
	      NFS client fsync operation

	       See probe::nfs.fop.fsync(3stap)
	       for details.

       nfs.fop.lock
	      NFS client file lock operation

	       See probe::nfs.fop.lock(3stap)
	       for details.

       nfs.fop.sendfile
	      NFS client send file operation

	       See probe::nfs.fop.sendfile(3stap)
	       for details.

       nfs.fop.check_flags
	      NFS client checking flag operation

	       See probe::nfs.fop.check_flags(3stap)
	       for details.

       nfs.aop.readpage
	      NFS client synchronously reading a page

	       See probe::nfs.aop.readpage(3stap)
	       for details.

       nfs.aop.readpages
	      NFS client reading multiple pages

	       See probe::nfs.aop.readpages(3stap)
	       for details.

       nfs.aop.set_page_dirty
	      NFS client marking page as dirty

	       See probe::nfs.aop.set_page_dirty(3stap)
	       for details.

       nfs.aop.writepage
	      NFS client writing a mapped page to the NFS server

	       See probe::nfs.aop.writepage(3stap)
	       for details.

       nfs.aop.writepages
	      NFS client writing several dirty pages to the NFS server

	       See probe::nfs.aop.writepages(3stap)
	       for details.

       nfs.aop.write_begin
	      NFS client begin to write data

	       See probe::nfs.aop.write_begin(3stap)
	       for details.

       nfs.aop.write_end
	      NFS client complete writing data

	       See probe::nfs.aop.write_end(3stap)
	       for details.

       nfs.aop.release_page
	      NFS client releasing page

	       See probe::nfs.aop.release_page(3stap)
	       for details.

SEE ALSO

	  probe::nfs.fop.llseek(3stap),      probe::nfs.fop.read(3stap),      probe::nfs.fop.write(3stap),	probe::nfs.fop.aio_read(3stap),
       probe::nfs.fop.aio_write(3stap),      probe::nfs.fop.mmap(3stap),       probe::nfs.fop.open(3stap),	  probe::nfs.fop.flush(3stap),
       probe::nfs.fop.release(3stap),	     probe::nfs.fop.fsync(3stap),      probe::nfs.fop.lock(3stap),	probe::nfs.fop.sendfile(3stap),
       probe::nfs.fop.check_flags(3stap),		 probe::nfs.aop.readpage(3stap),		 probe::nfs.aop.readpages(3stap),
       probe::nfs.aop.set_page_dirty(3stap),		    probe::nfs.aop.writepage(3stap),		  probe::nfs.aop.writepages(3stap),
       probe::nfs.aop.write_begin(3stap),  probe::nfs.aop.write_end(3stap),  probe::nfs.aop.release_page(3stap),  stap(1), stapprobes(3stap)

IBM
									---							tapset::nfs(3stap)

We Also Found This Discussion For You

1. AIX

Very Active NFS and Disk Usage

Discussion started by: masterpengu

LEARN ABOUT CENTOS

tapset::nfs