NFS active/active cluster with gluster and NFS-ganesha, I can create dirs, but not files! Post: 303045800

Sponsored Content

Top Forums UNIX for Advanced & Expert Users NFS active/active cluster with gluster and NFS-ganesha, I can create dirs, but not files! Post 303045800 by Linusolaradm1 on Monday 13th of April 2020 05:52:02 PM

04-13-2020

Registered User

NFS active/active cluster with gluster and NFS-ganesha, I can create dirs, but not files!

Following this fantastic guide I finally setup an active working active/active nfs4 cluster.
The setup is not too difficult: two servers with ganesha+glusterfs other two with haproxy and keepalived.
The cluster works fine, from one client I have mount the nfs share called "nfshare" without problem

Code:

mount -t nfs4

nfsserver:/nfsshare on /mnt type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=10.2.0.170,local_lock=none,addr=10.2.0.7)

I have created some dirs on mnt and works perfect(there are replicated on nfsgluster servers). I have also rebooted for testing the nfs server one or two, and after a very little downtime (2 seconds) the connection is up and working.
The problem is..mkdir works, but every file operation(dd,cp,touch) fails(stuck,freeze until ctrl+c is pressed).

On both the nfs servers and keepalived servers there is no problem with selinux

Code:

grep -i denied /var/log/audit/audit.log

What can be?Why mkdir works and file operation not?

--- Post updated at 05:52 PM ---

Solution found, ganesha was misconfigured, I have forgot to add the ports for services.

Linusolaradm1

View Public Profile for Linusolaradm1

Find all posts by Linusolaradm1

We Also Found This Discussion For You

1. AIX

Very Active NFS and Disk Usage

Here is the scenario... NFS share that is accessed every few minutes by approx 70 systems (AIX 5.3/6.1). Filesystem space is being eaten up rapidly according to df however du numbers really never change. lsof and fuser cannot see any unlinked files on either the NFS server or remote clients. ...

LEARN ABOUT CENTOS

pmdagluster

PMDAGLUSTER(1)						      General Commands Manual						    PMDAGLUSTER(1)

NAME

       pmdagluster - Gluster Filesystem PMDA

DESCRIPTION

       pmdagluster is a Performance Metrics Domain Agent (PMDA) which exports metric values about mounted gluster filesystems using the gluster(8)
       command.  This PMDA exports metrics about volumes and bricks both local and remote to the node where pmdagluster is running.

       The gluster filesystem supports fine-grained control over enabling statistics on individual volumes, so	that  the  values  are	optionally
       enabled or disabled on systems where they are not desired to be monitored.

       The  pmstore(1)	command can be used to enable and disable profiling of volumes.  Using the individual instances of the gluster.volume.pro-
       file metric, one can set their values (and associated profiling) either on (1) or off (0).  Additionally, pminfo(1) can report on the  cur-
       rent status of profiling of each volume.

	    # pminfo -f gluster.volume.profile

	    gluster.volume.profile
		inst [0 or "gv0"] value 0
		inst [1 or "gv1"] value 1

	    # pmstore -i "gv0" gluster.volume.profile 1
	    gluster.volume.profile inst [0 or "gv0"] old value=0 new value=1

       Further details on the gluster filesystem can be found at http://www.gluster.org

INSTALLATION

       Install the gluster PMDA by using the Install script as root:

	     # cd $PCP_PMDAS_DIR/gluster
	     # ./Install

       To uninstall, do the following as root:

	     # cd $PCP_PMDAS_DIR/gluster
	     # ./Remove

       pmdagluster  is	launched by pmcd(1) and should never be executed directly. The Install and Remove scripts notify pmcd(1) when the agent is
       installed or removed.

FILES

       $PCP_PMDAS_DIR/gluster/Install
	   installation script for the pmdagluster agent

       $PCP_PMDAS_DIR/gluster/Remove
	   undo installation script for the pmdagluster agent

       $PCP_LOG_DIR/pmcd/gluster.log
	   default log file for error messages from pmdagluster

PCP ENVIRONMENT

       Environment variables with the prefix PCP_ are used to parameterize the file and directory names used by PCP.  On  each	installation,  the
       file  /etc/pcp.conf contains the local values for these variables.  The $PCP_CONF variable may be used to specify an alternative configura-
       tion file, as described in pcp.conf(5).

SEE ALSO

       pmcd(1), pminfo(1), pmstore(1), and gluster(8)

Performance Co-Pilot							PCP							    PMDAGLUSTER(1)

We Also Found This Discussion For You

1. AIX

Very Active NFS and Disk Usage

Discussion started by: masterpengu

LEARN ABOUT CENTOS

pmdagluster