Login or Register to Ask a Question and Join Our Community


AIX

NAGIOS Service not able to open port on AIX 7.1

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems AIX NAGIOS Service not able to open port on AIX 7.1
# 1  
Old 09-04-2018
NAGIOS Service not able to open port on AIX 7.1
I have an AIX 7.1 LPAR where Nagios agent was installed for monitoring. The issue is that when I start the nagios service (ncpa_listener), it starts but does not open the 5693 port it requires for communication. On all other LPARs the service opens the port and is listening. I tried reinstalling the agent. Sometimes, when I try to stop the service it goes into a stopping state and has to be killed forcefully. The oslevel is 7100-05-01-1731. The LPAR has about 120GB of memory and 6 CPUs as entitled capacity. This is an Oracle DB DR server. Please let me know if more details are required.

I tried to see if there is anything using the port using netstat -an | grep 5693. I also checked the services file to see if any service is already using this port, but there was nothing in both cases.

------ Post updated at 12:22 PM ------

I just wanted to add one more thing. If I do a "telnet localhost 5693", I don't get a telnet prompt. But on all other LPARs, the telnet connects and gives a prompt. I can't seem to think of a reason why the service should not be able to open an unused port.
# 2  
Old 09-05-2018
What do your Nagios agent startup logs say?


Maybe you can post the recent output of this logfile:

Code:
/usr/local/nagios/var/nagios.log

# 3  
Old 09-07-2018
Below are the logs. I don't see anything which can help me with the port issue.

Code:
/usr/local/ncpa/var/log#tail -50 ncpa_listener.log
2018-07-29 19:35:38,563 62456054 INFO 172.23.103.81 - - [2018-07-29 19:35:38] "GET /api/disk/logical/%7CARCH_MYMONEY_DR/used_percent/?token=XhRJ5
PTsL&warning=70&critical=90&check=1 HTTP/1.1" 200 242 0.082072
2018-07-29 19:35:41,910 62456054 INFO 172.23.103.81 - - [2018-07-29 19:35:41] "GET /api/disk/logical/%7CARCH_REPORT_DR/used_percent/?token=XhRJ5S
TsL&warning=70&critical=90&check=1 HTTP/1.1" 200 242 0.050659
2018-07-29 19:35:44,978 62456054 INFO 172.23.103.81 - - [2018-07-29 19:35:44] "GET /api/disk/logical/%7Cor11_6/used_percent/?token=XhRJ5ScGPTsL&w
ing=70&critical=90&check=1 HTTP/1.1" 200 242 0.115249
2018-07-29 19:35:51,887 62456054 INFO 172.23.103.81 - - [2018-07-29 19:35:51] "GET /api/disk/logical/%7CARCH_TPPPROD_DR/used_percent/?token=XhRJ5
PTsL&warning=70&critical=90&check=1 HTTP/1.1" 200 242 0.056481
2018-07-29 19:36:02,089 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:02] "GET /api/disk/logical/%7CCTM/used_percent/?token=XhRJ5ScGPTsL&warn
=70&critical=90&check=1 HTTP/1.1" 200 239 0.051827
2018-07-29 19:36:10,775 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:10] "GET /api/disk/logical/%7Cdbfs/used_percent/?token=XhRJ5ScGPTsL&war
g=70&critical=90&check=1 HTTP/1.1" 200 242 0.186102
2018-07-29 19:36:11,828 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:11] "GET /api/disk/logical/%7CCDCSOFTMMMA/used_percent/?token=XhRJ5ScGP
&warning=70&critical=90&check=1 HTTP/1.1" 200 242 0.112948
2018-07-29 19:36:21,192 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:21] "GET /api/disk/logical/%7CDBScripts/used_percent/?token=XhRJ5ScGPTs
arning=70&critical=90&check=1 HTTP/1.1" 200 242 0.074064
2018-07-29 19:36:27,303 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:27] "GET /api/disk/logical/%7Cvar/used_percent/?token=XhRJ5ScGPTsL&warn
=70&critical=90&check=1 HTTP/1.1" 200 247 0.045942
2018-07-29 19:36:30,496 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:30] "GET /api/disk/logical/%7Cexport/used_percent/?token=XhRJ5ScGPTsL&w
ing=70&critical=90&check=1 HTTP/1.1" 200 242 0.172986
2018-07-29 19:36:40,537 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:40] "GET /api/disk/logical/%7Chome/used_percent/?token=XhRJ5ScGPTsL&war
g=70&critical=90&check=1 HTTP/1.1" 200 242 0.155030
2018-07-29 19:36:50,784 62456054 INFO 172.23.103.81 - - [2018-07-29 19:36:50] "GET /api/disk/logical/%7Copt/used_percent/?token=XhRJ5ScGPTsL&warn
=70&critical=90&check=1 HTTP/1.1" 200 242 0.124295
2018-07-29 19:37:01,410 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:01] "GET /api/disk/logical/%7Cadmin/used_percent/?token=XhRJ5ScGPTsL&wa
ng=70&critical=90&check=1 HTTP/1.1" 200 239 0.056164
2018-07-29 19:37:10,224 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:10] "GET /api/disk/logical/%7Cusr/used_percent/?token=XhRJ5ScGPTsL&warn
=70&critical=90&check=1 HTTP/1.1" 200 242 0.054711
2018-07-29 19:37:20,011 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:20] "GET /api/disk/logical/%7Ctmp/used_percent/?token=XhRJ5ScGPTsL&warn
=70&critical=90&check=1 HTTP/1.1" 200 242 0.051173
2018-07-29 19:37:26,371 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:26] "GET /api/disk/logical/%7Cvar/used_percent/?token=XhRJ5ScGPTsL&warn
=70&critical=90&check=1 HTTP/1.1" 200 247 0.071834
2018-07-29 19:37:28,804 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:28] "GET /api/disk/logical/%7C/used_percent/?token=XhRJ5ScGPTsL&warning
&critical=90&check=1 HTTP/1.1" 200 242 0.288115
2018-07-29 19:37:46,452 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:46] "GET /api/disk/logical/%7Cproc/used_percent/?token=XhRJ5ScGPTsL&war
g=70&critical=90&check=1 HTTP/1.1" 200 250 0.043516
2018-07-29 19:37:50,129 62456054 INFO 172.23.103.81 - - [2018-07-29 19:37:50] "GET /api/disk/logical/%7Cibmperf/used_percent/?token=XhRJ5ScGPTsL&
ning=70&critical=90&check=1 HTTP/1.1" 200 242 0.162522
2018-07-29 19:38:05,755 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:05] "GET /api/disk/logical/%7Cor11_163/used_percent/?token=XhRJ5ScGPTsL
rning=70&critical=90&check=1 HTTP/1.1" 200 242 0.123206
2018-07-29 19:38:22,439 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:22] "GET /api/disk/logical/%7Cor11_5/used_percent/?token=XhRJ5ScGPTsL&w
ing=70&critical=90&check=1 HTTP/1.1" 200 242 0.042097
2018-07-29 19:38:31,503 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:31] "GET /api/disk/logical/%7Corasr5/used_percent/?token=XhRJ5ScGPTsL&w
ing=70&critical=90&check=1 HTTP/1.1" 200 242 0.047661
2018-07-29 19:38:38,962 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:38] "GET /api/disk/logical/%7CARCH_STAGCDC_DR/used_percent/?token=XhRJ5
PTsL&warning=70&critical=90&check=1 HTTP/1.1" 200 239 0.066742
2018-07-29 19:38:42,470 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:42] "GET /api/disk/logical/%7CCDCSOFTSTAG/used_percent/?token=XhRJ5ScGP
&warning=70&critical=90&check=1 HTTP/1.1" 200 247 0.068118
2018-07-29 19:38:57,421 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:57] "GET /api/memory/virtual/?token=XhRJ5ScGPTsL&warning=85&critical=90
its=Gi&check=1 HTTP/1.1" 200 387 0.079366
2018-07-29 19:38:57,932 62456054 INFO 172.23.103.81 - - [2018-07-29 19:38:57] "GET /api/cpu/percent/?token=XhRJ5ScGPTsL&warning=85&critical=90&ch
=1&aggregate=avg HTTP/1.1" 200 229 0.676725
2018-07-29 19:39:07,876 62456054 INFO 172.23.103.81 - - [2018-07-29 19:39:07] "GET /api/disk/logical/%7CCDCDATAMMMA/used_percent/?token=XhRJ5ScGP
&warning=70&critical=90&check=1 HTTP/1.1" 200 239 0.084986
2018-07-29 19:39:08,859 62456054 INFO 172.23.103.81 - - [2018-07-29 19:39:08] "GET /api/memory/swap/?token=XhRJ5ScGPTsL&warning=30&critical=40&un
=Gi&check=1 HTTP/1.1" 200 330 0.082764
2018-07-29 19:39:12,904 62456054 INFO 172.23.103.81 - - [2018-07-29 19:39:12] "GET /api/disk/logical/%7Cvar%7Cadm%7Cras%7Clivedump/used_percent/?
en=XhRJ5ScGPTsL&warning=70&critical=90&check=1 HTTP/1.1" 200 239 0.048158
2018-07-29 19:39:17,578 62456054 INFO 172.23.103.81 - - [2018-07-29 19:39:17] "GET /api/disk/logical/%7CCDCDATASTAG/used_percent/?token=XhRJ5ScGP
&warning=70&critical=90&check=1 HTTP/1.1" 200 239 0.150568
2018-07-29 19:39:34,103 62456054 INFO 172.23.103.81 - - [2018-07-29 19:39:34] "GET /api/disk/logical/%7CCDCDATATPPPROD/used_percent/?token=XhRJ5S
TsL&warning=70&critical=90&check=1 HTTP/1.1" 200 239 0.098944
2018-07-29 19:39:56,727 62456054 INFO 172.23.103.81 - - [2018-07-29 19:39:56] "GET /api/disk/logical/%7CCDCSOFTTPPPROD/used_percent/?token=XhRJ5S
TsL&warning=70&critical=90&check=1 HTTP/1.1" 200 242 0.114090
2018-08-09 22:11:06,089 47448130 INFO started
2018-08-09 22:14:39,071 47448138 INFO started
2018-08-09 22:52:45,887 47448138 INFO stopped
2018-08-09 22:59:59,896 15270034 INFO started
2018-08-16 14:46:18,123 15270034 INFO stopped
2018-08-16 15:36:39,075 49414344 INFO started
2018-08-16 15:36:54,761 49414344 INFO stopped
2018-08-16 15:38:47,656 46727418 INFO started
2018-08-16 15:40:06,202 51904760 INFO started
2018-08-16 15:40:47,708 46727212 INFO started
2018-08-16 15:42:48,639 44761154 INFO started
2018-08-16 15:47:01,135 62980292 INFO started
2018-08-16 15:53:15,527 58458112 INFO started
2018-08-16 15:54:18,140 58458112 INFO stopped
2018-08-20 22:24:18,533 58458136 INFO started
2018-08-28 22:13:33,386 58458136 INFO stopped
2018-08-31 07:47:07,234 2490720 INFO started

This User Gave Thanks to wibhore For This Post:
Neo
# 4  
Old 09-08-2018
Maybe you need to change the logging level to get more information?

You should be able to get a more verbose logging level and then you can attempt to connect to the port and see the errors.

There is always a log file somewhere that can help you sort this out.

You just need to find the right log and the right logging level.
# 5  
Old 09-09-2018
Some other debugging tips:
If the telnet terminates with "connection refused" then there is no listener.
The listener and a connection to it is shown with netstat.
You can start the service daemon with truss -f to see what it does.
This User Gave Thanks to MadeInGermany For This Post:
wibhore
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. AIX

Nagios for AIX 7.1

Hello All, I am new to Nagios. I have a requirement to monitor AIX 7.1 using Nagios xi, could any one guide me steps to go in right direction. I know Nagios doesn't have precompiled agent and plugin for aix 7.1. Appreciate your help (2 Replies)
Discussion started by: bsivavani
2 Replies

2. Solaris

Cabling and adapters to communicate to service processor serial port from Windows PC with USB port.

Hello, I have an unloaded T5140 machine and want to access the ILOM for the first time and subsequently the network port after that., and then load Solaris 10 the final January 2011 build. The first part is what confuses me -the cabling. I am coming from a Windows machine (w/appropriate... (5 Replies)
Discussion started by: joboy
5 Replies

3. IP Networking

Tcp ip port open but no such process (merged: Release A Port)

i want to kill a tcp connection by killing its pid with netstat -an i got the tcp ip connection on port 5914 but when i type ps -a or ps-e there is not such process running on port 5914 is it possible that because i do not log on with proper user account i can not see that process running? (30 Replies)
Discussion started by: alinamadchian
30 Replies

4. Programming

Using Different port for Daytime Service

Hi all, is it possible to use a different port number for daytime service. By default the port number of daytime service is 13, so what if I want to get the time from a different port number e.g say 9000 (or any other port). I guess this would remain the same on the server side !... (2 Replies)
Discussion started by: manisum
2 Replies

5. AIX

How to open port 1001 on AIX 6.1

Hi all, I have problem while starting Oracle Listener on port 1001(I think it's well known ports). It's error "Permission denied" I can start it on port 1111 and no any service started on port 1001(netstat -an). Can I start on this port ??, How ?? Thank you aRm (5 Replies)
Discussion started by: arm_naja
5 Replies

6. Shell Programming and Scripting

Parsing Nagios service config files with awk

Hope someone can help, I've been pulling my hair out with this one... I've written a shell script that does a sanity check on our quite extensive Nagios configuration for anything that needs cleaning up but wouldn't make the Nagios daemon necessarily bork or complain. One section of the script... (2 Replies)
Discussion started by: vinbob
2 Replies

7. Web Development

Need to run Nagios Web Interface on a different port

Hi, During Nagios install we added the following piece of config to apache httpd.conf file and it runs on the regular port 80, now if I want to run this on a different port then what needs to changed to make it run on lets say port 8080. I tried adding Virtual servers but was getting... (1 Reply)
Discussion started by: jacki
1 Replies

8. Infrastructure Monitoring

Using SMF to register & start a (Nagios) service

I'm trying to register & start a service using SMF on Solaris 10. It's nsca, part of the Nagios monitoring system. I've got nsca running fine as a detached process, and can manually create passive checks via send_nsca. But when I try to run nsca as a daemon, I need some advice. The nsca... (0 Replies)
Discussion started by: lyle
0 Replies

9. IP Networking

Unknown open port: "6881/tcp open bittorrent-tracker" found with nmap

Hi. I ran nmap on my server, and I get the following: Starting Nmap 4.76 ( http://nmap.org ) at 2009-03-19 16:33 EDT Interesting ports on -------- (-----): Not shown: 997 closed ports PORT STATE SERVICE 22/tcp open ssh 80/tcp open http 6881/tcp open bittorrent-tracker The... (0 Replies)
Discussion started by: Rledley
0 Replies

10. AIX

How to open a port in AIX

Hi Guys, i am trying to open a port in AIX. but i am not able to get the command for this. AIX is not having the iptables file present. So please any body can tell me how to open a port in AIX... Thanks sanju (2 Replies)
Discussion started by: sanju_d1231
2 Replies
Login or Register to Ask a Question