Question related to UNIX and Oracle DB


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Question related to UNIX and Oracle DB
# 1  
Old 10-19-2013
Question related to UNIX and Oracle DB

I have one application server, which is Solaris non global zone (dsapid02-dt3d02 - 10.63.76.96) and a database server, which is Linux (db1-serv26 - 10.63.36.117 & 10.63.36.118).
Whenever database admin is starting listener, it starts filling listener log file. Within minutes, it will make file in gigabytes.
Scenerio - There were 5 databases running on db1-serv26. One of the database, T3IA was using port 1558. A month back all those 5 databases were migrated to another server and all file-systems on db1-serv26 were removed after that, so no listener was listening on 1558 and other ports used by T3 QA databases on db1-serv26.
Now there is a new requirement of creation of new database on db1-serv26, which should use port 1558. The moment database administrator configure 1558 port, a number of processes from IP 10.63.76.96 (dsapid02-dt3d02) from different ports (59881, 59882, 59883, 59884, 59885, 59886, etc) started trying to connect to T3IA database on db1-serv26 on port 1558. As 1558 is now being used by newely created database, and not by T3IA, the connections were not successful, and hence started generating following errors in large number
Code:
TNS-12514: TNS:listener does not currently know of service requested in connect descriptor
18-OCT-2013 22:32:39 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=__jdbc__)(USER=))(SERVICE_NAME=T3IA.tms.toyota.com)) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.63.76.96)(PORT=39372)) * establish * T3IA.tms.toyota.com * 12514
TNS-12514: TNS:listener does not currently know of service requested in connect descriptor
18-OCT-2013 22:32:39 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=__jdbc__)(USER=))(SERVICE_NAME=T3IA.tms.toyota.com)) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.63.76.96)(PORT=39385)) * establish * T3IA.tms.toyota.com * 12514

On Solaris box (dsapid02-dt3d02) -->
Code:
root@dsapid02-dt3d02:/# netstat -an | grep 1558| grep ESTA | wc -l
      24
root@dsapid02-dt3d02:/# netstat -an | grep 1558| grep CLOSE_WAIT | wc -l
     816
root@dsapid02-dt3d02:/# netstat -an | grep 1558| grep CLOSE_WAIT | head
10.63.76.96.44310    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.45893    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.62334    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.49056    10.63.36.117.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.63381    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.38431    10.63.36.117.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.54637    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.53052    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.48458    10.63.36.118.1558     6912      0 131768      0 CLOSE_WAIT
10.63.76.96.56239    10.63.36.117.1558     6912      0 131768      0 CLOSE_WAIT
root@dsapid02-dt3d02:/#

Can somebody help me to find this issue, where I need to hit ?
# 2  
Old 10-19-2013
Check the process that is repeatedly trying to connect (not sure if your netstat has the -p option). Remove/modify it.
# 3  
Old 10-19-2013
If I check 1558 port is being used by which process (through a script), I get this output.
Code:
root@dsapid02-dt3d02:/# /tmp/check_port
Enter port you would like to know pid for: 1558
---------------------------------------------
Port: 1558 is being used by PID: 1330 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID: 5569 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:23183 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID: 6411 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:17983 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID: 2958 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:28607 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:21057 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:17826 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:29999 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID: 1888 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:11236 /t3/apps/Oracle/Middleware/10.3.5/jdk160_24/bin/java -server -Xms2048m -Xmx2048
---------------------------------------------
Port: 1558 is being used by PID:13689 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:20985 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID: 1672 java T3LinkValidator
---------------------------------------------
Port: 1558 is being used by PID:23303 java T3LinkValidator
^Croot@dsapid02-dt3d02:/# ps -ef | grep T3LinkValidator | wc -l
      22
root@dsapid02-dt3d02:/#

Are you asking me this one ?
Yes, I can run "netstat -p" on my server.
# 4  
Old 10-19-2013
What's that T3LinkValidator for? Checking an invalid link (as you moved the database to another server)? Can you point it to the correct server? Can you stop/remove it, as it has proven to be unnecessary for a month?
# 5  
Old 10-19-2013
T3LinkValidator is another application running on this server.
Code:
root@dsapid02-dt3d02:/# ptree 29485
29401 zsched
  198   /usr/sbin/cron
    29481 sh -c /t3/data/link-extractor/PDFExtractor.sh > /t3/data/link-extractor/logs/T3
      29485 /bin/bash /t3/data/link-extractor/PDFExtractor.sh
        29878 java T3LinkValidator
root@dsapid02-dt3d02:/# ptree 19406
29401 zsched
  198   /usr/sbin/cron
    19402 sh -c /t3/data/link-extractor/PDFExtractor.sh > /t3/data/link-extractor/logs/T3
      19406 /bin/bash /t3/data/link-extractor/PDFExtractor.sh
        21695 java T3LinkValidator
root@dsapid02-dt3d02:/#

Is it something, which needs to be taken care by owner of this application to point to correct db server and not to be taken care by db admin or sys admin ? If I know, it is broken at which level, I can get hold of that person/team.
# 6  
Old 10-20-2013
The owner is the right person to talk to. That thing is obiously broken as it it validating an inexistent link. If that didn't catch anybody's eye, chances are good that it can go away without replacement.
# 7  
Old 10-23-2013
Solaris1977,

I think you need to talk to your dba to lessen the logs output or put the logs to syslog server if you may and rotate the logs.

I think based on your screenshots its not your fault as admin. i think this is a DBA issue. =) pass the ball mate.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Question related to 'ps'

If I run a script called 'abc.sh' and then execute the following : ps -ef | grep 'abc.sh' I always get two rows of output, one for the executing script, and the other for the grep command that I have triggered after the pipe. Questions: Why does the second row turn up in the results. My... (10 Replies)
Discussion started by: jawsnnn
10 Replies

2. Shell Programming and Scripting

need downloading related help...but its not related to unix

Hi All, I am trying to dowmload the zip file "zkManageCustomers.zip " but i dont have access. Can anyone help me to download this file See the below link- http://www.ibm.com/developerworks/opensource/library/wa-aj-open/index.html?ca=drs- Please help me as early as... (1 Reply)
Discussion started by: aish11
1 Replies

3. Shell Programming and Scripting

awk related question

awk "/^<Mar 31, 2012 : /,0" /app/blah.log can someone please help me figure out why the above command isn't pulling anything out from the log? basically, i want it to pull out all records, from the very first line that starts with the date "Mar 31, 2012" and that also has a time immediately... (4 Replies)
Discussion started by: SkySmart
4 Replies

4. Shell Programming and Scripting

having df command related question

Hi All, When i have run the below command its showing 90% which is critical for production. for this i need the answer of some below question please help me for that. 1) i want to delete some unwanted files. how can i know the unwanted files ?Is it there any way of knowing this?? 2)and... (2 Replies)
Discussion started by: aish11
2 Replies

5. Solaris

RBAC related question.....

I am referring Bill Calkins(SCSA exam prep) for RBAC..actually i wanted to make a normal user to get the privilege to run a command through authorization, not through profile files... This is the exact steps given by Bill calkins.. 1.roleadd -m -d /export/home/adminusr -c... (11 Replies)
Discussion started by: saagar
11 Replies

6. UNIX for Advanced & Expert Users

DOS messaging question - related to UNIX process problem

Hi, This is a strange request. I know there is some sort of crude DOS tool that allows you to communicate to another PC either using its IP adress or PC name. But I can't remember where aor what its called, any ideas? Reason for asking here, Someone has telnet'd on a UNIX server I have... (0 Replies)
Discussion started by: nhatch
0 Replies

7. UNIX for Advanced & Expert Users

One Question related to alias

Hello, I have created following alias in csh lab 'rlogin -l user23 complab23' but problem is complab23 does not allow automatic login by checking .rhosts file. So after typing lab on command line I have to type complicate password and if wrong password is typed thrice then account gets... (4 Replies)
Discussion started by: neerajrathi2
4 Replies

8. UNIX for Dummies Questions & Answers

oracle related

Plz. help me for returning set of values from oracle to unix array? (1 Reply)
Discussion started by: harsh_kats
1 Replies

9. UNIX for Dummies Questions & Answers

Question related to Emailing from UNIX

Hi All, I would like to write a script which sends an email to clients. mailx -s "TEST" $EMAIL_RECIPIENTS < FILE ...will send an email to EMAIL_RECIPIENTS with TEST as the subject and FILE as the body. Now I have a another CONTROL_FILE which is constant all the times (FILE in the above... (1 Reply)
Discussion started by: jingi1234
1 Replies

10. UNIX for Dummies Questions & Answers

A Question related to the net

well, I was suggested to remove the contents of the cache as i get out of the browser netscape from the .netscape folder. is that really necessary? if so what are the rest to be done? can anybody please tell me?:rolleyes: (8 Replies)
Discussion started by: sskb
8 Replies
Login or Register to Ask a Question