Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Shell script

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Shell script
# 1  
Old 02-17-2014
Shell script
Hi,

I want to parse csv file s.csv

Code:
a,b,server,c,d,e,f,g,h,i,j,k,l,m,n
1,ss,ip-login-date-01,1,2,3,4,5,6,7,8,9,1,2,3
1,dd,cd-login-01,2,3,4,5,6,7,8,9,1,2,3,4,
1,ww,ip-login-date-02,1,3,4,5,6,7,8,9,1,2,3,4
1,ff,gf-login-date-01,5,6,7,8,9,1,2,3,4,5,6,7
1,gg,ip-login-date-03,6,7,8,9,1,2,3,4,5,6,7,8

based on a particular name of the column,here say server,not sure that the column will always be in the second position
,it might be any column in the csv file.In that if the server name is name
for eg

Code:
ip-login-date-01
ip-login-date-02
ip-login-date-03

a,b,server,c,d,e,f,g,h,i,j,k,l,m,n

1,ss,ip-login-date-01,1,2,3,4,5,6,7,8,9,1,2,3
1,ww,ip-login-date-02,1,3,4,5,6,7,8,9,1,2,3,4
1,gg,ip-login-date-03,6,7,8,9,1,2,3,4,5,6,7,8

i wanted the output as

Code:
a,b,server,c,d,e,f,g,h,i,j,k,l,m,n
1,ss-ww-gg,ip-login-date,8,12,15,18,12,15,18,21,15,9,12,15

first column as it is
second column appending all those names separated with -
server name without sequence number i.e 01,02,03
remaining columns - sum
eg:
Code:
ip-login-date-01,1,2
ip-login-date-02,1,3
ip-login-date-03,6,7

6+1+1 = 8 in 4th column
7+3+2 = 12 in 5th column ....... and redirect output to k.csv
Last edited by Scott; 02-17-2014 at 09:58 AM.. Reason: Added more code tags
# 2  
Old 02-17-2014
So,
  • What have you tried so far?
  • What error, messages or output are you getting?
  • What Operating System and version are you running?
  • What are your preferred tools?
Most importantly, what have you tried so far?

It's better for you if you research, have a go and then ask for suggestions so that you learn and everyone else can see your thinking. That might help someone else out in future.



Regards,
Robin
# 3  
Old 02-18-2014
Hi,

I posted in this site after working a lot on this file.But i forgot to post wat i have tried.

I tried matching the pattern separating with - with the following

Code:
grep "[[:alnum:]].\+-.\+[[:alnum:]].\+-.\+[[:alnum:]].\+-.*" test.csv > cat>p.csv

my input file

Code:
Time,SubnetMask,ScopeName,percentFree,TotalDynamic,TotalReserved,Leased,Avail,otherAvail,PendingAvail,InTransition,ReservedActive,Unavail,ActiveDeactivated,Deactivated
20131203170000,171.99.192.0/23,SRT-PKT-ActiveSubCPE-13,87,509,0,66,399,44,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,MSKKBK13CM0-ActiveSubCM-01,35,3578,0,2300,1144,127,0,7,0,0,0,0,
20131203170000,110.169.128.0/23,SKW-09-ActiveSubCPE-01,0,504,0,504,0,0,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,MSKKBK13CM0-BZ-ActiveSubCM-01,100,248,0,0,224,24,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,Total,39,3826,0,2300,1368,151,0,7,0,0,0,0,
20131203170000,10.18.48.0/20,BNA-ActiveSubCM-02,81,4090,0,774,2982,331,0,3,0,0,0,0,
20131203170000,171.98.202.0/23,SKW-09-ActiveSubCPE-08,41,509,0,300,188,21,0,0,0,0,0,0,
20131203170000,10.18.48.0/20,Total,81,4090,0,774,2982,331,0,3,0,0,0,0,
20131203170000,10.18.64.0/20,SMSSBK01CM0-BZ-ActiveSubCM-01,100,504,0,0,454,50,0,0,0,0,0,0,
20131203170000,10.18.64.0/20,SMSSBK01CM0-ActiveSubCM-01,76,3576,0,834,2467,274,0,1,0,0,0,0,
20131203170000,171.99.150.0/23,SRT-PKT-ActiveSubCPE-07,0,509,0,509,0,0,0,0,0,0,0,0,
20131203170000,171.99.186.0/23,SKW-09-ActiveSubCPE-04,0,509,0,507,2,0,0,0,0,0,0,0,
20131203170000,171.99.172.0/23,Total,25,509,0,380,114,14,0,1,0,0,0,0,
20131203170000,171.99.174.0/23,PNC-ActiveSubCPE-05,47,509,0,269,216,24,0,0,0,0,0,0,
20131203170000,171.99.174.0/23,Total,47,509,0,269,216,24,0,0,0,0,0,0,

this matches the pattern [anything]-[anything]-[anything]-[someinteger]

and output those lines to p.csv

executed output

Code:
20131203170000,58.10.152.0/23,SRT-PKT-ActiveSubCPE-13,87,509,0,66,399,44,0,0,0,0,0,0,
20131203170000,171.99.150.0/23,SRT-PKT-ActiveSubCPE-07,0,509,0,509,0,0,0,0,0,0,0,0,

But i wanted the output in such a awy that

those two lines should be merged intio one single line with the fields from field number 4 added,field number 2 appended and the scope name as SRT-PKT-ActiveSubCPE

without succeeded by integer
i wonder why its not giving me the output with the lines matching pattern SKW-09-ActiveSubCPE

Required output

Code:
20131203170000,58.10.152.0/23+171.99.150.0/23,SRT-PKT-ActiveSubCPE,87,1018,0,575,399,44,0,0,0,0,0,0

Thanks in advance

Regards,
Preethy
Last edited by Scott; 02-18-2014 at 08:43 AM.. Reason: More code tags
# 4  
Old 02-18-2014
Code:
$ cat file
Time,SubnetMask,ScopeName,percentFree,TotalDynamic,TotalReserved,Leased,Avail,otherAvail,PendingAvail,InTransition,ReservedActive,Unavail,ActiveDeactivated,Deactivated
20131203170000,171.99.192.0/23,SRT-PKT-ActiveSubCPE-13,87,509,0,66,399,44,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,MSKKBK13CM0-ActiveSubCM-01,35,3578,0,2300,1144,127,0,7,0,0,0,0,
20131203170000,110.169.128.0/23,SKW-09-ActiveSubCPE-01,0,504,0,504,0,0,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,MSKKBK13CM0-BZ-ActiveSubCM-01,100,248,0,0,224,24,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,Total,39,3826,0,2300,1368,151,0,7,0,0,0,0,
20131203170000,10.18.48.0/20,BNA-ActiveSubCM-02,81,4090,0,774,2982,331,0,3,0,0,0,0,
20131203170000,171.98.202.0/23,SKW-09-ActiveSubCPE-08,41,509,0,300,188,21,0,0,0,0,0,0,
20131203170000,10.18.48.0/20,Total,81,4090,0,774,2982,331,0,3,0,0,0,0,
20131203170000,10.18.64.0/20,SMSSBK01CM0-BZ-ActiveSubCM-01,100,504,0,0,454,50,0,0,0,0,0,0,
20131203170000,10.18.64.0/20,SMSSBK01CM0-ActiveSubCM-01,76,3576,0,834,2467,274,0,1,0,0,0,0,
20131203170000,171.99.150.0/23,SRT-PKT-ActiveSubCPE-07,0,509,0,509,0,0,0,0,0,0,0,0,
20131203170000,171.99.186.0/23,SKW-09-ActiveSubCPE-04,0,509,0,507,2,0,0,0,0,0,0,0,
20131203170000,171.99.172.0/23,Total,25,509,0,380,114,14,0,1,0,0,0,0,
20131203170000,171.99.174.0/23,PNC-ActiveSubCPE-05,47,509,0,269,216,24,0,0,0,0,0,0,
20131203170000,171.99.174.0/23,Total,47,509,0,269,216,24,0,0,0,0,0,0,
20131203170000,171.99.192.0/23,SRT-PKT-ActiveSubCPE-13.5,87,509,0,66,399,44,0,0,0,0,0,0,
20131203170000,171.99.192.0/23,SRT-PKT-ActiveSubCPE-13.5 ,87,509,0,66,399,44,0,0,0,0,0,0,

Code:
awk '

  $0 ~ pattern"-[0-9]+,.*"{
				if(!n){
					n=split($0,A,/,/)
				      }
				 else {
					for(i=2;i<=9;i++)
					A[i] = i == 2 ? A[2] "+" $2 : i >3 ? (A[i]+=$i) : A[i] 
				      }				
			  }
  		       END{
				for(i=1;i<=n;i++){
							if(i==3)gsub(/-[0-9]+/,x,A[3])
							s = s ? s FS A[i] : A[i]		
						 }
				print s
     			  }
      ' FS=, pattern="SRT-PKT-ActiveSubCPE" file

Code:
$ bash tester
20131203170000,171.99.192.0/23+171.99.150.0/23,SRT-PKT-ActiveSubCPE,87,1018,0,575,399,44,0,0,0,0,0,0,

---------- Post updated at 08:27 PM ---------- Previous update was at 08:21 PM ----------

I could not find 58.10.152.0/23 in your datafile

Quote:
Originally Posted by preethy
Hi,

I posted in this site after working a lot on this file.But i forgot to post wat i have tried.

I tried matching the pattern separating with - with the following

Code:
grep "[[:alnum:]].\+-.\+[[:alnum:]].\+-.\+[[:alnum:]].\+-.*" test.csv > cat>p.csv

my input file

Code:
Time,SubnetMask,ScopeName,percentFree,TotalDynamic,TotalReserved,Leased,Avail,otherAvail,PendingAvail,InTransition,ReservedActive,Unavail,ActiveDeactivated,Deactivated
20131203170000,171.99.192.0/23,SRT-PKT-ActiveSubCPE-13,87,509,0,66,399,44,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,MSKKBK13CM0-ActiveSubCM-01,35,3578,0,2300,1144,127,0,7,0,0,0,0,
20131203170000,110.169.128.0/23,SKW-09-ActiveSubCPE-01,0,504,0,504,0,0,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,MSKKBK13CM0-BZ-ActiveSubCM-01,100,248,0,0,224,24,0,0,0,0,0,0,
20131203170000,10.18.32.0/20,Total,39,3826,0,2300,1368,151,0,7,0,0,0,0,
20131203170000,10.18.48.0/20,BNA-ActiveSubCM-02,81,4090,0,774,2982,331,0,3,0,0,0,0,
20131203170000,171.98.202.0/23,SKW-09-ActiveSubCPE-08,41,509,0,300,188,21,0,0,0,0,0,0,
20131203170000,10.18.48.0/20,Total,81,4090,0,774,2982,331,0,3,0,0,0,0,
20131203170000,10.18.64.0/20,SMSSBK01CM0-BZ-ActiveSubCM-01,100,504,0,0,454,50,0,0,0,0,0,0,
20131203170000,10.18.64.0/20,SMSSBK01CM0-ActiveSubCM-01,76,3576,0,834,2467,274,0,1,0,0,0,0,
20131203170000,171.99.150.0/23,SRT-PKT-ActiveSubCPE-07,0,509,0,509,0,0,0,0,0,0,0,0,
20131203170000,171.99.186.0/23,SKW-09-ActiveSubCPE-04,0,509,0,507,2,0,0,0,0,0,0,0,
20131203170000,171.99.172.0/23,Total,25,509,0,380,114,14,0,1,0,0,0,0,
20131203170000,171.99.174.0/23,PNC-ActiveSubCPE-05,47,509,0,269,216,24,0,0,0,0,0,0,
20131203170000,171.99.174.0/23,Total,47,509,0,269,216,24,0,0,0,0,0,0,

this matches the pattern [anything]-[anything]-[anything]-[someinteger]

and output those lines to p.csv

executed output

Code:
20131203170000,58.10.152.0/23,SRT-PKT-ActiveSubCPE-13,87,509,0,66,399,44,0,0,0,0,0,0,
20131203170000,171.99.150.0/23,SRT-PKT-ActiveSubCPE-07,0,509,0,509,0,0,0,0,0,0,0,0,

But i wanted the output in such a awy that

those two lines should be merged intio one single line with the fields from field number 4 added,field number 2 appended and the scope name as SRT-PKT-ActiveSubCPE

without succeeded by integer
i wonder why its not giving me the output with the lines matching pattern SKW-09-ActiveSubCPE

Required output

Code:
20131203170000,58.10.152.0/23+171.99.150.0/23,SRT-PKT-ActiveSubCPE,87,1018,0,575,399,44,0,0,0,0,0,0

Thanks in advance

Regards,
Preethy
# 5  
Old 02-18-2014
Seems good
# 6  
Old 02-18-2014
Who is "preethy" and who is "nivl" ? Double account ?
# 7  
Old 02-18-2014
Thanks Akshay Hegde for the fix. I was struggling a lot on this. It was really helpful

But the pattern SRT-PKT-ActiveSubCP is not fixed,means there may be anything between [ ]-[ ]-[ ]-[digit]
for eg i should parse the field scope name,if scope name is like this

SMSSBK01CM0-ActiveSubCM-01
SMSSBK01CM0-ActiveSubCM-02
SMSSBK01CM0-ActiveSubCM-03

SKW-09-ActiveSubCPE-01
SKW-09-ActiveSubCPE-02
SKW-09-ActiveSubCPE-03

i should obtain the string before last "-" and search for all possibilities of the string and merge all those lines into single line with the second field appended,field number 2 appended and the scope name excluding the part from last "-".what all scope names are there in input file i should get them in output file with the above said modifications

Thanks,
Preethy

---------- Post updated at 09:11 AM ---------- Previous update was at 09:10 AM ----------

sorry we both are working in same office,we both have accounts in unix.com.internet is not working fine in my system so i gave reply from her account,now its working fine.so i replied from my account
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script newbie- how to generate service log from shell script

Hi, I am totally a newbie to any programming languages and I just started an entry level job in an IT company. One of my recent tasks is to create a script that is able to show the log file of linux service (i.e. ntpd service) lets say, if I run my script ./test.sh, the output should be... (3 Replies)
Discussion started by: xiaogeji
3 Replies

2. Shell Programming and Scripting

Pass C shell array to another C shell script(csh) and shell(sh)

Dear Friends, Please help me on this my script name is send.csh In this i have written the statement like this set args = ( city state country price ) I want to pass this array to another c shell called receiver.csh. and i want to use it in this c shell or how to pass to... (2 Replies)
Discussion started by: SA_Palani
2 Replies

3. Shell Programming and Scripting

How to write config shell script to pass variables in master shell script?

Dear Unix gurus, We have a config shell script file which has 30 variables which needs to be passed to master unix shell script that invokes oracle database sessions. So those 30 variables need to go through the database sessions (They are inputs) via a shell script. one of the variable name... (1 Reply)
Discussion started by: dba1981
1 Replies

4. UNIX for Dummies Questions & Answers

How to write Config shell script to pass variables in master shell script?

Dear Unix gurus, We have a config shell script file which has 30 variables which needs to be passed to master unix shell script that invokes oracle database sessions. So those 30 variables need to go through the database sessions (They are inputs) via a shell script. one of the variable name... (1 Reply)
Discussion started by: dba1981
1 Replies

5. Shell Programming and Scripting

Unable to pass shell script variable to awk command in same shell script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk... (2 Replies)
Discussion started by: Ashunayak
2 Replies

6. Shell Programming and Scripting

Correct shell script to Call One shell script from another shell script

Hi All, I have new for shell scripting. Problem : I have one scrip at serv1 and path of server is /apps/dev/provimage/scripts and script name:extract_ancillary.bat. I need to call this script at server2(my working server) and execute at server2 . Please let me know how to build the... (5 Replies)
Discussion started by: Vineeta Nigam
5 Replies

7. Shell Programming and Scripting

call another shell script and pass parameters to that shell script

Hi, I basically have 2 shell scripts. One is a shell script will get the variable value from the user. The variable is nothing but the IP of the remote system. Another shell script is a script that does the job of connecting to the remote system using ssh. This uses a expect utility in turn. ... (2 Replies)
Discussion started by: sunrexstar
2 Replies

8. Shell Programming and Scripting

How to use ssh execute other shell script on other host (shell script include nohup)?

i want use ssh on the host01 to execute autoexec.sh on the host02 like following : host01> ssh host02 autoexec.sh autoexec.sh include nohup command like follwing : nohup /home/jack/deletedata.sh & after i execute ssh host02 autoexec.sh one the host01. i can't found deletedata.sh... (1 Reply)
Discussion started by: orablue
1 Replies

9. Shell Programming and Scripting

invoking a shell script inside cgi shell script

Hi, I have an HTML form through which I get some text as input. i need to run a shell script say script.sh inside a perl-cgi script named main_cgi.sh on the form input. I want to write the contents of the form in a file and then perform some command line operations like grep, cat on the text... (2 Replies)
Discussion started by: smriti_shridhar
2 Replies

10. Shell Programming and Scripting

How to Run a shell script from Perl script in Parent shell?

Hi Perl/UNIX experts, I have a problem in running a shell script from my perl script (auto.pl). I run the perl script using perl auto.pl from the shell prompt The shell script picks the files in "input" folder and procesess it. The shell script blue.sh has this code. export... (16 Replies)
Discussion started by: hifake
16 Replies
Login or Register to Ask a Question