Help with awk/sed


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with awk/sed
# 1  
Old 02-17-2012
Help with awk/sed

Hi,
I am a newbie in UNIX and need a help here .
I have a file from which I need to extract data based on a certain search pattern.
E.g, consider the below file

/* ----------- IB_QEF_INF_1244_DMFullBox_job------------*/
##########some data##########
##########some data##########

/* ----------- IB_QEF_INF_1244_DMGRPFPMSIn_Box -----------*/

##########some data##########
##########some data##########
/* ------------- IB_QEF_INF_1244_DMGRPFPMS_Box ---------- */
##########some data##########
##########some data##########


Now, I need to extract the data between the patterns /* ----------- IB_QEF_INF_1244_DMFullBox_job------------*/
and /* ----------- IB_QEF_INF_1244_DMGRPFPMSIn_Box -----------*/.

Like this I have numberous different patterns starting with the same word IB_QEF_INF_1244*

Hope I am clear with the requirement.

Thanks

Now there's one more catch, I need to extract the data and store in a separate files with the same name given with in the pattern ( IB_QEF_INF_1244_DMFullBox_job and IB_QEF_INF_1244_DMGRPFPMSIn_Box).

Last edited by Kishlay; 02-17-2012 at 03:18 AM.. Reason: updates more info
# 2  
Old 02-17-2012
Code:
$ awk '/\/\*/{print $3}' input.txt
IB_QEF_INF_1244_DMFullBox_job
IB_QEF_INF_1244_DMGRPFPMSIn_Box
IB_QEF_INF_1244_DMGRPFPMS_Box

---------- Post updated at 01:27 PM ---------- Previous update was at 01:25 PM ----------

For storing all jobs jil information, run the below command
Code:
 
awk '/\/\*/{print $3}' input.txt | while read job; do autorep -q -J $job > $job; done

# 3  
Old 02-17-2012
Thanks for the help.
But probably I was not clear with the requirements. Smilie

In my case, the autosys jil files are not stored in server. so cant use autorep command.
The definitions are stored in a separate file and from that I want 1 file for each of the job definitions.

E.g. consider if my file contains 20 job definitions then I need 20 different files containing job definition of each one of them.

The awk command which u have provided will only extract the different job names from my file but not the definition.Smilie
# 4  
Old 02-17-2012
is one of your box job contains one more box job inside ?

Code:
 
box
||
---box
     ||---box

# 5  
Old 02-17-2012
My files contains all the job definitions of one server (irrespective of box/child jobs).
I created this file using a perl script during migration of Autosys 4 to Autosys 11.

Say If I have 20 jobs in my server then the file lists all 20 jobs (box+child) in a random order.

Now what I need is 20 different files for 20 jobs with their corresponding definitions.
Considering the above eg
* ----------- IB_QEF_INF_1244_DMFullBox_job------------*/
##########some data##########
##########some data##########

/* ----------- IB_QEF_INF_1244_DMGRPFPMSIn_Box -----------*/

##########some data##########
##########some data##########
/* ------------- IB_QEF_INF_1244_DMGRPFPMS_Box ---------- */
##########some data##########
##########some data##########

Now what I need is 3 different files (IB_QEF_INF_1244_DMFullBox_job,IB_QEF_INF_1244_DMGRPFPMSIn_Box and IB_QEF_INF_1244_DMGRPFPMS_Box ) with their corresponding definitions (some data)
# 6  
Old 02-17-2012
Code:
awk '/[Bb]ox/{a=$3;print >> a} !/[Bb]ox/ {print >>a}' input.txt

# 7  
Old 02-17-2012
itkamaraj, this too will not help since the names doesn't necessarily contain the 'box' word and I want the job definitions too with the different files.

Can't we search for the next occurence of the string /* ------------- IB_QEF_INF_1244 and fetch all the data in between the two occurences and then store the data in a separate file named by the job name which can be fetched using the first command whihc u provided.

I am a beginner in awk/sed, so couldn't formulate a command/script which will do the same.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed and awk giving error ./sample.sh: line 13: sed: command not found

Hi, I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

2. Shell Programming and Scripting

Is this possible using SED and AWK?

Dear Geeks, I want to manipulate a file with certain modifications for that using sed or AWK how to do this process for one file i have this type of data. Input File: "Restricted and Reserved names .ANISH",3798,"TEST.CO",1201208,6/16/10 0:00,6/16/13 0:00,,,"CO","2nd"^M "Restricted and... (4 Replies)
Discussion started by: anishkumarv
4 Replies

3. UNIX for Dummies Questions & Answers

sed/awk or help please

I have a file that contain the data below: B1 1 2 3 B2 20 30 40 B3 7 8 B4 100 B5 21 22 23How can I retrieve the data for B1 into a seperate file. (8 Replies)
Discussion started by: bobo
8 Replies

4. Shell Programming and Scripting

Need help using awk or sed.

Hi All, Is there a way of comparing two columns in the same file and deleting the row if the values of the columns match. I have the sample data file as below. M024900|175309.00|968.00|17 M025001|19861.79|97.90|148 M025002|431.70|159.00|3 M025003|912.30|159.90|6 ... (6 Replies)
Discussion started by: nua7
6 Replies

5. Shell Programming and Scripting

Using sed or awk?

What if I wanted to add a word such as IT after the first character and if theres 3 characters, after the 2nd character? output would be: G, it H G, H it P G, H, P it L I'm thinking that AWK would be the easiest way to do this... Currently looking it up. Right now I'm using awk but I... (13 Replies)
Discussion started by: puttster
13 Replies

6. UNIX for Dummies Questions & Answers

sed or awk?

I've got an inventory database with eight columns with things like product name, manufacturer, UPC code, etc. on each line. Our PO (purchase order) number is in the first column. I can grep the date and get the full line of data but I would like to strip out everything but the PO number in the... (5 Replies)
Discussion started by: NetJones
5 Replies

7. UNIX for Advanced & Expert Users

Awk or Sed help

Hi, I have a data file with 5 columns - like this: "20080401 09:43:08.770798 +0100s","TEST 1","R 1","A TEST","Nov 27 2007","1" "20080401 09:43:08.770798 +0100s","THIS IS A TEST","R 2","B TEST","Nov 30 2007","10" "20080401 09:43:08.770798 +0100s","ANOTHER TEST","R 3","B TEST","Nov 05... (7 Replies)
Discussion started by: MrG-San
7 Replies

8. UNIX for Advanced & Expert Users

sed in awk ? or nested awk ?

Hey all, Can I put sed command inside the awk action ?? If not then can i do grep in the awk action ?? For ex: awk '$1=="174" { ppid=($2) ; sed -n '/$ppid/p' tempfind.txt ; }' tempfind.txt Assume: 174 is string. Assume: tempfind.txt is used for awk and sed both. tempfind.txt... (11 Replies)
Discussion started by: varungupta
11 Replies

9. Shell Programming and Scripting

sed,awk

Hi, I know sed is stream text editor and not a bit more than that. Can anyone explain its usage and advantages? How is awk different from sed? I donno i am a bit confused about it. But i have coded in awk and shell. Thanks, Nisha :confused: (7 Replies)
Discussion started by: Nisha
7 Replies

10. Shell Programming and Scripting

awk / sed

I have many messages such as the test message below: 00:00000:00021:2002/05/13 13:57:00.51 ERROR:- Test error, my test error!!! I am writing a script in which I need to get everything from the word "ERROR:-" onwards. I normally use awk for these things, but I am not an expert at it so i am... (6 Replies)
Discussion started by: baileyr1
6 Replies
Login or Register to Ask a Question