Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

How to extract a piece of information from a huge file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to extract a piece of information from a huge file
# 1  
Old 03-13-2008
How to extract a piece of information from a huge file
Hello All,

I need some assistance to extract a piece of information from a huge file.
The file is like this one :

database information

ccccccccccccccccc
ccccccccccccccccc
ccccccccccccccccc
ccccccccccccccccc

os information

cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc

application information

cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc

I would like to slipt the information in 3 different files or extract it to 3 different files : database_infomation.txt, os_information.txt, application_information.txt.

Let me know if you have any suggestion using AWK.
Thanks,
Marco
# 2  
Old 03-13-2008
Code:
awk '{ if ($2=="information") {outfile=sprintf("%s%s.txt", $1,$2)}
        print $0 > outfile
      }'  infile

output:
Quote:
csadev:/home/jmcnama> cat databaseinformation.txt

aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa

csadev:/home/jmcnama> cat osinformation.txt

bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc

csadev:/home/jmcnama> cat applicationinformation.txt

cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
input:
Quote:
database information

aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa

os information

bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc

application information

cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
# 3  
Old 03-13-2008
Additional information
Thanks for the previous answer, but what can I do if the headers are different? Smilie

Ex :

database xxx

aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaa

os yyy

bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc
bbbbbbbbbbbbbbbbbc

application www

cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc
cccccccccccccccccc

Thanks!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract information from file

In a particular directory, there can be 1000 files like below. filename is job901.ksh #!/bin/ksh cront -x << EOJ submit file=$PRODPATH/scripts/genReport.sh maxdelay=30 &node=xnode01 tname=job901 &pfile1=/prod/mldata/data/test1.dat ... (17 Replies)
Discussion started by: vedanta
17 Replies

2. Shell Programming and Scripting

Extract information from file

Gents, If is possible please help. I have a big file (example attached) which contends exactly same value in column, but from column 2 to 6 these values are diff. I will like to compile for all records all columns like the example attached in .csv format (output.rar ).. The last column in the... (11 Replies)
Discussion started by: jiam912
11 Replies

3. Shell Programming and Scripting

Extract information from txt file

Hello! I need help :) I have a file like this: AA BC FG RF TT GH DD FF HH (a few number of rows and three columns) and I want to put the letters of each column in a variable step by step in order to give them as input in another script. So I would like to obtain: for the 1° loop:... (11 Replies)
Discussion started by: edekP
11 Replies

4. Shell Programming and Scripting

How to extract information from a file?

Hi, i have a file like this: <Iteration> <Iteration_iter-num>3</Iteration_iter-num> <Iteration_query-ID>lcl|3_0</Iteration_query-ID> <Iteration_query-def>G383C4U01EQA0A length=197</Iteration_query-def> <Iteration_query-len>197</Iteration_query-len> ... (9 Replies)
Discussion started by: the_simpsons
9 Replies

5. Shell Programming and Scripting

Extract various information from a log file

Hye ShamRock If you can help me with this difficult task for me then it will save my day Logs : ================================================================================================================== ... (4 Replies)
Discussion started by: SilvesterJ
4 Replies

6. Shell Programming and Scripting

extract information from a log file (last days)

I'm still new to bash script , I have a log file and I want to extract the items within the last 5 days . and also within the last 10 hours the log file is like this : it has 14000 items started from march 2002 to january 2003 awk '{print $4}' < *.log |uniq -c|sort -g|tail -10 but... (14 Replies)
Discussion started by: matarsak
14 Replies

7. Shell Programming and Scripting

Create shell script to extract unique information from one file to a new file.

Hi to all, I got this content/pattern from file http.log.20110808.gz mail1 httpd: Account Notice: close igchung@abc.com 2011/8/7 7:37:36 0:00:03 0 0 1 mail1 httpd: Account Information: login sastria9@abc.com proxy sid=gFp4DLm5HnU mail1 httpd: Account Notice: close sastria9@abc.com... (16 Replies)
Discussion started by: Mr_47
16 Replies

8. Shell Programming and Scripting

Extract information from Log file formatted

Good evening! Trying to make a shell script to parse log file and show only required information. log file has 44 fields and alot of lines, each columns separated by ":". log file is like: first_1:3:4:5:6:1:3:4:5:something:notinterested second_2:3:4:3:4:2 first_1:3:4:6:6:7:8 I am interested... (3 Replies)
Discussion started by: dummie55
3 Replies

9. Shell Programming and Scripting

extract and format information from a file

Hi, Following is sample portion of the file; <JDBCConnectionPool DriverName="oracle.jdbc.OracleDriver" MaxCapacity="10" Name="MyApp_DevPool" PasswordEncrypted="{3DES}7tXFH69Xg1c=" Properties="user=MYAPP_ADMIN" ShrinkingEnabled="false" ... (12 Replies)
Discussion started by: sujoy101
12 Replies

10. Shell Programming and Scripting

How to extract data from a huge file?

Hi, I have a huge file of bibliographic records in some standard format.I need a script to do some repeatable task as follows: 1. Needs to create folders as the strings starts with "item_*" from the input file 2. Create a file "contents" in each folders having "license.txt(tab... (5 Replies)
Discussion started by: srsahu75
5 Replies
Login or Register to Ask a Question