How to get lines started with matched strings using sed or grep for loop?

AMBER · #1 (**permalink**) 06-27-2009

I have a huge file and want to separate it into several subsets.
The file looks like:

C1 C2 C3 C4 ... (variable names)
1 ....
2 ....
3 ....
:
22 ....
23 ....

I want to separate the huge file using the column 1, which has numbers from 1 to 23 (but there are different amount of lines for each number).
I tried to use the loop looks like this:

@ i = 1
while ($i <= 23)
grep ^$i hugefile.txt > $i.txt
@ i ++
end

But there is one problem that for 1.txt, it will include all lines started with 1, 10, 11,..19

I tried to use
grep "\<$i\>" instead, but it doesn't work too. Since in the other columns might contain numbers 1 to 23, and will add into the wrong files.

I am thinking maybe I can awk all the columns if column 1 = $i?

Is there any suggestion for this situation? Thank you in advance

.

tkleczek · #2 (**permalink**) 06-28-2009

Code:

while read first rest; do
    echo "$first $rest" >> $first.txt
done

Side effect: It changes all whitespace between first and second field into space.

kshji · #3 (**permalink**) 06-28-2009

Previous ex. using read is better, but if you like to use grep then you must grep value+space. If you use grep to find lines using some key, use always with field delimeter. This works using ksh, bash, posix-sh, ...

Code:

i=1
while ((i <= 23))
do
  grep "^$i " hugefile.txt > $i.txt
 ((i+=1))
end

Franklin52 · #4 (**permalink**) 06-28-2009

Try this:

Code:

awk '{print > $1".txt"}' file

Regards

summer_cherry · #5 (**permalink**) 06-29-2009

Code:

nawk '{file=sprintf("%s.txt",$1);print $0 >> file}' yourfile

AMBER · #6 (**permalink**) 06-29-2009

Thank you so much! All posts are really helpful, it works using read, grep, awk and nwak~ The 'grep value+space' is really smart, it solved so many problems~ Thank you guys again

pxgupta2k · #7 (**permalink**) 07-13-2009

I have somewhat similar problem.
Hello,

I have a file with junk characters at the beginning of the file. Pls advice how could i bypass these junk characters. Sample file is given below.I want to extract the data starting from CREATE keyword to till end of the file.

SQL08029QDB2/AIX6400AIX 64BIT@MADMS012009-07-13-00.05.04.732394PSQLASC_ANNUALIZEDRATEOFRETURNACTIVITY"SQL080226170053405MADMS01I MADMS01LDID074"SYSIBM","SYSFUN","SYSPROC","LDID074"%P5270293MADMS01*SPACE RESERVED FOR FUTURE*ÉPVM 00SQL08029QDB2/AIX64ÿÿÿÿSQL090513152703000
¸°ñÿÿÿÅÿÿÿÿñÿÿÿÿÁÿÿÿÿ ñÿÿÿÿ¨ñÿÿÿÿ°ñÿÿÿÿ¸ÁFHÿÿÿÿÁ$&GÀkÀÀðÿÿÿÿÿÿÿÿÿÿÿÿÿÿÿKÿÿÿÿÿÿÿÿCREATE PROCEDURE"MADMS01I"."ASC_ANNUALIZEDRATEOFRETURNACTIVITY"
(IN "GUIDPOLICYGUID" VARCHAR(36),
IN "DPERIODSTARTDATE" TIME
END

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Grep and delete lines except the lines with strings	vj8436	Shell Programming and Scripting	14	04-17-2009 11:25 AM
print only matched string instead lines in grep	anchal_khare	Shell Programming and Scripting	3	02-18-2009 04:34 AM
How to print lines till till a pattern is matched in loop	anoopvraj	Shell Programming and Scripting	3	10-30-2008 10:36 PM
sed replaces all matched strings!!!	melanie_pfefer	Shell Programming and Scripting	1	08-07-2008 11:40 AM
SED: match pattern & delete matched lines	not4google	Shell Programming and Scripting	7	11-22-2006 09:58 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread: