Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

awk syntax

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk syntax
# 1  
Old 04-15-2011
awk syntax
Hi I have a bash file which will split a big file to many small files.
But I got a syntax error.
Code:
H="$(head -1 CCC.tped)"
awk 'print $0 > $1 ".tped"' CCC.tped
for f in $(ls *.tped); do echo "$H\n" "$(cat $f)" >$f; done

And
Code:
-bash-4.1$ bash split
awk: print $0 > $1".tped"
awk: ^ syntax error
split: xrealloc: cannot allocate 18446744071562067968 bytes (40960 bytes allocated)

The tped file format
Code:
1	bs1_533	0	533	G G	G G	G G	
1	bs1_41342	0	41342	T T	T A	
1	bs1_41791	0	41791	G G	G G	
1	bs1_44449	0	44449	T T	T T	
1	rs2462492	0	44539	C C	C C	
1	bs1_44571	0	44571	G G	G G	
1	rs10399749	0	45162	C C	C C	
1	rs28402963	0	52066	T T	T T

Thanks for help.
# 2  
Old 04-15-2011
Code:
awk '{print $0 > $1 ".tped"}' CCC.tped

# 3  
Old 04-15-2011
I'm not sure you can substitute there. this code works:

Code:
nawk '{ F=$1 ".out" ; if(F) { print $0>F ; close(F) } }' input

awk will barf and quit if you try and redirect into an invalid filename for some reason so check the filename before you do.

The close() is because otherwise, the file will remain open so that if you decide to write to it again later, you'll write a second line instead of overwriting it. So if you were splitting a million rows you could end up with one million open files! plain old awk doesn't have close but nawk should.
Last edited by Corona688; 04-15-2011 at 05:32 PM..
# 4  
Old 04-18-2011
Quote:
nawk '{ F=$1 ".out" ; if(F) { print $0>F ; close(F) } }' input
Incorrect, the output file size is always jumping between 0kb and 1kb
It looks the bottom line overwritesd the previous line. Only one line in the file.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk: syntax error

awk -F, ' NR>1 { BEGIN{ chr=$2 } END{ for (k in chr) {print k} } } ' $gene_file I've a really simple code. I want to store gene name and it's chromosome and in the end print them. I'm skipping line one as it contains headers. But I don't know why I get error as: (2 Replies)
Discussion started by: genome
2 Replies

2. Shell Programming and Scripting

Help with the awk syntax

Hello Experts: While writing a script to help one of the posts on here, I end up writing a wrong one. I am very much eager to know how this can be corrected. Aim was to not print specified columns - lets say out of 100 fields, need to print all but 5th, 10th, 15th columns. Someone already... (13 Replies)
Discussion started by: juzz4fun
13 Replies

3. Shell Programming and Scripting

Syntax Problem with awk

Hello, I have perl script,which take some part of data in the file. the below command works fine in normal cmd prompt. `awk '/CDI/ && // && !/Result for/ {print $3 $5 > "final.txt"}' datalist.txt`; `nawk -F"" '{print $2}' finalcdi.txt`; But not working. Please use code tags, thanks. (5 Replies)
Discussion started by: rasingraj
5 Replies

4. Shell Programming and Scripting

AWK Function syntax

Hi, I would like to know what is the correct syntax to perform a function in awk. Although I have seen several examples, not get it to work, this is what I'm trying: #!/bin/bash awk function multi (number) { return number * 3 } print multi (4)Thanks (2 Replies)
Discussion started by: Godie
2 Replies

5. AIX

Help with syntax using AWK

I have a file which is comma separated and has quotes. I can use this command and awk -F"," '{ if ($4=="01" print $0 }' test.txt But this doesn't fetch me the data.since it has quotes. If the data has no quotes,the above command works fine. In Unix you can skip quote \" but this doesn't work.... (7 Replies)
Discussion started by: ganesnar
7 Replies

6. Shell Programming and Scripting

AWK syntax help

i have a ksh code that needs to be written in AWK. can someone please help me here? :( if }" | grep -c "$2") -gt 0 ] ; then print - "found $2 in array ignore" else print - "did not find $2 in array ignore" fi ignore=4ty56r ignore=er45ty . . . ignore=frhtg2 (27 Replies)
Discussion started by: usustarr
27 Replies

7. UNIX for Dummies Questions & Answers

awk syntax

Little bit confusing while using awk :confused::confused: In Sed while pattern search we can use "(double quotes) i mean $a=hello $cat file.txt |sed -n "/$a/p"this thing work fine But if i use it in awk it's not working How could i do the substitution of pattern by a variables and the... (1 Reply)
Discussion started by: posix
1 Replies

8. Shell Programming and Scripting

AWK syntax

Hi I am trying to understand AWK syntax so I tried this command which gives me the home directory of root awk 'BEGIN { FS = ":"} {if ($1 == "root") print $6 }' /etc/passwd I would know what are the following commands doing. The first one prints all /etc/passwd, second prints nothing. ... (4 Replies)
Discussion started by: wakatana
4 Replies

9. Shell Programming and Scripting

awk syntax help

I don't get correct output when I run this command line: nmap -sP failedhost.com | grep -i failed | awk -F '{print $6}' I basically want it to return 'failedhost.com' but its just showing the output of the nmap scan. (8 Replies)
Discussion started by: streetfighter2
8 Replies

10. Shell Programming and Scripting

Help with Awk Syntax

I have written many awk commands which go in multiple lines. I have this confusion many times. Some time they work if i dont terminate them with "\" but some time error. Some time in "if" statements between if and else if i dont use ";" it gives error but sometimes it doesnt. The below... (4 Replies)
Discussion started by: pinnacle
4 Replies
Login or Register to Ask a Question