awk executes and works but only on copy of file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk executes and works but only on copy of file
# 1  
Old 08-01-2018
awk executes and works but only on copy of file

The tab-delimited file below using the awk produces a blank output. However, when I copy the same lines in file to a new document and execute the awk I get the desired result.
The awk counts the unique characters before the : in $7 according to the id in $1.
The awk seems to work but I can not figure out why it doesn't on the original file. There doesn't appear to be windows line endings. Thank you Smilie.

file
Code:
PTPN11	5781	13324	28363	genomic	na	LRG_614:g.36663G>T	g.36663G>T	-	-	Yes	No	No
PTPN11	5781	13324	28363	coding	na	LRG_614t1:c.214G>T	c.214G>T	LRG_614p1:p.Ala72Ser	p.Ala72Ser	Yes	No	No
PTPN11	5781	13324	28363	coding	na	NM_002834.4:c.214G>T	c.214G>T	NP_002825.3:p.Ala72Ser	p.Ala72Ser	Yes	No	Yes
PTPN11	5781	13324	28363	coding	na	NM_080601.2:c.214G>T	c.214G>T	NP_542168.1:p.Ala72Ser	p.Ala72Ser	No	No	No

awk
Code:
BEGIN { FS="[\t:]" }
{
    cnt[$1][$7]++
    max[$1] = (max[$1] > cnt[$1][$7] ? max[$1] : cnt[$1][$7])
}
END {
    for (word in cnt) {
        for (val in cnt[word]) {
            if (cnt[word][val] == max[word]) {
                print word, val
            }
        }
    }
}

desired result
Code:
PTPN11 LRG_614t1
PTPN11 LRG_614
PTPN11 NM_080601.2
PTPN11 NM_002834.4

# 2  
Old 08-01-2018
What does the file command show
Code:
file filename

This User Gave Thanks to jim mcnamara For This Post:
# 3  
Old 08-01-2018
hgvs4variation.txt: ASCII text, with very long lines, but I am not sure what to do from here. Thank you Smilie.

Last edited by cmccabe; 08-01-2018 at 11:27 AM..
# 4  
Old 08-01-2018
How did you "copy the same lines in file to a new document"?

What does ls -l original_file new_document show?

What does diff original_file new_document show?
This User Gave Thanks to Don Cragun For This Post:
# 5  
Old 08-01-2018
It might also be worth doing sha1sum on each file to compare the derived checksum value. If that is not available, try using sum which is not so detailed but is more widely available.

Perhaps the copy process has written an end-of-file or perhaps the original file is open and you awk is refusing to read it because of that where cp is less concerned. Does running fuser on the original file show anything?

Just suggestions to try out. If there are differences, can you push them through od to see what the differences are?




I hope that this helps,
Robin
This User Gave Thanks to rbatte1 For This Post:
# 6  
Old 08-02-2018
The same file was formatted with tab and space delimiters in it. Thank you very much Smilie.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Ksh: How to write the log file simultaneously when .sql file executes by UNIX process

Hello Team- we would like to implement an approach which has to write the log file simultaneously when .sql file is executing by Unix process. At present,it is writing the log file once the process is completed. I've tested the current process with the below approaches and none of them... (1 Reply)
Discussion started by: Hima_B
1 Replies

2. Shell Programming and Scripting

Remove original file from directory after bash executes

The below bash works great, except I can not seem to delete the original file $f from the directory. Thank you :) For example, after the bash executes there are 8 files in the directory: 123.txt (original file) 123_remove.txt 123_index.txt 123_final.txt 456.txt (original file)... (11 Replies)
Discussion started by: cmccabe
11 Replies

3. Shell Programming and Scripting

[Solved] My script executes poorly as a text file.

Hello again, I have put together a shell script using sed and some shell commands, and it runs pretty well when I am in terminal, but when I save it as a text file and invoke it through the terminal by typing its path, all I get are errors. Can some one give me some hints as to what I am doing... (13 Replies)
Discussion started by: Paul Walker
13 Replies

4. Shell Programming and Scripting

Copy entire file to a new file in awk

Hi, How do we write the contents of multiple files created in awk body to a new file in awk (END block) ? when I used "getline", it is consuming more time. Do we have any other way other than getline? (1 Reply)
Discussion started by: Cool
1 Replies

5. UNIX for Dummies Questions & Answers

cp times.csv{,.bak} -> makes a copy with *.bak extension. How this works?

Hi cp times.csv{,.bak}makes a copy with *.bak extension. How this works? Whats the gimmick here? Can't google special characters (1 Reply)
Discussion started by: slashdotweenie
1 Replies

6. Shell Programming and Scripting

Running a script in crontab which executes a jar file

Hi, I have a script (.sh file) which has been created through my login. This script executes a jar file. Java is installed through my login and the folder has been given full permission for access. When this script is added by root in crontab, it does not get executed. Could you please... (1 Reply)
Discussion started by: archana.n
1 Replies

7. Shell Programming and Scripting

"awk '/[0-9]{4}/' file" not works, why ?

Hello, my question comes with the following code: $ cat fan_get.txt Source Speed Status Mode ------------------------------------------------------------------------------------------------------- PS A,Virtual Fan Group #1 ... (6 Replies)
Discussion started by: 915086731
6 Replies

8. Shell Programming and Scripting

Perl or Awk script to copy a part of text file.

Hi Gurus, I'm a total newbie to Perl and Awk scripting. Let me explain the scenario, there is a DB2 table with 5 columns and one of the column is a CLOB datatype containing XML. We need all the 4 columns but only a portion of string from the XML column. We decided to export DB2 table to a .del... (26 Replies)
Discussion started by: asandy1234
26 Replies

9. Shell Programming and Scripting

AWK : copy file with changes

Hi, I am seeking help to copy a file - with the changes (not just the changes) - to a new file. I have a text file that contains numerous lines of text as given below - Name ABC.DEF.GHI Adrs (tcp) Port (53) CONN(xyz) #Name ABC.DEF.GHI Adrs (tcp) Port (53) CONN(xyz) Name GHI.JKL.MNO Adrs... (8 Replies)
Discussion started by: gowri_g_s
8 Replies

10. Shell Programming and Scripting

How to copy multiple lines from a file to another using AWK?

Hi, I have a abc.txt file. In this file there is a SQL query which Iwant to copy and print it on another file.The query (for eg) is written like this: SELECT field1, field2, field3 from table1,table2 where <conditions> END I want to copy this query to another... (3 Replies)
Discussion started by: jisha
3 Replies
Login or Register to Ask a Question