Search Results

Hi,

Please help, this is quite complex, I dont know how to start.
The original input files are 10mb in size each.


I have multiple files and I want to merge them in the following way....

Hi All,

Please help with code for this.
I want to parse several huge files and summarize relevant information into columns.
The columns of output are title, pagebegin,pageend,...

Thanks a lot.

I had to change the sort parameters to meet my requirements.


awk 'gsub(FS $3,"&")<4' infile | sort -k 1,1 -k2,2n

I want to remove all rows that have exactly the same value in cols 3 through 232.
Col 3 through 6 was just a shortened example of cols 3 through 232 in the main file.

This has nothing to do with...

the option uniq -d extracts duplicate rows, I want to compare the value of columns in a single row.

For example I want to delete all of the following lines
A A A A
T T T T
- - - -

I am expecting to keep more rows, and the rows with duplicate values in columns are not meaningful to my analysis.

Hi All,

I have a big file with 232 columns and 9 million rows, I want to delete all rows with same column values in col3 through col232. Also the output should be sorted based on first 2 columns....

Thanks Ranga, my bad, I should have looked more closely..

Hi Scrutinizer,

I used this code


for file in *
do
awk 'BEGIN{FS=OFS="\t"}{$2="chr"$2;a[NR]=$0;}END{for(i=1;i<=NR;i ){print a[i] >FILENAME;}}' ${file}
done


It still gets into an...

Hi Methyl and Ranga,

I`m sorry for the inconvenience and many thanks for the help.

I`m using Red Hat Enterprise Linux 6 unix bash, thats all i know.

I have included the input and output...

Hi,

I want to append "chr" to all col 2 values of all files in a particular folder.
This is what I came up with but isnt working. Please help.

ls -1 * |
(
while read line
do
awk 'BEGIN...

Hi radoulov,

Would you please help me debug this case?
The value of f2s2[$1] is printing to be 0 when it should be 1
for $6=1S5M145N29M1S. So f2m2s[$1] is off by f2s2[$1]
it is not ignoring...

I had to do a couple of more adjustments, it is a great learning experience. Thanks a ton radoulov (https://www.unix.com/members/302021308.html).

The output is incorrect.
It should be GTT but it gives GTC . Please see the following record in the files.

file1$4=file2$1=SNPSTER1_0001:7:32:86:1332#0/1
file2$10 =...

Hi radoulov, (https://www.unix.com/members/302021308.html)

I will try to explain my question with two examples. Sorry if its a lengthy read, I`m sure the answer will take you much less time than...

Hi radoulov and vgersh99,

Can you help me out please? :)

Thanks,
Alpesh

Hi All,

Thanks for all the help. I am faced with a little complication now with respect to the last problem.The substring to be extracted must take care of the padded S values(column 6 in file2)....

I am getting a blank output with your command , also in the output I would like to wrap the text, limit the text to 80 characters per line except the first line which is >bcr1 and the last line.

actually, i want the text between these two expressions, not including ">bcr2" .
so if the file is
>bcr0sdfsfsfsfdfdsf>bcr1abbbbbbbbbbbbbbbbbbbsbsbsbsbsbbsbsbsbsbsb>bcr2hhhhd...

Hi,

I want to copy text between expressions ">bcr1" and ">bcr2" to another file.
Any simple solutions?

Thanks

outstanding !! thank you :)

Thanks radoulov (https://www.unix.com/members/302021308.html). Looks like I do not have dos2unix installed , I have to ask the admin to install.
Is there anything else I could try?

Hi vgersh99 and (https://www.unix.com/members/37898.html)radoulov (https://www.unix.com/members/302021308.html),

I used the following code from radoulov (https://www.unix.com/members/302021308.html)...

Thanks radoulov and (https://www.unix.com/members/302021308.html) vgersh99 (https://www.unix.com/members/37898.html). I will process my 200MB files and let you guys know if I have issues.
...

sorry ..you are correct !