Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

[Solved] Data error need to fix

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting [Solved] Data error need to fix
# 1  
Old 01-29-2014
[Solved] Data error need to fix
Hi Guys,

I`m having a strange problem with my data set. Whenever there is a transition to another value is col1, the corresponding 3rd col goes to the next line. This is a huge file, so need to fix in a script. The file is tab delimited.

Here is what is happening when transitioning from DS11.02060 to DS11.02061, the value 1150.76 is in the next line. Happens for every transition. The file is sorted by col 1.

Code:
DS11.02060    DS11.28178    562.907
DS11.02060    DS11.28179
    1150.76
DS11.02061    DS11.02063    455.141
DS11.02061    DS11.02064    476.496
DS11.02062    DS11.28178    562.957
DS11.02062    DS11.28179
    1170.76
DS11.02063   DS11.02063    235.141
DS11.02063    DS11.02064    445.499

Expected output 

DS11.02060    DS11.28178    562.907
DS11.02060    DS11.28179    1150.76
DS11.02061    DS11.02063    455.141
DS11.02061    DS11.02064    476.496
DS11.02062    DS11.28178    562.957
DS11.02062    DS11.28179    1170.76
DS11.02063   DS11.02063    235.141
DS11.02063    DS11.02064    445.499

# 2  
Old 01-29-2014
Code:
awk -F"\t" -v OFS="\t" 'NF==2 { A=$0 ; getline ; print A,$0 }' inputfile > outputfile

This User Gave Thanks to Corona688 For This Post:
gina.lizar
# 3  
Old 01-29-2014
Code:
$ awk 'NF==2{s=$0;next}NF==1{$0 = s FS $0}1' file

This User Gave Thanks to Akshay Hegde For This Post:
gina.lizar
# 4  
Old 01-29-2014
Code:
 awk 'ORS=(NF==2)?FS:RS' myFile

These 3 Users Gave Thanks to vgersh99 For This Post:
Corona688 gina.lizar Yoda
# 5  
Old 01-29-2014
thank you ! everything works great !
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to fix and manage data in rescue mode?

Hello, I am running ubuntu 14.04 My server has problems again. I need to manage system files in rescue mode, backup some files, edit /etc/crontab and rc.local files etc. root@rescue:~# cat /proc/mdstat Personalities : md2 : active raid1 sda2 sdb2 4193216 blocks md3 :... (4 Replies)
Discussion started by: baris35
4 Replies

2. Shell Programming and Scripting

[Solved] Data manipulation

Hallo Team, I need your help. I have a file that has two colums. See sample below: 105550 0.28 105550 0.24 125550 0.28 125550 0.24 215650 0.28 215650 0.24 315550 0.28 315550 0.24 335550 0.28 335550 0.24 40555 0.21 40555 0.17 415550 0.21 415550 0.17 43555 0.21 43555 0.17 (5 Replies)
Discussion started by: kekanap
5 Replies

3. Shell Programming and Scripting

[Solved] Testing Data Type of User Input

hi all i'm new in shell scripting and now i'm working on project and i wanna make a function take input from user and test it's datatype then if correct write it to file i wounder what is the best way to do this ? can i use awk ? edit by bakunin: Please give your threads a meaningful... (5 Replies)
Discussion started by: mohamed91
5 Replies

4. Shell Programming and Scripting

[Solved] Compare column data in all the rows

Hi.. In the below sorted input file.. I am comparing the first 3 columns of data one by one row and it is a pipeline delimitter file.. AA|BB|CC|line1 AA|BB|CC|ine4 AA|BB|CC|line2 BB|CC|DD|line3 BB|CC|DD|line5 If first 3 columns of data matches with any record in the file the... (4 Replies)
Discussion started by: NareshN
4 Replies

5. Shell Programming and Scripting

[Solved] Converting the data into matrix with 0's and 1's

I have a file that contains 2 columns tag,pos cat input_file tag pos atg 10 ata 16 agt 15 agg 19 atg 17 agg 14 I have used following command to sort the file based on second column sort -k 2 input_file tag pos atg 10 agg 14 agt 15 ata 16 agg 19 atg 17 (2 Replies)
Discussion started by: raj_k
2 Replies

6. Shell Programming and Scripting

[SOLVED] Converting data from one format to the other

Hi All, I need to convert an exel spreadsheet into a SAS dataset, and the following format change is needed. Please help, this is too complex for a biologist. Let me describe the input. 1st row is generation.1st column in keyword 'generation', starting 2nd column there are 5... (9 Replies)
Discussion started by: newbie83
9 Replies

7. Shell Programming and Scripting

[Solved] Messaging data into required report

Hello to all; hope someone can assist me in getting the required output that my manager is expecting. I have been able to generate this code which does the comparison of the files and creates the file called diff_fuss_file.txt $ vi fussrpt.pl #!/usr/bin/perl #cd /tmp #rm output.txt ... (2 Replies)
Discussion started by: gvolpini
2 Replies

8. Shell Programming and Scripting

[Solved] Extracting data from a determined file

Hi guys, How you doing? Need some help with this .I got a file with this kind of information SURVIVABLE PROCESSORS Name Type IP Address Reg Act Translations Net Updated Rgn Gateway001 ... (8 Replies)
Discussion started by: REX:)
8 Replies

9. UNIX for Dummies Questions & Answers

Format/Fix Timestamp Data in a File.

Hello Experts, I have a timestamp(6) column in a .csv data file , format of the data is as below:- ETCT,P,Elec, Inc.,abc,11/5/2010 4:16:09.000000 PM,Y,Y,Y I want the timestamp column to be properly formatted like 11/05/2010 04:16:09.000000 PM Currently the "0" is missing with... (3 Replies)
Discussion started by: mtlrsk
3 Replies

10. Shell Programming and Scripting

awk / shell - Fix broken lines and data

Gurus, I am struggling with a issue and thought I could use some of your expertise. Need Help with this I have a flat file that has millions of records 24|john|account ~ info |56| 25|kuo|account ~ journal |58| 27|kim|account ~ journal |59| 28|San|account ~ journal |60|... (3 Replies)
Discussion started by: rimss
3 Replies
Login or Register to Ask a Question