help reformat data with awk Post: 302200668

Sponsored Content

Top Forums Shell Programming and Scripting help reformat data with awk Post 302200668 by climbak on Thursday 29th of May 2008 07:14:01 PM

05-29-2008

Registered User

help reformat data with awk

I am trying to write an awk program to reformat a data table and convert the date to julian time. I have all the individual steps working, but I am having some issues joing them into one program. Can anyone help me out? Here is my code so far:

Code:

# This is an awk program to convert the dates from time series data to Julian dates.
#
#  1. Remove leading "1" from every line
#
{sub(1,"",$1); #print}
#
# 2. Change single digit months to MM
#
 sub(/^[ \t]+/,0); #print}  #### works up to here if i comment everything following out ####
#
# 3. Change single digit days to DD
#
 if ( NF == 37 ) sub(/^[ \t]+/,0,2); #print}
 else if ( NF == 38 ) sub(/^[ \t]+/,0,2) && sub(/^[ \t]+/,0,3); 
 print}   ### This is what I can't get working so far ###
#

Here is an example of the date part of the data:

Code:

110/24/74FDUNC
110/24/74FDUNC
110/25/74FDUNC
1 3/ 3/75FDUNC
1 3/ 3/75FDUNC
1 3/ 3/75FDUNC

step one as it says in the code removes the leading "1", step 2 adds a "0" to the single digit months and step 3 is suppose to add a "0" before the single digit days and years.
Right now I can get step 1 and 2 to run together, but I can't get step 3 to do anything. There are more steps after this, but not much use trying to get them to work until I get the first stuff to work. Thanks in advance.

Last edited by climbak; 05-29-2008 at 08:18 PM.. Reason: forgot an example of the date part of the data I am trying to change.

climbak

View Public Profile for climbak

Find all posts by climbak

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Reformat Data (Perl)

I am new to Perl. I need to reformat a data file as the last part of a script I am working on. I am stuck on this. Here is the current format: CUSTOMER Filename 09/04/07-08:49 CUSTOMER Filename 09/04/07-08:52 CUSTOMER Filename 09/04/07-08:52 CUSTOMER2 Filename 09/04/07-08:49 CUSTOMER2...

2. Shell Programming and Scripting

reformat data with a shell script

Can anyone help me with a shell script that can do the following: I have a data in fasta format (first line is the header, followed by a sequence of characters). >ALLLY GGCCCCTCGAGCCTCGAACCGGAACCTCCAAATCCGAGACGCTCTGCTTATGAGGACCTC GAAATATGCCGGCCAGTGAAAAAATCTTGTGGCTTTGAGGGCTTTTGGTTGGCCAGGGGC...

3. Shell Programming and Scripting

Reformat the data of a file.

I have a file which have data like A.txt a 1Jan I am in a1. 1Jan I was born. 2Jan I am here. 3Jan I am in a3. b 1Jan I am in b1. c 2Jan I am in c2. d 2Jan I am in d2. 5jan I am in d5. date in the file might be vary evertime.

4. Shell Programming and Scripting

Help with reformat data content

input file: hsa-miR-4726-5p Score hsa-miR-483-5p Score hsa-miR-125b-2* Score hsa-miR-4492 hsa-miR-4508 hsa-miR-4486 Score Desired output file: hsa-miR-4726-5p Score hsa-miR-483-5p Score hsa-miR-125b-2* Score hsa-miR-4492 hsa-miR-4508 hsa-miR-4486 Score ...

5. Shell Programming and Scripting

Help with reformat input data

Input file: 58227131 50087390 57339526 40578034 65348841 55614853 64363217 44178559 Desired output file: 58227131 50087390 57339526 40578034 65348841 55614853 64363217 44178559 Command that I try:

6. Shell Programming and Scripting

Reformat MLS Data - Use AWK?

I am helping my wife set up a real estate site and I am starting to integrate MLS listings. We are using a HostGator level 5 VPS running CentOS and have full root and SSH access to the VPS. Thus far I have automated the daily FTP download of listings from our MLS server using a little sh script....

7. Shell Programming and Scripting

Data reformat and rearrangement problem asking

Input file: dependent general_process dependent general_process regulation general_process - - template component food component binding data_rearrangement binding data_rearrangement specific_activity data_rearrangement - ...

8. Shell Programming and Scripting

Help with reformat data structure

Input file: bv|111259484|pir||T49736_real_data bv|159484|pir||T9736_data_figure bv|113584|prf|T4736|truth bv|113584|pir||T4736_truth Desired output: bv|111259484|pir|T49736|real_data bv|159484|pir|T9736|data_figure bv|113584|prf|T4736|truth bv|113584|pir|T4736|truth Once the...

9. Shell Programming and Scripting

Help with reformat data set

Input file 4CL1 O24145 CoA1 4CL1 P31684 CoA1 4CL1 Q54P77 CoA_1 73 O36421 Unknown 4CL3 Q9S777 coumarate 4CL3 Q54P79 coumarate 4CL3 QP7932 coumarate Desired output result 4CL1 O24145#P31684 CoA1 4CL1 Q54P77 CoA_1 73 O36421 Unknown 4CL3 Q9S777#Q54P79#QP7932 coumarate I...

10. Shell Programming and Scripting

awk to reformat output if input file is empty, but not if file has data in it

The below awk improved bu @MadeInGermany, works great as long as the input file has data in it in the below format: input chrX 25031028 25031925 chrX:25031028-25031925 ARX 631 18 chrX 25031028 25031925 chrX:25031028-25031925 ARX 632 14...

LEARN ABOUT CENTOS

igawk

IGAWK(1)							 Utility Commands							  IGAWK(1)

NAME

       igawk - gawk with include files

SYNOPSIS

       igawk [ all gawk options ] -f program-file [ -- ] file ...
       igawk [ all gawk options ] [ -- ] program-text file ...

DESCRIPTION

       Igawk is a simple shell script that adds the ability to have ``include files'' to gawk(1).

       AWK programs for igawk are the same as for gawk, except that, in addition, you may have lines like

	      @include getopt.awk

       in your program to include the file getopt.awk from either the current directory or one of the other directories in the search path.

OPTIONS

       See gawk(1) for a full description of the AWK language and the options that gawk supports.

EXAMPLES

       cat << EOF > test.awk
       @include getopt.awk

       BEGIN {
	    while (getopt(ARGC, ARGV, "am:q") != -1)
		 ...
       }
       EOF

       igawk -f test.awk

SEE ALSO

       gawk(1)

       Effective AWK Programming, Edition 1.0, published by the Free Software Foundation, 1995.

AUTHOR

       Arnold Robbins (arnold@skeeve.com).

Free Software Foundation					    Nov 3 1999								  IGAWK(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Reformat Data (Perl)

Discussion started by: flood

2. Shell Programming and Scripting

reformat data with a shell script

Discussion started by: manishabh

3. Shell Programming and Scripting

Reformat the data of a file.

Discussion started by: samkhu

4. Shell Programming and Scripting

Help with reformat data content

Discussion started by: perl_beginner

5. Shell Programming and Scripting

Help with reformat input data

Discussion started by: perl_beginner

6. Shell Programming and Scripting

Reformat MLS Data - Use AWK?

Discussion started by: Chicago_Realtor

7. Shell Programming and Scripting

Data reformat and rearrangement problem asking

Discussion started by: cpp_beginner

8. Shell Programming and Scripting

Help with reformat data structure

Discussion started by: perl_beginner

9. Shell Programming and Scripting

Help with reformat data set

Discussion started by: perl_beginner

10. Shell Programming and Scripting

awk to reformat output if input file is empty, but not if file has data in it

Discussion started by: cmccabe

LEARN ABOUT CENTOS

igawk