help with data formatting Post: 302587718

Login or Register to Ask a Question and Join Our Community

Sponsored Content

Top Forums Shell Programming and Scripting help with data formatting Post 302587718 by varman on Thursday 5th of January 2012 05:48:04 PM

Old

01-05-2012

Registered User

help with data formatting

Hi,

I have data coming in like below. Not all data is like that, these are the problem records that is causing the ETL load to fail. Can you pls help me with combining theese broken records!

Code:

001800018000000guyMMAAY~acct name~acct type~~"address part 1
address part2"~city~STATE~ZIP~COUNTRY~(123) 123-1234~~~~~~~~~~~~~~~~~^M
0018000000gwQ63AAE~acct name~acct type~~"address part 1
address part2"~city~state~zip~country~(123) 123-1234~(123) 123-1234~~~~~~~~~~~~~~~~^M

Appreciate your time and effort!

Thanks,

Last edited by radoulov; 01-05-2012 at 07:00 PM.. Reason: Code tags!

varman

View Public Profile for varman

Find all posts by varman

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Formatting Data

i am writing a script that reads in a file and i just want it to print each element on a new line here is my code and the data that i want to read in #!/usr/bin/perl use strict; use CGI qw(:standard); use CGI qw(:cgi); my $data_file = "/tmp/results.txt"; my $configuration; my...

2. Shell Programming and Scripting

Re-formatting of data display

Hi All, I have been trying to re-arrange the below data using AWK or Perl. Can anybody help me ? Thanks in advance. Input: 111 222 333 444 AAA BBB CCC DDD 555 666 777 888 EEE FFF GGG HHH Output:

3. Shell Programming and Scripting

Script for data formatting

Hi I have to convert the data in a file ******* 01-20-09 11:14AM 60928 ABC Valuation-2009.xls 01-20-09 11:16AM 55808 DEF GHI Equation-2009.xls 01-20-09 11:02AM 52736 ABC DF Valuation-2009.xls 01-20-09 11:06AM 89600 THE...

4. UNIX for Dummies Questions & Answers

Data manipulation/ formatting question

How would I get this output to look $ cat newfile 13114 84652 84148 LIKE THIS?: 13114,84652,84148 sed,cut awk? syntax?

5. Shell Programming and Scripting

Formatting Data - CSV

I want to check whether if any column data has any + , - , = prefixed to it then convert it in such a form that in excel its not read as formula. echo "$DATA" | awk 'BEGIN { OFS="," } -F" " {print $1,$2,$3,$4,$5,$6,$7,$8.$9,$10,$11,$12}'

6. Shell Programming and Scripting

Formatting input data

Hello everybody, I have a file containing some statistics regarding CPU usage. The file has this syntax : Fri Jul 16 14:27:16 EEST 2010 Cpu(s): 15.2%us, 1.4%sy, 0.0%ni, 82.3%id, 0.1%wa, 0.0%hi, 0.9%si, 0.0%st Fri Jul 16 15:02:17 EEST 2010 Cpu(s): 15.3%us, 1.4%sy, 0.0%ni, 82.3%id, ...

7. UNIX for Advanced & Expert Users

formatting the data

HI I want to make it single row if start with braces i.e. { .Any idea {1:XXX2460275191}{2:SEC00687921131112201641N}{3:{58910}}{4: :R:GENL :C::xx//xx1 :20C::yy//yy1 :2S:xxT} {1:XXX2460275190}{2:SEC00687921131112201641y}{3:{58911}}{4: :z:GENL :v::xx//xx1 :10C::yy//yy1 :4S:xxT ...

8. Shell Programming and Scripting

Help with data formatting

Hi, I am generating the following output from my script. Country,A,B,C,D,E,F INDIA ,3755019,774604,484749,329838,7333612,442031 CHINA ,3716520,889197,530899,379754,6198475,355768 JAPAN ,52038,30462,231224,147275,1272,498 USA,9494,1130,0,0,15303,451...

9. Shell Programming and Scripting

Data formatting using awk

Need assistance on the data extraction using awk Below is the format and would like to extract the data in another format ------------------------------------------------------------------------------------------------- Minimum Temperature (deg F ) DAY 1 2 3 4 5 6 7 8 9 10 11...

LEARN ABOUT PHP

holidays

holidays(4)							   File Formats 						       holidays(4)

NAME

       holidays - prime/nonprime table for the accounting system

SYNOPSIS

       /etc/acct/holidays

DESCRIPTION

       The   /etc/acct/holidays file describes which hours are considered prime time and which days  are holidays.  Holidays and weekends are con-
       sidered non-prime time hours.  /etc/acct/holidays is used by the accounting system.

       All lines beginning with an "*" are comments.

       The  /etc/acct/holidays file consists of two sections.  The first non-comment line defines the current year and the start time of prime and
       non-prime time hours, in the form:

       current_year	 prime_start	  non_prime_start

       The remaining non-comment lines define the holidays in the  form:

       month/day     company_holiday

       Of these two fields, only the  month/day is actually used by  the accounting system programs.

       The  /etc/acct/holidays file must be updated each year.

EXAMPLES

       Example 1: Example of the /etc/acct/holidays file.

       The following is an example of the /etc/acct/holidays file:

       * Prime/Nonprime Table for the accounting system
       *
       * Curr	  Prime     Non-Prime
       * Year	  Start     Start
       *
	 1991	  0830	   1800
       *
       * only the first column (month/day) is significant.
       *
       * month/day    Company Holiday
       *
	 1/1	      New Years Day
	 5/30	      Memorial Day
	 7/4	      Indep. Day
	 9/5	      Labor Day
	 11/24	      Thanksgiving Day
	 11/25	      day after Thanksgiving
	 12/25	      Christmas
	 12/26	      day after Christmas

SEE ALSO

       acct(1M)

SunOS 5.10							    28 Mar 1991 						       holidays(4)