Help with a Flat File!!! Post: 302120577

Sponsored Content

Top Forums Shell Programming and Scripting Help with a Flat File!!! Post 302120577 by kumarsaravana_s on Thursday 7th of June 2007 06:22:58 AM

06-07-2007

Registered User

Help with a Flat File!!!

Hi All,

I need a help with a shelll script program.I get a '|' separated file which sometime has a encrypted column.And this encryption sometime breaks the last column data into a new line and this is not picked by the ETL.So when i run a script,it should append back the broken new line data back to its end of record and if there is any empty row,just delete them.

Input:

xxxxx|Jun 5 2007 11:57:27:486PM|1014aaaa|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1
%%^&&&
xxxxx|Jun 5 2007 11:57:27:486PM|101aa05|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1%%^&&&

xxxxx|Jun 5 2007 11:57:27:486PM|1014aa05|xxx|dddd|aa|qwq|2cvcxv| |TP|#$
@1%%^&&&
xxxxx|Jun 5 2007 11:57:27:486PM|10aa2905|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1%%^&&&

Output :

xxxxx|Jun 5 2007 11:57:27:486PM|1014aaaa|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1%%^&&&
xxxxx|Jun 5 2007 11:57:27:486PM|1014aa05|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1%%^&&&
xxxxx|Jun 5 2007 11:57:27:486PM|10aa2905|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1%%^&&&
xxxxx|Jun 5 2007 11:57:27:486PM|1014aa05|xxx|dddd|aa|qwq|2cvcxv| |TP|#$@1%%^&&&

Your help is appreciated,

Thanks,
Kumar

kumarsaravana_s

View Public Profile for kumarsaravana_s

Find all posts by kumarsaravana_s

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Look up column in a flat file

Here is on more go ! Need a shortcut for my problem ! problem is i have a look_update with fixed sequence of column that is : MANDT:SERAIL:SERSCHA:SEREX:EQTYP:BSTVP I will be getting data in a flat file having same number of column but the sequence could be different in each...

2. Shell Programming and Scripting

Help with a flat file!!!

Hi All, I get a flat file everyday with some records being invalid.Some records come with less number '|'.I just want to add the missing '|'s ,So the it doesnt give an error insufficient fields while loading...There area total of 32 pipes in each record. Input: ASADASD |Y|B|SDFGDSDFD| ...

3. Shell Programming and Scripting

Flat file

Hi I have a flat file looking this QWER 2:35 7044 00001 ROUT 1188 EA SS ASD 2:36 7044 00010 ROUT BSD 2:37 7044 00011 ROUT END QWER 3:35 7044 00011 ROUT 1088 EA SS ASD 3:36 7044 00010 ROUT BSD 3:37 7044 00011 ROUT...

4. Shell Programming and Scripting

Flat File in HP-UX

Hi I have a file like below . IF the record starts with ASD then change the 20th offset to "K" follwed by that 20th offset value & if the record starts with ASDR then change the 38th offset to "K" followed by 38th offset value . But here the condition is the next value ...

5. Shell Programming and Scripting

Awk to convert a flat file to CSV file

Hi , I have a file with contents as below: Contract Cancellation Report UARCNCL LOS CODE DATE REAS TYPE AMOUNT AMOUNT LETTER BY ========= ======= ==== ==== ==== ========= ==== ==== 8174739 7641509 1S NONE CRCD 30-JUN-2008 NPAR N .00 .00 CCAN 8678696 8091709 1S NONE DDEB 30-JUN-2008...

6. Programming

compare XML/flat file with UNIX file system structure

Before i start doing something, I wanted to know whether the approach to compare XML file with UNIX file system structure. I have a pre-configured file(contains a list of paths to executables) and i need to check against the UNIX directory structure. what are the various approches should i use ? I...

7. Shell Programming and Scripting

format a flat file

i have a flat file with around 700 columns . i want to break it into a flat file with say five columns like col1,col2,col3,col4 col5,col6,col7,col8 col9...... ,col700 how can i do this

8. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as...

9. Shell Programming and Scripting

reading a csv file and creating a flat file

hi i have written a script for reading a csv file and creating a flat file, suggest if this script can be optimized #---------------- FILENAME="$1" SCRIPT=$(basename $0) #-----------------------------------------// function usage { echo "\nUSAGE: $THIS_SCRIPT file_to_process\n"...

10. UNIX for Beginners Questions & Answers

Flat File Validation

Hi Team there is a requirement to do validate on Flat files using Shell Scripting. Suppose we have two flat files ( F1, F2). Validation 1. Row count between F1 and F2 a) Write it in a file with results of count of each file and differences if any 2. Apply checksum or any...

LEARN ABOUT PHP

db2_field_name

DB2_FIELD_NAME(3)							 1							 DB2_FIELD_NAME(3)

db2_field_name - Returns the name of the column in the result set

SYNOPSIS

       string db2_field_name (resource	$stmt, mixed  $column)

DESCRIPTION

	Returns the name of the specified column in the result set.

PARAMETERS

	      o $stmt
		- Specifies a statement resource containing a result set.

	      o $column
		-  Specifies  the  column in the result set. This can either be an integer representing the 0-indexed position of the column, or a
		string containing the name of the column.

RETURN VALUES

	Returns a string containing the name of the specified column. If the specified column does not exist in the result set,  db2_field_name(3)
       returns FALSE.

SEE ALSO

       db2_field_display_size(3), db2_field_num(3), db2_field_precision(3), db2_field_scale(3), db2_field_type(3), db2_field_width(3).

PHP Documentation Group 													 DB2_FIELD_NAME(3)