06-15-2004
Problem with the flat file
Hi All,
I have a situation where I have a flat file that contains data that needs to be loaded into tables. The flat file contains 10 columns that are pipe dilimited. This table contains more than 500,000 rows.
This flat file was created from two different sources. The problem is third column(10 digit character) got switched with the fourth column(three digit character) somewhere in the middle of the flatfile i.e. somewhere in the file the fourth column became the third column and vice versa. This probably happened when the data from two sources are merged. Due to some problem I am not able to generate the file again.
I am trying to put all the rows with three digit character in fourth column into one file and ten digit character rows in another file. Is there a unix script/command that I can use to divide this file into two different file so that I can load all data sucessfully.
I will really appreciate any help in this regards.
Thanks
Raj
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi All,
I get a flat file everyday with some records being invalid.Some records come with less number '|'.I just want to add the missing '|'s ,So the it doesnt give an error insufficient fields while loading...There area total of 32 pipes in each record.
Input:
ASADASD |Y|B|SDFGDSDFD| ... (3 Replies)
Discussion started by: kumarsaravana_s
3 Replies
2. Shell Programming and Scripting
Hi All,
I need a help with a shelll script program.I get a '|' separated file which sometime has a encrypted column.And this encryption sometime breaks the last column data into a new line and this is not picked by the ETL.So when i run a script,it should append back the broken new line data... (11 Replies)
Discussion started by: kumarsaravana_s
11 Replies
3. Solaris
Hi,
I have two flat files which is generated by some automated process.
When I tried to view both files in vi editor using vi command both looks same. But I typed
=>cat TEST_WESM900033
&&HDR|M9SLRBR|0003|020012|012408|M9
&&TLR|0wes /usr5/datafiles/batch/M9
=>cat TEST_WESM90004... (2 Replies)
Discussion started by: surjyap
2 Replies
4. Shell Programming and Scripting
Hi
I have a flat file looking this
QWER 2:35 7044 00001 ROUT 1188 EA SS
ASD 2:36 7044 00010 ROUT
BSD 2:37 7044 00011 ROUT
END
QWER 3:35 7044 00011 ROUT 1088 EA SS
ASD 3:36 7044 00010 ROUT
BSD 3:37 7044 00011 ROUT... (9 Replies)
Discussion started by: Krishnaramjis
9 Replies
5. Shell Programming and Scripting
Hi
I have a file like below . IF the record starts with ASD then change the 20th offset to "K" follwed by that 20th offset value & if the record starts with ASDR then change the 38th offset to "K" followed by 38th offset value . But here the condition is the next value ... (0 Replies)
Discussion started by: Krishnaramjis
0 Replies
6. Shell Programming and Scripting
Hi ,
I have a file with contents as below:
Contract Cancellation Report UARCNCL
LOS CODE DATE REAS TYPE AMOUNT AMOUNT LETTER BY
========= ======= ==== ==== ==== ========= ==== ====
8174739 7641509 1S NONE CRCD 30-JUN-2008 NPAR N .00 .00 CCAN
8678696 8091709 1S NONE DDEB 30-JUN-2008... (14 Replies)
Discussion started by: rkumudha
14 Replies
7. Programming
Before i start doing something, I wanted to know whether the approach to compare XML file with UNIX file system structure. I have a pre-configured file(contains a list of paths to executables) and i need to check against the UNIX directory structure. what are the various approches should i use ? I... (6 Replies)
Discussion started by: shafi2all
6 Replies
8. Shell Programming and Scripting
Need to develop a unix shell script for the below requirement and I need your assistance:
1) search for file.log and file.bad file in a directory and read them
2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file
4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies
9. Shell Programming and Scripting
hi
i have written a script for reading a csv file and creating a flat file, suggest if this script can be optimized
#----------------
FILENAME="$1"
SCRIPT=$(basename $0)
#-----------------------------------------//
function usage
{
echo "\nUSAGE: $THIS_SCRIPT file_to_process\n"... (3 Replies)
Discussion started by: mprakasheee
3 Replies
10. UNIX for Beginners Questions & Answers
Hi Team
there is a requirement to do validate on Flat files using Shell Scripting.
Suppose we have two flat files ( F1, F2).
Validation
1. Row count between F1 and F2
a) Write it in a file with results of count of each file and differences if any
2. Apply checksum or any... (1 Reply)
Discussion started by: shlearner
1 Replies
LEARN ABOUT PHP
db2_column_privileges
DB2_COLUMN_PRIVILEGES(3) 1 DB2_COLUMN_PRIVILEGES(3)
db2_column_privileges - Returns a result set listing the columns and associated privileges for a table
SYNOPSIS
resource db2_column_privileges (resource $connection, [string $qualifier], [string $schema], [string $table-name], [string $column-
name])
DESCRIPTION
Returns a result set listing the columns and associated privileges for a table.
PARAMETERS
o $connection
- A valid connection to an IBM DB2, Cloudscape, or Apache Derby database.
o $qualifier
- A qualifier for DB2 databases running on OS/390 or z/OS servers. For other databases, pass NULL or an empty string.
o $schema
- The schema which contains the tables. To match all schemas, pass NULL or an empty string.
o $table-name
- The name of the table or view. To match all tables in the database, pass NULL or an empty string.
o $column-name
- The name of the column. To match all columns in the table, pass NULL or an empty string.
RETURN VALUES
Returns a statement resource with a result set containing rows describing the column privileges for columns matching the specified parame-
ters. The rows are composed of the following columns:
+-------------+---------------------------------------------------+
|Column name | |
| | |
| | Description |
| | |
+-------------+---------------------------------------------------+
| TABLE_CAT | |
| | |
| | Name of the catalog. The value is NULL if this |
| | table does not have catalogs. |
| | |
|TABLE_SCHEM | |
| | |
| | Name of the schema. |
| | |
| TABLE_NAME | |
| | |
| | Name of the table or view. |
| | |
|COLUMN_NAME | |
| | |
| | Name of the column. |
| | |
| GRANTOR | |
| | |
| | Authorization ID of the user who granted the |
| | privilege. |
| | |
| GRANTEE | |
| | |
| | Authorization ID of the user to whom the privi- |
| | lege was granted. |
| | |
| PRIVILEGE | |
| | |
| | The privilege for the column. |
| | |
|IS_GRANTABLE | |
| | |
| | Whether the GRANTEE is permitted to grant this |
| | privilege to other users. |
| | |
+-------------+---------------------------------------------------+
SEE ALSO
db2_columns(3), db2_foreign_keys(3), db2_primary_keys(3), db2_procedure_columns(3), db2_procedures(3), db2_special_columns(3), db2_statis-
tics(3), db2_table_privileges(3), db2_tables(3).
PHP Documentation Group DB2_COLUMN_PRIVILEGES(3)