Sponsored Content
Top Forums Shell Programming and Scripting Auto correct a csv file using UNIX shell script. Post 302888894 by karthik_ak on Tuesday 18th of February 2014 01:17:03 AM
Old 02-18-2014
This is the actual data in a csv file.

Code:
 
abcd,789756,20140211,20140202,464532.00,C,XZY,,,Settlement of purchase.,,1
abcd,795156,20140211,20140202,548962.52,C,JPY,,,Payement to: tokyo BNF=N,,1
abcd,763256,20140211,20140202,42188.80,C,USD,,,recieved from ,,1
abcd,756556,20140211,20140202,456898.28,C,EUR,,,Payment via.,,1
abcd,732656,20140211,20140202,58461.10,C,INR,,,Settlement of purchase.,,1
abcd,798756,20140211,20140202,323156.82,C,AUD,,,Settlement of purchase.,,1
abcd,789856,20140211,20140202,84621.63,C,CHF,,,Settlement of sale no B35453 EUR 471.60,,1
abcd,785456,20140211,20140202,86421.40,C,USD,,,Settlement of purchase.,,1

Some times the one or two records will have a next line character in between causing it to split into two lines like this

Code:
 
abcd,789756,20140211,20140202,464532.00,C,XZY,,,Settlement of purchase.,,1
abcd,795156,20140211,20140202,548962.52,C,JPY,,,Payement to: tokyo BNF=N,,1
abcd,763256,20140211,20140202,42188.80,C,USD,,,recieved from ,,1
abcd,756556,20140211,20140202,456898.28,C,EUR,,,Payment via.,,1
abcd,732656,20140211,20140202,
58461.10,C,INR,,,Settlement of purchase.,,1
abcd,798756,20140211,20140202,323156.82,C,AUD,,,Settlement of purchase.,,1
abcd,789856,20140211,20140202,84621.63,C,CHF,,,Settlement of sale no B35453 EUR 471.60,,1
abcd,785456,20140211,20140202,86421.40,C,USD,,,Settlement of purchase.,,1

I use windows OS.

---------- Post updated at 11:47 AM ---------- Previous update was at 11:45 AM ----------

If you see the 5 th record, it is split into 2.
This need to be auto corrected either in the same file or another file with the same file name as the original.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Modifying a csv file from Shell Script

Hi all, I have some script that creates a temp csv file. What I need to do is do some search and replace and modify the file from my shell script. I know the commands to open the file and then apply the reg ex but wasnt sure how I could do this from a script and modify the file? Any help... (2 Replies)
Discussion started by: not4google
2 Replies

2. UNIX for Advanced & Expert Users

Unix Shell Script with output to CSV File

Hi, I have a unix shell script that is outputting results from an SQL query to a *.csv file, using utl_file.put_line. The resulting file is then sent out via e-mail as a mail attachment. The issue I have is that when the mailed attachment is opened in Excel the first column is shown as... (1 Reply)
Discussion started by: heather.morton@
1 Replies

3. Shell Programming and Scripting

how to create csv file using shell script

I have a file in multiple directory which has some records in the following format File: a/latest.txt , b/latest.txt, c/latest.txt -> Name=Jhon Age=27 Gender=M Street=LA Road Occupation=Service I want to generate a csv file from the above file as follows File: output.csv -> ... (9 Replies)
Discussion started by: rjk2504
9 Replies

4. Shell Programming and Scripting

Exporting data as a CSV file from Unix shell script

Friends...This is the first time i am trying the report generation using shell script... any suggestions are welcome. Is there a way to set the font size & color when i am exporting the data from unix shell script as a CSV file ? The following sample data is saved as a .csv file in the... (2 Replies)
Discussion started by: appu2176
2 Replies

5. UNIX for Dummies Questions & Answers

Help to parse csv file with shell script

Hello ! I am very aware that this is not the first time this question is asked here, because I have already read a lot of previous answers, but none of them worked, so... As said in the title, I want to read a csv file with a bash script. Here is a sample of the file: ... (4 Replies)
Discussion started by: Grhyll
4 Replies

6. Post Here to Contact Site Administrators and Moderators

Auto correct a csv file using UNIX shell script.

Hi All, There are list of 4-5 .csv files which has 12 columns.In some cases one of the record is split into 2 records. What needs to be done is this split record has to be auto corrected and placed in the csv file. Eg: Let us consider sample.csv file and in normal conditions the file... (1 Reply)
Discussion started by: karthik_ak
1 Replies

7. Shell Programming and Scripting

Read csv file, convert the data and make one text file in UNIX shell scripting

I have input data looks like this which is a part of a csv file 7,1265,76548,"0102:04" 8,1266,76545,"0112:04" I need to make the output data should look like this and the output data will be part of text file: 7|1265000 |7654899 |A| 8|12660000 |76545999 |B| The logic behind the... (6 Replies)
Discussion started by: RJG
6 Replies

8. Shell Programming and Scripting

Help with Shell Scrip in Masking particular columns in .csv file or .txt file using shell script

Hello Unix Shell Script Experts, I have a script that would mask the columns in .csv file or .txt file. First the script will untar the .zip files from Archive folder and processes into work folder and finally pushes the masked .csv files into Feed folder. Two parameters are passed ... (5 Replies)
Discussion started by: Mahesh G
5 Replies

9. UNIX for Beginners Questions & Answers

How to zip csv files having specific pattern in a directory using UNIX shell script?

I have files in a Linux directory . Some of the file is listed below -rw-rw-r--. 1 roots roots 0 Dec 23 02:17 zzz_123_00000_A_1.csv -rw-rw-r--. 1 roots roots 0 Dec 23 02:18 zzz_121_00000_A_2.csv -rw-rw-r--. 1 roots roots 0 Dec 23 02:18 zzz_124_00000_A_3.csv drwxrwxr-x. 2 roots roots 6 Dec 23... (4 Replies)
Discussion started by: Balraj
4 Replies

10. Shell Programming and Scripting

How to auto correct a failing command?

If a command is not found, e.g. nawk, this is how I fix the problem ] && NAWK=/usr/bin/gawk ] && NAWK=/usr/bin/nawk ] && NAWK=/usr/bin/awkI use $NAWK an the set the appropriate value based on the system it runs. How can I implement a similar fix for a command found but illegal argument.... (6 Replies)
Discussion started by: mohtashims
6 Replies
QDeepCopy(3qt)															    QDeepCopy(3qt)

NAME
QDeepCopy - Template class which ensures that SYNOPSIS
All the functions in this class are reentrant when Qt is built with thread support.</p> #include <qdeepcopy.h> Public Members QDeepCopy () QDeepCopy ( const T & t ) QDeepCopy<T> & operator= ( const T & t ) operator T () DESCRIPTION
The QDeepCopy class is a template class which ensures that implicitly shared and explicitly shared classes reference unique data. Normally, shared copies reference the same data to optimize memory use and for maximum speed. In the example below, s1, s2, s3, s4 and s5 share data. // all 5 strings share the same data QString s1 = "abcd"; QString s2 = s1; QString s3 = s2; QString s4 = s3; QString s5 = s2; QDeepCopy can be used several ways to ensure that an object references unique, unshared data. In the example below, s1, s2 and s5 share data, while neither s3 nor s4 share data. // s1, s2 and s5 share the same data, neither s3 nor s4 are shared QString s1 = "abcd"; QString s2 = s1; QDeepCopy<QString> s3 = s2; // s3 is a deep copy of s2 QString s4 = s3; // s4 is a deep copy of s3 QString s5 = s2; In the example below, s1, s2 and s5 share data, and s3 and s4 share data. // s1, s2 and s5 share the same data, s3 and s4 share the same data QString s1 = "abcd"; QString s2 = s1; QString s3 = QDeepCopy<QString>( s2 ); // s3 is a deep copy of s2 QString s4 = s3; // s4 is a shallow copy of s3 QString s5 = s2; QDeepCopy can also provide safety in multithreaded applications that use shared classes. In the example below, the variable global_string is used safely since the data contained in global_string is always a deep copy. This ensures that all threads get a unique copy of the data, and that any assignments to global_string will result in a deep copy. QDeepCopy<QString> global_string; // global string data QMutex global_mutex; // mutex to protext global_string ... void setGlobalString( const QString &str ) { global_mutex.lock(); global_string = str; // global_string is a deep copy of str global_mutex.unlock(); } ... void MyThread::run() { global_mutex.lock(); QString str = global_string; // str is a deep copy of global_string global_mutex.unlock(); // process the string data ... // update global_string setGlobalString( str ); } Warning: It is the application developer's responsibility to protect the object shared across multiple threads. The examples above use QString, which is an implicitly shared class. The behavior of QDeepCopy is the same when using explicitly shared classes like QByteArray. Currently, QDeepCopy works with the following classes: QMemArray (including subclasses like QByteArray and QCString) QMap QString QValueList (including subclasses like QStringList and QValueStack) QValueVector See also Thread Support in Qt, Implicitly and Explicitly Shared Classes, and Non-GUI Classes. MEMBER FUNCTION DOCUMENTATION
QDeepCopy::QDeepCopy () Constructs an empty instance of type T. QDeepCopy::QDeepCopy ( const T & t ) Constructs a deep copy of t. QDeepCopy::operator T () Returns a deep copy of the encapsulated data. QDeepCopy<;T> & QDeepCopy::operator= ( const T & t ) Assigns a deep copy of t. SEE ALSO
http://doc.trolltech.com/qdeepcopy.html http://www.trolltech.com/faq/tech.html COPYRIGHT
Copyright 1992-2001 Trolltech AS, http://www.trolltech.com. See the license file included in the distribution for a complete license statement. AUTHOR
Generated automatically from the source code. BUGS
If you find a bug in Qt, please report it as described in http://doc.trolltech.com/bughowto.html. Good bug reports help us to help you. Thank you. The definitive Qt documentation is provided in HTML format; it is located at $QTDIR/doc/html and can be read using Qt Assistant or with a web browser. This man page is provided as a convenience for those users who prefer man pages, although this format is not officially supported by Trolltech. If you find errors in this manual page, please report them to qt-bugs@trolltech.com. Please include the name of the manual page (qdeepcopy.3qt) and the Qt version (3.1.1). Trolltech AS 9 December 2002 QDeepCopy(3qt)
All times are GMT -4. The time now is 07:33 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy