How to cut a pipe delimited file and paste it with another file to form a comma separated outputfile


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to cut a pipe delimited file and paste it with another file to form a comma separated outputfile
# 22  
Old 10-07-2014
This problem is only from the Excel side.
If you simply create a sample excel file, with leading zeroes, they will disappears as useless in type number.
Then try to change the cells format to text , and add extra leadings zeroes it's ok. But once this sheet is saved as csv and reloaded , what happens ? Nomore leading zeroes again.
The trouble is the leading zeroes are a matter of format, not saved with CSV file type.

A simple workaround is to save the file as .txt . Excel will import it interactively, so you can select each column format.
But all this is completely outside the scope of this forum .
This User Gave Thanks to blastit.fr For This Post:
# 23  
Old 10-08-2014
Might be double quoting the leading zeroes number fields would help?
# 24  
Old 11-24-2014
the sed code seems to be working fine but its throwing me off when the data contains double quotes within them .I have attached picture of what I am talking about.
Code:
sed 's/|/","/g; s/^/"/; s/$/"/' A4.txt > A5.csv


I know the sed code protectively quotes the fields with double quotes to help converting the pipe delim to commas delimited when there are commas within the fields.

I need a solution or change in the sed command to accommodate the situation where my input file A4.txt (attached file) contains fields which are encased as
Code:
="0123"

inorder to prevent dropping of leading zeroes.

I have attached the picture for same (A4.txt) .I can send the input file as well..

Image
# 25  
Old 11-24-2014
Use of an xml file instead of .CSV

As I explained previously, CSV files don't preserve the cells formats, and you need them to keep leading zeroes.
So I suggest as a workaround : generate Excel XML files from your application.
The required converting script can be easily done with awk.

You can easily get a template by exporting a excel sheet .
Under Excel, just save as "Excel 2003 xml sheet" , or something close to this .( I'm using Excel 2003 in French )
Starting from this file,you can create a good template by removing useless tags.

See the attached file, I just create using Excel et Notepad++.

Of course you may have to change some file associations if you wish to open it directly under Excel.

Jean-Paul
# 26  
Old 11-24-2014
thanks blastit but unfortunately my requiremenst dont allow me to do a xml and thhe conversion..I ahve figured out how to prevent the dropping of leading zeroes but I need a SED code that would work when data contains double quotes and commas within them to convert the pipe delim to csv.

It would be great if we can come up with any sed/awk solution.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Linux convert Comma delimited file to pipe

I have file in linux with comma delimited and string fields in double quotations ", I need to convert them to pipe delimiter please share your inputs. Example: Input: "2017-09-30","ACBD,TVF","01234",NULL,18,NULL,"686091802","BANK OF ABCD, LIMITED, THE",790456 Output: ... (4 Replies)
Discussion started by: shieksir
4 Replies

2. UNIX for Dummies Questions & Answers

Need to convert a pipe delimited text file to tab delimited

Hi, I have a rquirement in unix as below . I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column. ex: Input Text file: 1|A|apple 2|B|bottle excel file to be generated as output as... (9 Replies)
Discussion started by: raja kakitapall
9 Replies

3. Shell Programming and Scripting

Comma separated file

Hi all, I have the following files types: FileA: 100, 23, 33, FileB: 22, 45, 78, and i want to make File C: 100,22 23,45 33,78 any nice suggestions for making it easy. (3 Replies)
Discussion started by: hen1610
3 Replies

4. Shell Programming and Scripting

Help with converting Pipe delimited file to Tab Delimited

I have a file which was pipe delimited, I need to make it tab delimited. I tried with sed but no use cat file | sed 's/|//t/g' The above command substituted "/t" not tab in the place of pipe. Sample file: abc|123|2012-01-30|2012-04-28|xyz have to convert to: abc 123... (6 Replies)
Discussion started by: karumudi7
6 Replies

5. Shell Programming and Scripting

How to convert a space delimited file into a pipe delimited file using shellscript?

Hi All, I have space delimited file similar to the one as shown below.. I need to convert it as a pipe delimited, the values inside the pipe delimited file should be as highlighted... AA ATIU2345098809 009697 005374 BB ATIU2345097809 005445 006518 CC ATIU9685098809 003215 003571 DD... (7 Replies)
Discussion started by: nithins007
7 Replies

6. Shell Programming and Scripting

How to format file into comma separated text file?

Hi Guys, I have text file which is tab/space separated but I want it to re-format into a comma separated and trim the spaces in between. Can someone spare me a perl or sed script that can do the job? INPUT FILE: 500010245623 500 21-APR-11 05.58.21 PM ... (14 Replies)
Discussion started by: pinpe
14 Replies

7. Shell Programming and Scripting

Converting comma separated to pipe delimited file

Hi, I came across a very good script to convert a comma seperated to pipe delimited file in this forum. the script serves most of the requirement but looks like it does not handle embedded double quotes and commas i.e if the input is like 1234, "value","first,second", "LDC5"monitor",... (15 Replies)
Discussion started by: anijan
15 Replies

8. Shell Programming and Scripting

Cut and paste data in matrix form

I have large formatted data file with five columns. This has to be rearranged in lower order matrix form as shown below for sample data. 1 2 3 4 5 1.0 3.0 2.0 5.0 3.0 2.0 4.0 3.0 1.0 6.0 2.0 3.0 4.0 5.0 1.0 1.0 4.0 2.0 3.0 5.0 3.0 5.0 4.0 2.0 8.0 1.0 3.0 2.0 4.0 5.0 2.0... (7 Replies)
Discussion started by: dhilipumich
7 Replies

9. Shell Programming and Scripting

convert a pipe delimited file to a':" delimited file

i have a file whose data is like this:: osr_pe_assign|-120|wg000d@att.com|4| osr_evt|-21|wg000d@att.com|4| pe_avail|-21|wg000d@att.com|4| osr_svt|-11|wg000d@att.com|4| pe_mop|-13|wg000d@att.com|4| instar_ready|-35|wg000d@att.com|4| nsdnet_ready|-90|wg000d@att.com|4|... (6 Replies)
Discussion started by: priyanka3006
6 Replies

10. Shell Programming and Scripting

Converting Tab delimited file to Comma delimited file in Unix

Hi, Can anyone let me know on how to convert a Tab delimited file to Comma delimited file in Unix Thanks!! (22 Replies)
Discussion started by: charan81
22 Replies
Login or Register to Ask a Question