Visit The New, Modern Unix Linux Community


Need a script to convert comma delimited files to semi colon delimited


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need a script to convert comma delimited files to semi colon delimited
# 1  
Need a script to convert comma delimited files to semi colon delimited

Hi All,

I need a unix script to convert .csv files to .skv files (changing a comma delimited file to a semi colon delimited file). I am a unix newbie and so don't know where to start. The script will be scheduled using cron and needs to convert each .csv file in a particular folder to a .skv equivalent and create a token in the folder to show completion as well as a log showing the number of files and records converted for auditing.

Sample data ... before conversion

Code:
27981,13,"0901"," ","B18975362",1,"C",17,"1"," "," "," "
24875,12,"0901"," ","B24578942",0,"F",17,"0"," "," "," "

Sample data ... after conversion

Code:
27981;13;0901;;B18975362;1;C;17;1;;;;^ 
24875;12;0901;;B24578942;0;F;17;0;;;;^

Please note that the number of columns in each file to be converted could be different, but that each .skv should have the same number of columns as the source .csv

example source & target folder: /test/conv

Any help would be most appreciated
# 2  
try..

Code:
sed 's/,/;/g; s/\"//g; s/$/;^/' file

# 3  
Hi Pamu,

Thanks for the suggestion ... as I mentioned I am a complete newbie and dont know how I would write the script at all. Please could you give me a more detailed example that I could test on my data?

Many thanks
# 4  
You can do sth like below...

Code:
$ cat file
27981,13,"0901"," ","B18975362",1,"C",17,"1"," "," "," "
24875,12,"0901"," ","B24578942",0,"F",17,"0"," "," "," "

$ sed 's/,/;/g; s/\"//g; s/$/;^/' file > out_file

$ cat out_file
27981;13;0901; ;B18975362;1;C;17;1; ; ; ;^
24875;12;0901; ;B24578942;0;F;17;0; ; ; ;^

Hope this helps you

Regards,

pamu
# 5  
Code:
awk 'NR%2{gsub(/,/,";")}1' RS=\" ORS= file


Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #128
Difficulty: Easy
Generally speaking, most of the software included in a Linux distro is free and open source.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Need help on an old post - How to convert a comma delimited string to records or lines of text?

Hi, Apologies in advance to the moderator if I am posting this the wrong way. I've searched and found the solution to an old post but as it is a very old post, I don't see an option to update it with additional question. The question I have is in relation to the following post: How to... (6 Replies)
Discussion started by: newbie_01
6 Replies

2. Shell Programming and Scripting

Linux convert Comma delimited file to pipe

I have file in linux with comma delimited and string fields in double quotations ", I need to convert them to pipe delimiter please share your inputs. Example: Input: "2017-09-30","ACBD,TVF","01234",NULL,18,NULL,"686091802","BANK OF ABCD, LIMITED, THE",790456 Output: ... (4 Replies)
Discussion started by: shieksir
4 Replies

3. Shell Programming and Scripting

Help/Advise please for converting space delimited string variable to comma delimited with quote

Hi, I am wanting to create a script that will construct a SQL statement based on a a space delimited string that it read from a config file. Example of the SQL will be For example, it will read a string like "AAA BBB CCC" and assign to a variable named IN_STRING. I then concatenate... (2 Replies)
Discussion started by: newbie_01
2 Replies

4. UNIX for Dummies Questions & Answers

Need to convert a pipe delimited text file to tab delimited

Hi, I have a rquirement in unix as below . I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column. ex: Input Text file: 1|A|apple 2|B|bottle excel file to be generated as output as... (9 Replies)
Discussion started by: raja kakitapall
9 Replies

5. UNIX for Dummies Questions & Answers

How to convert a comma delimited string to records or lines of text?

Hi, I am not sure if I've posted this question before. Anyway, I previously asked about converting lines of text into a comma delimited string. Now I am needing to do the other way around ... :( :o Can anyone advise how is this possible? Example as below: Converting records/lines to... (2 Replies)
Discussion started by: newbie_01
2 Replies

6. Shell Programming and Scripting

how to convert comma delimited file to tab separator

Hi all, How can i convert comma delimited .csv file to tab separate using sed command or script. Thanks, Krupa (4 Replies)
Discussion started by: krupasindhu18
4 Replies

7. Shell Programming and Scripting

How to convert a space delimited file into a pipe delimited file using shellscript?

Hi All, I have space delimited file similar to the one as shown below.. I need to convert it as a pipe delimited, the values inside the pipe delimited file should be as highlighted... AA ATIU2345098809 009697 005374 BB ATIU2345097809 005445 006518 CC ATIU9685098809 003215 003571 DD... (7 Replies)
Discussion started by: nithins007
7 Replies

8. UNIX for Advanced & Expert Users

Urgent! need help! how to convert this file into comma delimited format

Hi experts, I need urget help! I have the a text file with this format: Types of fruits Name of fruits 1,1 Farm_no,1 apple,1 pineapple,1 grapes,1 orange,1 banana,1 2,2--->this is the record seperator Farm_no,2 apple,1 pineapple,1 grapes,3 orange,2 banana,1 3,3--->this is the... (2 Replies)
Discussion started by: natalie23
2 Replies

9. Shell Programming and Scripting

how to convert this file into comma delimited format

Hi experts, I need urget help! I have the a text file with this format: Types of fruits Name of fruits 1,1 Farm_no,1 apple,1 pineapple,1 grapes,1 orange,1 banana,1 2,2--->this is the record seperator Farm_no,2 apple,1 pineapple,1 grapes,3 orange,2 banana,1 3,3--->this is the... (1 Reply)
Discussion started by: natalie23
1 Replies

10. Shell Programming and Scripting

Converting Tab delimited file to Comma delimited file in Unix

Hi, Can anyone let me know on how to convert a Tab delimited file to Comma delimited file in Unix Thanks!! (22 Replies)
Discussion started by: charan81
22 Replies

Featured Tech Videos