Hi drl,

Thanks for such a nice brief along with example. I understand that csvtool is an application which takes data as an input and based on the instruction it will process the input data and give the result in as an output.

Let me explain the scenario here what we are looking here.

From an automated application we are getting an input data file in csv format and we need to format that csv file in a specific format as I mentioned above. Here we maynt use any other application like csv tool to format the data (since the file may not be accessible to any other third party application). We are looking for some scripting command to format the input csv file and generate another csv file in side that automated tool which intially generated the input file.

Below is the part of the script which is generating the csv file and creating another csv file from the initial csv file.

Code:

 
// command for generating the initial csv file (file.csv)
blcli_execute Utility exportComplianceRunLatest "${COMPLIANCE_JOB_NAME}""$LOG_LOCATION/$LOG_NAME.csv""CSV"
 
//generating new csv file from initial csv file by removing carriage return. 
 
sed -e ':a' -e 'N' -e '$!ba' -e 's/]]\n/]]/g' file.csv > file1.csv

Currently these 2 commands are used in a shell script which is executing in the automation tool I have explained above. We have observing some problem in second command used to remove the carriage return. Instead of using the second command can you help me to create a new csv file with some specific columns/fields.

I hope you understood my limitation of not using csvtool. We can only use some scriting command to create a new csv file.



---------- Post updated at 04:47 PM ---------- Previous update was at 02:32 PM ----------

In our case we have csv file and data in below format.

Code:

 
file.csv
 
Name,age,permanent_address,current_address,job_location
 
Joel,18,"lanjipalli, ram nagar
1st lane.street4","baner gaon, bitthal
temple Pune", India
 
Litu,24,,"lteligudipalli, hariram nagar
1st lane.street no 8","nuonar gaon, bitthal
temple Pune", India
 
 
expected result(file.csv)
 
name,age,job_location
Joel,18,India
litu,24,India

Note: Here we have space, carriage return and white spaces in permanent and current location.

I think we have issue that we have carriage return in place for 3rd and 4th field in csv file.