File creation , csv

12-22-2015

Registered User

29, 0

Join Date: Dec 2015

Last Activity: 15 January 2018, 2:14 PM EST

Posts: 29

Thanks Given: 20

Thanked 0 Times in 0 Posts

File creation , csv

Dear All,

Below is my requirement.

Scenario:
There are four file input.txt, object.txt, output.txt, another_object.txt
Now the number of records in all these file may be different.

Sample Content of Files:
Object.txt -- > abcd.txt (eof)
Input.txt --> abc.txt \n xyz.txt(eof)
Output.txt --> output_file.txt(eof)
another_object.txt --> another_object_file_1.txt (eof) [ sometimes there may not be any such file]

Required output:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,NA,NA

i.e in order object.txt, input.txt, output.txt, another_object.txt (if there is no record or file present for particular... then NA should appear)

Expecting a constructive discussion / suggestion.

Thanks.

TechGyaann

View Public Profile for TechGyaann

Find all posts by TechGyaann

12-22-2015

Registered User

2,019, 606

Join Date: Apr 2009

Last Activity: 27 February 2021, 12:15 PM EST

Location: India

Posts: 2,019

Thanks Given: 50

Thanked 606 Times in 567 Posts

1. Please also let us know what you've attempted.
2. Let us know what OS/shell/tools you are using/want to use.

balajesuri

View Public Profile for balajesuri

Find all posts by balajesuri

12-22-2015

Registered User

12,315, 4,560

Join Date: Jul 2012

Last Activity: 22 November 2019, 4:29 PM EST

Location: San Jose, CA, USA

Posts: 12,315

Thanks Given: 952

Thanked 4,560 Times in 3,818 Posts

Please reformat your post using Code Tags when you post any code or data samples so we can easily read and understand your example. You can easily do this by highlighting your code and then clicking on the # in the editing menu. (You can also type code tags [code] and [/code] by hand.)

Note that by definition a text file on a UNIX or Linux systems consists of zero or more lines of text each of which is terminated by a <newline> character. If the (eof) in you samples is meant to indicate that your files do not include the line-terminating <newline> character on the last input line, your input files will need to be turned into legitimate text files before they can reliably be processed by UNIX and Linux text processing utilities.

With your given sample input, why is the desired output:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,NA,NA

instead of:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
NA,xyz.txt,NA,NA

or, maybe:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,output_file.txt,another_object_file_1.txt

???

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

12-22-2015

Registered User

29, 0

Join Date: Dec 2015

Last Activity: 15 January 2018, 2:14 PM EST

Posts: 29

Thanks Given: 20

Thanked 0 Times in 0 Posts

Quote:

Originally Posted by Don Cragun

Please reformat your post using Code Tags when you post any code or data samples so we can easily read and understand your example. You can easily do this by highlighting your code and then clicking on the # in the editing menu. (You can also type code tags [code] and [/code] by hand.)

Note that by definition a text file on a UNIX or Linux systems consists of zero or more lines of text each of which is terminated by a <newline> character. If the (eof) in you samples is meant to indicate that your files do not include the line-terminating <newline> character on the last input line, your input files will need to be turned into legitimate text files before they can reliably be processed by UNIX and Linux text processing utilities.

With your given sample input, why is the desired output:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,NA,NA

instead of:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
NA,xyz.txt,NA,NA

or, maybe:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,output_file.txt,another_object_file_1.txt

???

Its <newline> and not <EOF>.

I want the output like below

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,NA,NA

Where abcd.txt will get repeated. ( input, output, and another_object are files that are used inside the file abcd.txt) there by I want the output to be in the above format

This is one part of the coding that I am doing. I am going to use this as a function to parse different files(like abcd.txt) and create csv files.

Hope this information would be helpful for you.

Using - AIX

---------- Post updated at 02:57 PM ---------- Previous update was at 02:52 PM ----------

I don't have any idea as such on how to proceed.
But felt I can use a for loop and print as desired into an output file.

TechGyaann

View Public Profile for TechGyaann

Find all posts by TechGyaann

12-22-2015

Registered User

12,315, 4,560

Join Date: Jul 2012

Last Activity: 22 November 2019, 4:29 PM EST

Location: San Jose, CA, USA

Posts: 12,315

Thanks Given: 952

Thanked 4,560 Times in 3,818 Posts

We are still waiting to see what you have tried to solved this problem (as requested by balajesuri). And, no, the output doesn't make sense to me.

The 2nd input file has two lines. The 1st input line in that file goes into the 1st output file line and the 2nd input line in that file goes into the 2nd output file line.

The other three input files have one line. Why does that input line get duplicated in the output file for one input file and become NA in the output for the other two input files???

And, what should be in the output file if another_object.txt doesn't exist?

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

12-22-2015

Registered User

29, 0

Join Date: Dec 2015

Last Activity: 15 January 2018, 2:14 PM EST

Posts: 29

Thanks Given: 20

Thanked 0 Times in 0 Posts

I don't know how I should go ahead with this., and yes I dint give a try to this module.

Code:

 
 Column 1 -- abcd.txt gets repeated untill the maximum number of records in any of the other 3 files.
 Column 2, 3 and 4 will have to be "BLANK" or "NA" if it doesn't contain record.

if another_object.txt or output.txt or input.txt doesn't have any record (which) or if it doesn't exist, we need that part of the column have either blank or NA

TechGyaann

View Public Profile for TechGyaann

Find all posts by TechGyaann

12-22-2015

Registered User

12,315, 4,560

Join Date: Jul 2012

Last Activity: 22 November 2019, 4:29 PM EST

Location: San Jose, CA, USA

Posts: 12,315

Thanks Given: 952

Thanked 4,560 Times in 3,818 Posts

If I understand your requirements correctly (and I'm not sure that I do), you could try something like:

Code:

#!/bin/ksh
f1="Object.txt"
f2="Input.txt"
f3="Output.txt"
[ -f another_object.txt ] && f4="another_object.txt" || f4="/dev/null"
awk '
FNR == 1 {
	fn++
}
{	d[fn, FNR] = $0
	if(FNR > maxline)
		maxline = FNR
}
END {	for(i = 1; i <= maxline; i++)
		print d[1, 1], (2, i) in d ? d[2,i] : "NA",
			(3, i) in d ? d[3, i] : "NA",
			(4, i) in d ? d[4, i] : "NA"
}' OFS=, "$f1" "$f2" "$f3" "$f4"

and Object.txt contains:

Code:

abcd.txt

and Input.txt contains:

Code:

abc.txt
xyz.txt

and Output.txt contains:

Code:

output_file.txt
output_file2.txt
output_file3.txt
output_file4.txt

and another_object.txt contains:

Code:

another_object_file_1.txt

produces the output:

Code:

abcd.txt,abc.txt,output_file.txt,another_object_file_1.txt
abcd.txt,xyz.txt,output_file2.txt,NA
abcd.txt,NA,output_file3.txt,NA
abcd.txt,NA,output_file4.txt,NA

but, if there is no file another_object.txt, it produces the output:

Code:

abcd.txt,abc.txt,output_file.txt,NA
abcd.txt,xyz.txt,output_file2.txt,NA
abcd.txt,NA,output_file3.txt,NA
abcd.txt,NA,output_file4.txt,NA

Note that this code will not work if any input file except the last one is an empty file and will not work if any of the input files other than another_object.txt is missing.

This User Gave Thanks to Don Cragun For This Post:

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

Shell Programming and Scripting

File creation , csv

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Save output of updated csv file as csv file itself, part 2

Discussion started by: refrain

2. Shell Programming and Scripting

Save output of updated csv file as csv file itself

Discussion started by: refrain

3. Shell Programming and Scripting

Compare 2 files of csv file and match column data and create a new csv file of them

Discussion started by: refrain

4. Shell Programming and Scripting

Match columns from two csv files and update field in one of the csv file

Discussion started by: djoseph

5. Shell Programming and Scripting

Fixed Width file creation from csv

Discussion started by: aahlrich

6. Shell Programming and Scripting

CSV File Creation Within Shell Script

Discussion started by: swasid

7. Shell Programming and Scripting

Comparing 2 CSV files and sending the difference to a new csv file

Discussion started by: Naresh101

8. Shell Programming and Scripting

2 problems: Mailing CSV file / parsing CSV for display

Discussion started by: soldstatic

9. UNIX for Dummies Questions & Answers

csv file creation

Discussion started by: Student37