Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

awk append fileA.txt to growing file B.txt

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk append fileA.txt to growing file B.txt
# 1  
Old 10-15-2011
awk append fileA.txt to growing file B.txt
This is appending a column.
My question is fairly simple. I have a program generating data in a form like so:
Code:
1  20
2  22
3  23
4  12
5  43

For ever iteration I'm generating this data. I have the basic idea with
Code:
cut -f 2 fileA.txt | paste -d  >> FileB.txt ????

I want FileB.txt to grow, and my program automatically generates a new filea.txt after every iteration. Thanks for your help guys!
# 2  
Old 10-15-2011
Hi theawknewbie,

I don't understand what you try to achieve. What content will be in fileB?

Regards,
Birei
# 3  
Old 10-15-2011
I want FileB to be growing after each iteration.
After 1 iteration, here is FileB:
Code:
1  20
2  22
3  23
4  12
5  43

Second iteration, i cut column 2 from the newly made fileA into FileB:
Code:
1  20  21
2  22  23
3  23  24
4  12  25
5  43  21

And after the third iteration, fileA is again regenerated, i cut column two from it, append to FileB:
Code:
1  20  21  14
 2  22  23  15
 3  23  24  12
 4  12  25  23
 5  43  21  38

etc. etc. My problem is that If i paste the columns, i have to give the file a new name. But I want FileB to maintain the same name, essentially to keep appending and appending to FileB.
# 4  
Old 10-15-2011
There will be better ways. With this method, create first fileB. And 'awk' command uses an auxiliar file (fileC in my example). Test it:
Code:
$ ls -1
fileA
$ cat fileA 
1  25
2  27
3  28
4  17
5  48
$ touch fileB
$ ls -1
fileA
fileB
$ awk 'NR == FNR { $1 = ""; sub( /[[:space:]]+/, "", $0 ); fileA[FNR] = $0; next } { print $0 "  " fileA[FNR]; fileB_exists = 1 } END { if ( ! fileB_exists ) { for ( i = 1; i <= length(fileA); i++ ) { print fileA[i] } } } ' fileA fileB >fileC; mv fileC fileB
$ cat fileB
25
27
28
17
48
$ awk 'NR == FNR { $1 = ""; sub( /[[:space:]]+/, "", $0 ); fileA[FNR] = $0; next } { print $0 "  " fileA[FNR]; fileB_exists = 1 } END { if ( ! fileB_exists ) { for ( i = 1; i <= length(fileA); i++ ) { print fileA[i] } } } ' fileA fileB >fileC; mv fileC fileB
$ cat fileB
25  25
27  27
28  28
17  17
48  48

Regards,
Birei
# 5  
Old 10-19-2011
Birei,

that is sort of the way I was doing it. But the files I'm dealing with become huge, and it's becoming very slow.

I wonder if there is a way to do it in sed?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Programming

[Python] replicating "sha256 -C checksum_file.txt file.txt"

Hello everyone, Since my python knowledge is limimted, I've challenged myself to learn as much as possible to help me with my carrere. I'm currently trying to convert a shell script to python, just to give myself a task. There is one section of the script that I'm having issues converting and... (2 Replies)
Discussion started by: da1
2 Replies

2. Shell Programming and Scripting

Awk, sed, shell all words in INPUT.txt find in column1 of TABLE.txt and replce with column2 in

Hi dears i have text file like this: INPUT.txt 001_1_173 j nuh ]az 001_1_174 j ]esma. nuh ]/.xori . . . and have another text like this TABLE.txt j j nuh word1... (6 Replies)
Discussion started by: alii
6 Replies

3. Shell Programming and Scripting

Desired output.txt for reading txt file using awk?

Dear all, I have a huge txt file (DATA.txt) with the following content . From this txt file, I want the following output using some shell script. Any help is greatly appreciated. Greetings, emily DATA.txt (snippet of the huge text file) 407202849... (2 Replies)
Discussion started by: emily
2 Replies

4. Windows & DOS: Issues & Discussions

2 Questions: replace text in txt file, add text to end of txt file

so... Lets assume I have a text file. The text file contains multiple "#" symbols. I want to replace all thos "#"s with a STRING using DOS/Batch I want to add a certain TEXT to the end of each line. How can I do this WITHOUT aid of sed, grep or anything linux related ? (1 Reply)
Discussion started by: pasc
1 Replies

5. Shell Programming and Scripting

Need to append the date | abcddate.txt to the first line of my txt file

I want to add/append the info in the following format to my.txt file. 20130702|abcd20130702.txt FN|SN|DOB I tried the below script but it throws me some exceptions. <#!/bin/sh dt = date '+%y%m%d'members; echo $dt+|+members+$dt; /usr/bin/awk -f BEGIN { FS="|"; OFS="|"; } { print... (6 Replies)
Discussion started by: harik1982
6 Replies

6. Shell Programming and Scripting

command to list .txt and .TXT file

Hi expersts, in my directory i have *.txt and *.TXT and *.TXT.log, *.txt.log I want list only .txt and .TXT files in one command... how to ?? //purple (1 Reply)
Discussion started by: thepurple
1 Replies

7. Shell Programming and Scripting

AWK CSV to TXT format, TXT file not in a correct column format

HI guys, I have created a script to read 1 column in a csv file and then place it in text file. However, when i checked out the text file, it is not in a column format... Example: CSV file contains name,age aa,11 bb,22 cc,33 After using awk to get first column TXT file... (1 Reply)
Discussion started by: mdap
1 Replies

8. UNIX for Dummies Questions & Answers

Binary txt file received when i use uuencode to send txt file as attachment

Hi, I have already read a lot of posts on sending attachments in unix...but none of them were of help for my problem...so here goes.. i wanna attach a text file and send to a mail id..used the following code : uuencode "$File1" "$File1" ;|mail -s "$Mail_sub" abc@abc.com it works... (2 Replies)
Discussion started by: ash22
2 Replies

9. UNIX for Dummies Questions & Answers

echo "ABC" > file1.txt file2.txt file3.txt

Hi Guru's, I need to create 3 files with the contents "ABC" using single command. Iam using: echo "ABC" > file1.txt file2.txt file3.txt the above command is not working. pls help me... With Regards / Ganapati (4 Replies)
Discussion started by: ganapati
4 Replies

10. Shell Programming and Scripting

Need a script to Append date to generated .txt file

Hi, Can anyone plz share their experience with - Building shell script to append the file with date in following format- Filename_MMDDYYYY.txt Thanks in advance (2 Replies)
Discussion started by: prince_of_focus
2 Replies
Login or Register to Ask a Question