File manipulation

Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers File manipulation
# 1  
Old 05-01-2002
File manipulation

I'm new to Unix and want to know if this type of file processing is feasible. I have a master file downloaded on Sundays. From Monday to Saturday a file containing changes and adds and a file containing deletes are downloaded. I'd like to apply the mon-sat files to the master file so that I do not have to download the master every day. The master is extremely large.

# 2  
Old 05-02-2002
Have you tried tools like awk and sid and diff and grep ??

The above tools are sufficient for the task.
# 3  
Old 05-02-2002
This sounds just like an old COBOL program I had to write once upon a time.

In the UNIX world, I believe that sed and/or grep will work very well. Look at the replace function of sed and the -v function of grep.

You will also need to use file redirection as well. You know the > and < and >> and <<...

Try and code it first and then post some of your work for scrutiny.

Smilie Smilie Smilie
# 4  
Old 05-06-2002
regardless of what you decide, a good ol' fashioned parsing script placed into the crontab works wonders. completely hands off if done correctly.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Populating File data with custom manipulation on file names

Hi, I am confused how to proceed firther please find the problem below: Input Files: DCIA_GEOG_DATA_OCEAN.TXT DCIA_GEOG_DATA_MCRO.TXT DCIA_GEOG_DATA_CVAS.TXT DCIA_GEOG_DATA_MCR.TXT Output File Name: MMA_RFC_GEOG_NAM_DIM_LOD.txt Sample Record(DCIA_GEOG_DATA_OCEAN.TXT):(Layout same for... (4 Replies)
Discussion started by: Arun Mishra
4 Replies

2. Shell Programming and Scripting

Awk to convert a text file to CSV file with some string manipulation

Hi , I have a simple text file with contents as below: 12345678900 971,76 4234560890 22345678900 5971,72 5234560990 32345678900 71,12 6234560190 the new csv-file should be like: Column1;Column2;Column3;Column4;Column5 123456;78900;971,76;423456;0890... (9 Replies)
Discussion started by: FreddyDaKing
9 Replies

3. UNIX for Dummies Questions & Answers

Filtering records from 1 file based on some manipulation doen on second file

Hi, I am looking for an awk script which should help me to meet the following requirement: File1 has records in following format INF: FAILEd RECORD AB1234 INF: FAILEd RECORD PQ1145 INF: FAILEd RECORD AB3215 INF: FAILEd RECORD AB6114 ............................ (2 Replies)
Discussion started by: mintu41
2 Replies

4. Shell Programming and Scripting

value in file - manipulation

Hi Forum. I have the following 2 files: edw_mf_bypass_msg.txt and EDW_server.cfg. edw_mf_bypass_msg.txt - File#1 contains the following text To EDW Support: This is an automatic email sent from var_hostname. Please note that the Mutual Fund load did not run today due to previous... (2 Replies)
Discussion started by: pchang
2 Replies

5. Shell Programming and Scripting

File manipulation

Legends, Please help me to get the following I have a file abc.txt with the following contents 12 13 14 15 And, i want to get the output to a variable like below 12,13,14,15 .... How do i do this? Regards, san Please use code tags when posting data and code samples! (5 Replies)
Discussion started by: sdosanjh
5 Replies

6. UNIX for Dummies Questions & Answers

file manipulation help please

Hi there, I've trawled all over the web for help, and although seen some examples of what i want to do, I cannot seem to get it to work. I need to have this as a script. If anyone can help, I would like to do the following: I have 2 files, File A and File B. I would like to keep file A but... (5 Replies)
Discussion started by: lazerlyte
5 Replies

7. Shell Programming and Scripting

File Manipulation

Hi, i have a file with fixed record length with the following content (only one sentence) 12345678901234567890123456789012345678901234567890 12345678 87654321 hugo meyer friedhofpaul the numbers above are only the column-positions and not part of the file! Now i want... (2 Replies)
Discussion started by: FranzB
2 Replies

8. Shell Programming and Scripting

Help with file manipulation

I need help manipulating text in a file. I am wanting to know a way to shell (ksh)script-edit a file by having a script that searches for a specific string, and then input lines of text in the file before that specific string, without deleting any of the other text in the file. I got this... (2 Replies)
Discussion started by: LinuxRacr
2 Replies

9. Shell Programming and Scripting

file manipulation best way ?

Hi , i would convert the following file V M BOURSE EMPLOI mail/mail-03/dfr-dc.nsf V M DelSpam mail/mail-04/celine_bet.nsf like that : mail/mail-03/dfr-dc.nsf;BOURSE EMPLOI mail/mail-20/celine_bet.nsf;DelSpam the second field ( ex:... (2 Replies)
Discussion started by: Nicol
2 Replies

10. Programming

need help with file manipulation

I've been able to open and write data to files but I need to know how to search a file for a hex string and replace it. (2 Replies)
Discussion started by: angelfly
2 Replies
Login or Register to Ask a Question