Copy the last part since the file has been updated


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Copy the last part since the file has been updated
# 1  
Old 02-14-2012
Copy the last part since the file has been updated

Input File1 constatntly running and growing in size.

My Program Erorr ddmmyy hh:mm:ss My Program Error
**Port 123 terminated
**ID PIN 12345
Comamnd Successful
Command Terminated
Command Successful
Command Terminated
**My Program Erorr ddmmyy hh:mm:ss My Program Error
**Port 345 terminated
**ID PIN 67890
Comamnd Successful
Command Terminated
Command Successful
Command Terminated
**My Program Erorr ddmmyy hh:mm:ss My Program Error
**Port 678 terminated
**ID PIN 13579
Comamnd Successful
Command Terminated
Command Successful
Command Terminated


I periodically copy file1, to file2 and then run awk script to display "Program Errors" and then mailx to my inbox.

This part is working fine, however since the input file1 is constantly running and growing in size, is there a way to copy
only the last part that have been updated since last copy was run.
**I can add a time stamp to the file's header or footer if that can make things easier.
Thank you
# 2  
Old 02-14-2012
start with tail -f. It is meant to do exactly what you want.
Code:
tail -f logfile  | [some code here]

# 3  
Old 02-15-2012
Tail command will not work since I don't know how many lines are in the file.
The file is continuously growing, and sometime there are 100 lines per minute, sometimes 300 or more.
# 4  
Old 02-15-2012
Quote:
Originally Posted by eurouno
Tail command will not work since I don’t know how many lines are in the file.
You don't have to, because tail -f never quits -- when it hits the end of file, it waits for more data. Whenever the length of the file changes, it will print out what was added. If the file is truncated, it ought to start over from the beginning, too.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to make a loop to read the input from a file part by part?

Hi All, We've a VDI infrastructure in AWS (AWS workspaces) and we're planning to automate the process of provisioning workspaces. Instead of going to GUI console, and launching workspaces by selecting individual users is little time consuming. Thus, I want to create them in bunches from AWS CLI... (6 Replies)
Discussion started by: arun_adm
6 Replies

2. Shell Programming and Scripting

Save output of updated csv file as csv file itself, part 2

Hi, I have another problem. I want to sort another csv file by the first field. result.csv SourceFile,Airspeed,GPSLatitude,GPSLongitude,Temperature,Pressure,Altitude,Roll,Pitch,Yaw /home/intannf/foto5/2015_0313_090651_219.JPG,0.,-7.77223,110.37310,30.75,996.46,148.75,180.94,182.00,63.92 ... (2 Replies)
Discussion started by: refrain
2 Replies

3. Shell Programming and Scripting

Help in UNIX shell to copy part of file name to new file name

Hi, I want to do the following in a Unix shell script and wonder if someone could assist me? I want to take files in a specific directory that start with the name pxpur012 and copy them to the same directory with the file name not containg pxpur012. For example, I have files like... (4 Replies)
Discussion started by: lnemitz
4 Replies

4. Shell Programming and Scripting

Copy part of file between two strings to another

I am a newbie to shell scripting I have a large log file , i need to work on the part of the log file for a particular date. Is there a way to find the first occurance of the date string and last occurance of the next day date date string and move this section to a new file. to explain it... (3 Replies)
Discussion started by: swayam123
3 Replies

5. UNIX for Dummies Questions & Answers

Copy a part of file

Hi, I want to copy text between expressions ">bcr1" and ">bcr2" to another file. Any simple solutions? Thanks (4 Replies)
Discussion started by: alpesh
4 Replies

6. Shell Programming and Scripting

Copy part of a variable

Hi, i was using a input file to get the last line of the file.But now i have stored the values from the file to a variable and want the last line from the variable . Slightly confused on how to extract that data from the variable. previous code, cat input.txt <TIME>00:15:48</TIME>... (2 Replies)
Discussion started by: Shellslave
2 Replies

7. Shell Programming and Scripting

Perl or Awk script to copy a part of text file.

Hi Gurus, I'm a total newbie to Perl and Awk scripting. Let me explain the scenario, there is a DB2 table with 5 columns and one of the column is a CLOB datatype containing XML. We need all the 4 columns but only a portion of string from the XML column. We decided to export DB2 table to a .del... (26 Replies)
Discussion started by: asandy1234
26 Replies

8. UNIX for Dummies Questions & Answers

Can I copy only part of my file to a new file?

Hi, I am looking for command to allow me only copying certain lines of records in my file to a new file. Can I do that? (3 Replies)
Discussion started by: whatisthis
3 Replies
Login or Register to Ask a Question