11-13-2013
Don't use
sed nor
wc to read that huge file again and again. Why don't you keep last time's file size, and then skip that with
dd? Have a look
here. If your
dd allows for
iflag=skip_bytes, use this as it skips bytes but reads blocks.
These 2 Users Gave Thanks to RudiC For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
We have a third party tool in UNIX to kick off a 'file copy' job based on a file existance. If a specific file exists in an UNIX directory, another process should start copy the file into another system for further processing. The issue is, the copy job is starting as soon as the file exists in... (6 Replies)
Discussion started by: kslakshm
6 Replies
2. UNIX for Dummies Questions & Answers
my /etc/.osm file is growing rapidly and logging large amounts of activity. Can anyone tell me what this file is for and what types of information is logged in this file.
Thanks in advance for your help!! (1 Reply)
Discussion started by: golfs4us
1 Replies
3. UNIX for Dummies Questions & Answers
I need to find the file that is growing in the mount. Say yesterday the utilised space was 95% but today that is 96%. How do i find the file that is growing in size. Have checked the same with du/df options but was not able to find much.
Please suggest the best possible option. (3 Replies)
Discussion started by: raman1605
3 Replies
4. HP-UX
how to redirect the growing contents of log file to another file in unix (2 Replies)
Discussion started by: megh
2 Replies
5. Shell Programming and Scripting
I have log file that is incremented every second and is rather big. I need monitor error in this file. I do not want to parse it all every time.
I want parse it first time then remember last position (as byte for example)
All consequent parsing I want to start from last saved position to the... (3 Replies)
Discussion started by: Narcom
3 Replies
6. Shell Programming and Scripting
Hi ,
I have incremental file FILE1 which locate in directory /asd/ This directory contains log files whose name entries goes in FILE1
how to make shell scripts for following condition
shell script executes on
day1
FILE1 entry ---->
1.log
... (3 Replies)
Discussion started by: kaushik02018
3 Replies
7. Solaris
Hi gurus
Im a newbie in solaris..I need to extend file system space in solaris 10 which is using SVM..I have a file system /pin02 which is 93% full n needs to be extended..only 3.6 gb avail space left..the file system is not mirrored...normal ufs file system only..can u please tel me t... (6 Replies)
Discussion started by: madanmeer
6 Replies
8. UNIX for Dummies Questions & Answers
Hi,
A log file which is growing at high speed, don't know the name of it. How to find the respective file?
Many thanks. (2 Replies)
Discussion started by: venkatesht
2 Replies
9. UNIX for Dummies Questions & Answers
Hi All,
I want to check if one my log file is updating properly, how can I achieve it.
The approach I am trying is to get the file size at two different interval and than comparing it eg :
$ ls -ltr | tail -1 | awk '{print $5}'
20480 (7 Replies)
Discussion started by: mukulverma2408
7 Replies
10. Shell Programming and Scripting
Hi,
I have a log file (log.txt) that which contains lines of date/time.
I need to create a script to extract a CSV file (out.csv) that gets all the sequential times (with only 1 minute difference) together by stating the start time and end time of this period.
Sample log file (log.txt)
... (7 Replies)
Discussion started by: Mr.Zizo
7 Replies
LEARN ABOUT DEBIAN
hxcopy
HXCOPY(1) HTML-XML-utils HXCOPY(1)
NAME
hxcopy - copy an HTML file and update its relative links
SYNOPSIS
hxcopy [ -i old-URL ] [ -o new-URL ] [ file-or-URL [ file-or-URL ] ]
DESCRIPTION
The hxcopy command copies its first argument to its second argument, while updating relative links. The input is assumed to be HTML or
XHTML and may be slightly reformatted in the process.
If the second argument is omitted, hxcopy writes to standard output. In this case the option -o is required. If the first argument is also
omitted, hxcopy reads from standard input. In this case the option -i is required.
OPTIONS
The following options are supported:
-i old-URL
For the purposes of updating relative links, act as if old-URL is the location from which the input is copied. If this option is
omitted, the actual location of the first argument is used for calculating relative links.
-o new-URL
For the purposed of updating relative links, act as if new-URL is the location to which the input is copied. If this option is
omitted, the actual location of the second argument is used for calculating relative links.
ENVIRONMENT
To use a proxy to retrieve remote files, set the environment variables http_proxy and ftp_proxy. E.g., http_proxy="http://localhost:8080/"
BUGS
Unlike the last argument of cp(1), the last argument of hxcopy must be a file, not a directory.
The second argument must be a local file. Writing to a URL is not yet implemented. To work around this, replace hxcopy file.html
http://example.org/file.html by hxcopy -o http://example.org/file.html file.html tmp.html and then upload tmp.html to the given URL with
some other command, such as curl(1). The first argument, however, may be a URL. hxcopy will download the given file. (Currently only HTTP
is supported.)
EXAMPLE
Assume the HTML file foo.html contains a relative link to "../bar.html". Here are some examples of commands:
hxcopy foo.html bar/foo.html
The file foo.html is copied to ../bar/foo.html and the relative link to "../bar.html" becomes "../../bar.html".
hxcopy foo.html ../foo.html
The file foo.html is copied to ../foo.html and the relative link to "../bar.html" is rewritten as "bar.html".
hxcopy -i http://my.org/dir1/foo.html -o http://my.org/foo.html file1.html file2.html
The file file1.html is copied to file2.html and the relative link to "../bar.html" is rewritten as "bar.html". A command like this
may be useful to update files that are later uploaded to a server.
SEE ALSO
cp(1), curl(1), hxwls(1)
6.x 9 Dec 2008 HXCOPY(1)