Reading ALL BUT the first and last line of a huge file Post: 302969946

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Insert a line as the first line into a very huge file

Hello, I need to insert a line (like a header) as the first line of a very huge file (about 3 ml rows). I am able to do it with sed, but redirecting the output and creating a new file takes quite some time. I was wondering if there was a more efficient way of doing it? Any help would be...

2. UNIX for Dummies Questions & Answers

How to remove FIRST Line of huge text file on Solaris

i need help..!!!! i have one big text file estimate data file size 50 - 100GB with 70 Mega Rows. on OS SUN Solaris version 8 How i can remove first line of the text file. Please suggest me for solutions. Thank you very much in advance:)

3. Shell Programming and Scripting

[Solved] Problem in reading a file line by line till it reaches a white line

So, I want to read line-by-line a text file with unknown number of files.... So: a=1 b=1 while ; do b=`sed -n '$ap' test` a=`expr $a + 1` $here do something with b etc done the problem is that sed does not seem to recognise the $a, even when trying sed -n ' $a p' So, I cannot read...

4. Shell Programming and Scripting

Implement in one line sed or awk having no delimiter and file size is huge

I have file which contains around 5000 lines. The lines are fixed legth but having no delimiter.Each line line contains nearly 3000 characters. I want to delete the lines a> if it starts with 1 and if 576th postion is a digit i,e 0-9 or b> if it starts with 0 or 9(i,e header and footer) ...

5. Shell Programming and Scripting

Optimised way for search & replace a value on one line in a very huge file (File Size is 24 GB).

Hi Experts, I had to edit (a particular value) in header line of a very huge file so for that i wanted to search & replace a particular value on a file which was of 24 GB in Size. I managed to do it but it took long time to complete. Can anyone please tell me how can we do it in a optimised...

6. Shell Programming and Scripting

splitting a huge line of file into multiple lines with fixed number of columns

Hi, I have a huge file with a single line. But I want to break that line into lines of with each line having five columns. My file is like this: code: "hi","there","how","are","you?","It","was","great","working","with","you.","hope","to","work","you." I want it like this: code:...

7. Shell Programming and Scripting

Edit a Huge one line file

We have a huge file which has just one really large line; about 500 MB. I want to 1. Count all the occurrences of a phrase 2. Replace the phrase with another. Trying to open it using vi has not helped as it complains that it is too large. Can any script help? Please advise. Thank you,

8. Shell Programming and Scripting

Reading line by line from live log file using while loop and considering only those lines start from

Hi, I want to read a live log file line by line and considering those line which start from time stamp; Below code I am using, which read line but throws an exception when comparing line that does not contain error code tail -F /logs/COMMON-ERROR.log | while read myline; do...

9. UNIX for Dummies Questions & Answers

Need to replace new line characters in a huge file

Hi , I would like to replace new line characters(\n) in a huge file of about 2 million records . I tried this one (:%s/\n//g) but it's hanging there and no result. Does this command do not work if the file is big. Please let me know if you have any other options Regards Raj

LEARN ABOUT OPENSOLARIS

rusage

rusage(1B)					     SunOS/BSD Compatibility Package Commands						rusage(1B)

NAME

       rusage - print resource usage for a command

SYNOPSIS

       /usr/ucb/rusage command

DESCRIPTION

       The  rusage command is similar to time(1). It runs the given command, which must be specified; that is, command is not optional as it is in
       the C shell's timing facility. When the command is complete, rusage displays the real (wall clock), the system CPU, and the user CPU  times
       which  elapsed during execution of the command, plus other fields in the rusage structure, all on one long line. Times are reported in sec-
       onds and hundredths of a second.

EXAMPLES

       Example 1 The format of rusage output

       The example below shows the format of rusage output.

	 example% rusage wc /usr/share/man/man1/csh(1)
	 3045	13423	78071 /usr/share/man/man1/csh(1)
	 2.26 real 0.80 user 0.36 sys 11 pf 38 pr 0 sw 11 rb 0 wb 16 vcx 37
		  icx 24 mx 0 ix 1230 id 9 is
	 example%

       Each of the fields identified corresponds to an element of the rusage structure, as described in getrusage(3C), as follows:

       real			  elapsed real time
       user	 ru_utime	  user time used
       sys	 ru_stime	  system time used
       pf	 ru_majflt	  page faults requiring physical I/O
       pr	 ru_minflt	  page faults not requiring physical I/O
       sw	 ru_nswap	  swaps
       rb	 ru_inblock	  block input operations
       wb	 ru_oublock	  block output operations
       vcx	 ru_nvcsw	  voluntary context switches
       icx	 ru_nivcsw	  involuntary context switches
       mx	 ru_maxrss	  maximum resident set size
       ix	 ru_ixrss	  currently 0
       id	 ru_idrss	  integral resident set size
       is	 ru_isrss	  currently 0

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWscpu			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       csh(1), time(1), getrusage(3C), attributes(5)

BUGS

       When the command being timed is interrupted, the timing values displayed may be inaccurate.

SunOS 5.11							    14 Sep 1992 							rusage(1B)