Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: remove the first line of all files
Top Forums Shell Programming and Scripting remove the first line of all files Post 302155505 by ghostdog74 on Friday 4th of January 2008 07:17:23 AM
Old 01-04-2008
just for fun: for very large files, use awk/more instead of sed '1d' method.
Code:
# wc -l file1
8998841 file1
# time sed '1d' file1 > sedtest

real    0m28.329s
user    0m26.930s
sys     0m1.000s
# time sed -n '2,$p' file1 > sedtest

real    0m33.740s
user    0m29.842s
sys     0m1.096s

# time more +2 file1 > moretest

real    0m10.629s
user    0m8.353s
sys     0m0.856s
 # time awk 'NR>1' file1 > awktest

real    0m14.618s
user    0m7.476s
sys     0m1.016s

 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove '^M' in each line of files

Hi All, Working on AIX 5.3 we need to remove '^M' in each line of files. could anyone please share such an experience would be appreciated. Thanks for your time! Regards, (9 Replies)
Discussion started by: a1_win
9 Replies

2. UNIX for Dummies Questions & Answers

Newbye. Help with KSH. Loop in files and remove first line

Hi everybody. Firstly, sorry for doing such a basic questions, but i have never worked with linux shells and at this moment i am trully desperated :d. I have been checkin' another posts of this forum looking for different things for mixing them and get the solution to my problem, but i have not ... (2 Replies)
Discussion started by: bringer
2 Replies

3. Shell Programming and Scripting

Need to remove improperly formatted fortran output line from files, tried sed

I have been trying to remove some improperly formatted lines of output from fortran code I have been using. The problem is that I have some singularities in the math for some points that causes an incorrectly large value to be reported that exceeds the normal formating set in the code resulting in... (2 Replies)
Discussion started by: gillesc_mac
2 Replies

4. Shell Programming and Scripting

remove a line in files

Hi I have 3 files and I want to remove 1 line in each file. This line correposnds to the occurrence of a specific pattern any idea how to do this in shell? thx (4 Replies)
Discussion started by: melanie_pfefer
4 Replies

5. UNIX for Advanced & Expert Users

Remove first line from mutiple files

How to remove the first line from multiple files and use it as source to the jobs. Only at the runtime it should remove the first line not in the file . (1 Reply)
Discussion started by: etldeveloper
1 Replies

6. Shell Programming and Scripting

compare files and remove a line from a file if first column is greater than 25

my files are as follows fileA sepearated by tab /t 00 lieferungen 00 attractiop 01 done 02 forness 03 rasp 04 alwaysisng 04 funny 05 done1 fileB funnymou120112 funnymou234470 mou3raspnhdhv rddfgmoudone1438748 so all those record which are greater than 3 and which are not... (4 Replies)
Discussion started by: rajniman
4 Replies

7. Shell Programming and Scripting

Want to remove a line feed depending on number of tabs in a line

Hi! I have been struggling with a large file that has stray end of line characters. I am working on a Mac (Lion). I mention this only because I have been mucking around with fixing my problem using sed, and I have learned far more than I wanted to know about Unix and Mac eol characters. I... (1 Reply)
Discussion started by: user999991
1 Replies

8. UNIX for Dummies Questions & Answers

How to remove fields space and append next line to previous line.?

awk 'BEGIN{FS = "Ç"} NR == 1 {p = $0; next} NF > 1 {print p; p = $0} NF <= 1 {p = (p " " $0)} END {print p}' input.txt > output.txt This is what the input data file looks like with broken lines Code: 29863 Ç890000000 Ç543209911 ÇCHNGOHG Ç000000001 Ç055 ... (4 Replies)
Discussion started by: cumeh1624
4 Replies

9. Shell Programming and Scripting

Ksh: Read line parse characters into variable and remove the line if the date is older than 50 days

I have a test file with the following format, It contains the username_date when the user was locked from the database. $ cat lockedusers.txt TEST1_21062016 TEST2_02122015 TEST3_01032016 TEST4_01042016 I'm writing a ksh script and faced with this difficult scenario for my... (11 Replies)
Discussion started by: humble_learner
11 Replies

LEARN ABOUT DEBIAN

pegasus-remove

PEGASUS-REMOVE(1)														 PEGASUS-REMOVE(1)

NAME

       pegasus-remove - removes a workflow that has been planned and submitted using pegasus-plan and pegasus-run

SYNOPSIS

       pegasus-remove [-d dagid] [-v] [rundir]

DESCRIPTION

       The pegasus-remove command remove a submitted/running workflow that has been planned and submitted using pegasus-plan and pegasus-run. The
       command can be invoked either in the planned directory with no options and arguments or just the full path to the run directory.

OPTIONS

       By default pegasus-remove does not require any options or arguments if invoked from within the planned workflow directory. If running the
       command outside the workflow directory then a full path to the workflow directory needs to be specified or the dagid of the workflow to be
       removed.

       pegasus-remove takes the following options:

       -d dagid, --dagid dagid
	   The workflow dagid to remove

       -v, --verbose
	   Raises debug level. Each invocation increase the level by 1.

       rundir
	   Is the full qualified path to the base directory containing the planned workflow DAG and submit files. This is optional if
	   pegasus-remove command is invoked from within the run directory.

RETURN VALUE

       If the workflow is removed successfully pegasus-remove returns with an exit code of 0. However, in case of error, a non-zero exit code
       indicates problems. An error message clearly marks the cause.

FILES

       The following files are opened:

       braindump
	   This file is located in the rundir. pegasus-remove uses this file to find out paths to several other files.

ENVIRONMENT VARIABLES

       PATH
	   The path variable is used to locate binary for condor_rm.

SEE ALSO

       pegasus-plan(1), pegasus-run(1)

AUTHORS

       Gaurang Mehta <gmehta at isi dot edu>

       Jens-S. Vockler <voeckler at isi dot edu>

       Pegasus Team http://pegasus.isi.edu

								    05/24/2012							 PEGASUS-REMOVE(1)
All times are GMT -4. The time now is 08:52 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy