Delete lines from huge file Post: 302096036

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how can I delete lines without actually going into the file

what am trying to do is delete a line in a specific file but I dont know what to do. I cant use the sed or awk commands because these commands dont really alter the original file. they only alter what they display on the screen by the way, am trying to do this from a script so if anybody can...

2. Shell Programming and Scripting

How to delete lines in a file that have duplicates or derive the lines that aper once

Input: a b b c d d I need: a c I know how to get this (the lines that have duplicates) : b d sort file | uniq -d But i need opossite of this. I have searched the forum and other places as well, but have found solution for everything except this variant of the problem.

3. UNIX for Dummies Questions & Answers

copy and paste certain many lines of huge file in linux

Dear All, I am working with windoes OS but remote a linux machine. I wonder the way to copy an paste some part of a huge file in linux machine. the contain of file like as follow: ... dump annealling all custom 10 anneal_*.dat id type x y z q timestep 0.02 run 200000 Memory...

4. Shell Programming and Scripting

NAWK array to store lines from huge file

Hi, I would like to clarify about the NAWK array to store multiple lines from huge file. The file is having an unique REF.NO, I wants to store the lines (it may be 100+ lines) till I found the new REF.NO. How can I apply NAWK - arrays for the above? Rgds, sharif.

5. UNIX for Dummies Questions & Answers

How get only required lines & delete the rest of the lines in file

Hiiii I have a file which contains huge data as a.dat: PDE 1990 1 9 18 51 28.90 24.7500 95.2800 118.0 6.1 0.0 BURMA event name: 010990D time shift: 7.3000 half duration: 5.0000 latitude: 24.4200 longitude: 94.9500 depth: 129.6000 Mrr: ...

6. Shell Programming and Scripting

How to delete a huge number of files at a time

I met a problem on HPUX with 64G RAM and 20 CPU. There are 5 million files with file name from file0000001.dat to file9999999.dat, in the same directory, and with some other files with random names. I was trying to remove all the files from file0000001.dat to file9999999.dat at the same time....

7. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to...

8. Shell Programming and Scripting

how to split a huge file by every 100 lines

into small files. i need to add a head.txt and tail.txt into small files at the begin and end, and give a name as q1.xml q2.xml q3.xml .... thank you very much.

9. Shell Programming and Scripting

splitting a huge line of file into multiple lines with fixed number of columns

Hi, I have a huge file with a single line. But I want to break that line into lines of with each line having five columns. My file is like this: code: "hi","there","how","are","you?","It","was","great","working","with","you.","hope","to","work","you." I want it like this: code:...

10. Shell Programming and Scripting

Delete 40 lines after every 24 lines from a file

Hello, I have file of more than 10000 lines. I want to delete 40 lines after every 20 lines. e.g from a huge file, i want to delete line no from 34 - 74, then 94 - 134 etc and so on. Please let me know how i can do it. Best regards,

LEARN ABOUT SUSE

xzdiff

XZDIFF(1)							     XZ Utils								 XZDIFF(1)

NAME

       xzcmp, xzdiff, lzcmp, lzdiff - compare compressed files

SYNOPSIS

       xzcmp [cmp_options] file1 [file2]
       xzdiff [diff_options] file1 [file2]
       lzcmp [cmp_options] file1 [file2]
       lzdiff [diff_options] file1 [file2]

DESCRIPTION

       xzcmp  and  xdiff invoke cmp(1) or diff(1) on files compressed with xz(1), lzma(1), gzip(1), or bzip2(1).  All options specified are passed
       directly to cmp or diff.  If only one file is specified, then the files compared are file1 (which must have a suffix of	a  supported  com-
       pression  format)  and  file1 from which the compression format suffix has been stripped.  If two files are specified, then they are uncom-
       pressed if necessary and fed to cmp(1) or diff(1).  The exit status from cmp or diff is preserved.

       The names lzcmp and lzdiff are provided for backward compatibility with LZMA Utils.

SEE ALSO

       cmp(1), diff(1), xz(1), gzip(1), bzip2(1), zdiff(1)

BUGS

       Messages from the cmp(1) or diff(1) programs refer to temporary filenames instead of those specified.

Tukaani 							    2009-07-05								 XZDIFF(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how can I delete lines without actually going into the file

Discussion started by: TRUEST

2. Shell Programming and Scripting

How to delete lines in a file that have duplicates or derive the lines that aper once

Discussion started by: necroman08

3. UNIX for Dummies Questions & Answers

copy and paste certain many lines of huge file in linux

Discussion started by: ariesto

4. Shell Programming and Scripting

NAWK array to store lines from huge file

Discussion started by: sharif