I have a file `/tmp/wrk` containing filenames with paths. I want to remove filenames
from this file, for example
remove all filenames containing alja cagr cavt clta cmdo or corl
remove all filenames containing data for days in region `d.2016.001` to `d.2016.207`
remove all filenames containing data for days in region `d.2016.282` to `d.2016.356`
The tag represent data files for 2016 for each day (day1 to day 356),
i.e., from `d.2016.001` to `d.2016.356`
I want to keep only files in region `d.2016.208` to `d.2016.281`
Basically I want to process the files in this file by reading it and looping
each file in a do loop using bash. But as I have so many files, I want to
remove the ones I do not need from the file `/tmp/wrk`
You have started well over 300 threads in the last seven years. You know what is needed for us to be able to help you efficiently:
The operating system you're using (which you have not provided).
The shell you're using (which you have provided).
Names of files to be processed (which you have not provided).
A clear statement of what you're tying to do (which you have not provided).
A representative sample input file (which you have not provided).
The output that you hope will be produced from your sample input (which you have not provided).
The code that you have tried to solve this problem on your own (which you have not supplied). And any output (normal and diagnostic) produced by the code you have tried.
Please add another post to this thread filling in the missing information!
Note that you have said you want to remove files; but you have not made it clear whether that means that you want to physically remove files from your system, you just want to remove the names of those files from the file containing your list of filenames, or you just want to exclude those files while you process other filenames contained in file containing your list of filenames in a loop in your bash shell script.
Please don't make us guess at what you're trying to do. Tell us up front so we don't all waste our time suggesting solutions to problems unrelated to what you're trying to do.
This User Gave Thanks to Don Cragun For This Post:
What are you trying to match with . in the basic regular expressions you are creating to be used as addresses in sed? What characters does a <period> in a BRE match? Each of the following sed commands will remove every line in the current sample /tmp/wrk file you now have in post #1 in this thread.
Your last script in post #3, update #3 doesn't currently use .212 or .260; but it does use the other three.
Maybe you'd like to try the following replacement for that script and see if it works any better for you:
PS: Note that editing a file a few hundred times with sed is grossly inefficient. You would probably be better off using ed or ex to edit your file once feeding global editing commands to one invocation of that editor and after all of the updates have been completed, add a w command at the end to write all of the updates back to your input file. Running ed once instead of running sed about 290 times will be MUCH faster.
Last edited by Don Cragun; 02-19-2018 at 10:07 PM..
Reason: Add PS.
GM,
I have an issue at work, which requires a simple solution. But, after multiple attempts, I have not been able to hit on the code needed.
I am assuming that sed, awk or even perl could do what I need.
I have an application that adds extra blank page feeds, for multiple reports, when... (7 Replies)
Hi,
I have a linux server that was hacked and I have a bunch of files that sporadically contain the following lines through out the file:
<?php eval(base64_decode("Xxxxxxxxxxxxxx/xxxxxxxx"));
I did't put the exact lines of the file in this post. The "Xxxx" are random letters/numbers.... (8 Replies)
Hi folks, I have a long string of DNA sequences, and I need to remove several lines, as well as the line directly following them. For example, here is a sample of my starting material:
>548::GY31UMJ02DLYEH rank=0007170 x=1363.5 y=471.0 length=478... (1 Reply)
Hi
I have many files all with 1 field per line as in
12345
abcde
john.paul.net
6789101
how do I remove ceratin lines from these files.
Have tried sed but sed wrecks my head!
Many thanks in advance for any help (9 Replies)
Hi
Does anybody know of a command that will enable me to remove all entries in a file that have the format (name & time)
more testfile
anthony 2003
anthonyr 2008
amorel 15:00
anthonyp 14:35
anthonyp 14:35
anthonyr 2008
ardean 13:28
arlene 2003
arlenem 08:15
arlenem 08:15... (5 Replies)
Hi Gurus,
I'm a little new to UNIX. How can I do remove the first and last line in a file? Say, supppose I have a file as below:
Code:
1DMA
400002BARRIE
401002CALGARY/LETHBRI
402002CARLETON
500001PORTLAND-AUBRN
501001NEW YORK, NY
502001BINGHAMTON, NY ... (2 Replies)
Hi Gurus,
I'm a little new to UNIX. How can I do remove the first and last line in a file? Say, supppose I have a file as below:
1DMA
400002BARRIE
401002CALGARY/LETHBRI
402002CARLETON
500001PORTLAND-AUBRN
501001NEW YORK, NY ... (1 Reply)
I'm trying to find a command which will allow me to remove a range of lines (2-4) from a .dat file from the command line without opening the file.
Someone mentioned using the ex command?
Does anyone have any ideas?
thanks (6 Replies)
Hi There,
I've written a script that processes a data file on our system. Basically the script reads a post code from a list file, looks in the data file for the first occurrence (using grep) and reads the line number. It then tails the data file, with the line number just read, and outputs to a... (3 Replies)