05-05-2009
Help removing strings from one file that match any of the values in a second file.
Hello,
I have a file that lists a few hundred values.
Example:
abca
abcb
abcc
abcd
I have a 2nd file with a few thousand lines. I need to remove every line from the 2nd file that contains any of the values listed in first file.
Example of strings to delete:
line1 *abca* end of line
line2 *abcb* end of line
line3 *abcc* end of line
I don't know enough to even venture a guess on how to accomplish this. If anyone has any suggestions, they would be most appreciated.
Thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a file with the following format
12g data/datasets/cct 8g data/dataset/cct
10 g data/two 5g data/something_different
10g something_different
5g data/two
is there a way to loop through this... (1 Reply)
Discussion started by: yawalias
1 Replies
2. Shell Programming and Scripting
I have a very large file (10,000,000 lines), that contains a sample id and a property of that sample. I have another file that contains around 1,000,000 lines with sample ids that I want to remove from the original file (create a new file without these lines).
I know how to do this in Perl, but it... (9 Replies)
Discussion started by: Jo_puzzled
9 Replies
3. Shell Programming and Scripting
Hi,
I have two files. 1st file has 1 column (huge file containing ~19200000 lines) and 2nd file has 2 columns (small file containing ~6000 lines).
#################################
huge_file.txt
a
a
ab
b
##################################
small_file.txt
a 1.5
b 2.5
ab ... (4 Replies)
Discussion started by: AshwaniSharma09
4 Replies
4. Shell Programming and Scripting
Hi all,
I wrote the following code to remove the value which are 0 in the input file (a columns if numbers).
awk 'BEGIN {
for (i=1; i<=NF; i++)
if ($i)
printf("%13.6e\n",$i)
}' $1 >> $2
The script works if the zeros are written as
0.0000
but not as
0.000000e+00
In... (10 Replies)
Discussion started by: f_o_555
10 Replies
5. Shell Programming and Scripting
I have file that looks like:
ATOM 2517 O VAL 160 8.337 12.679 -2.487
ATOM 2518 OXT VAL 160 7.646 12.461 -0.386
TER
ATOM 2519 N VAL 161 -14.431 5.789 -25.371
ATOM 2520 H1 VAL 161 -15.336 5.698 -25.811
ATOM 2521 H2 VAL 161 -13.416 10.529 17.708
ATOM 2522 H3 VAL 161 -14.363 ... (4 Replies)
Discussion started by: kanikasharma
4 Replies
6. Shell Programming and Scripting
Hello,
got a file with this structure:
33274 171030 02/29/2012 37897 P_GEH 2012-02-29 10:31:26
33275 171049 02/29/2012 38132 P_GEH 2012-02-29 10:35:27
33276 171058 02/29/2012 38515 P_GEH 2012-02-29 10:43:26
33277 170748 02/29/2012 40685 P_KOM ... (3 Replies)
Discussion started by: krecik28
3 Replies
7. Shell Programming and Scripting
Hi Friends,
I'm a great fan of this forum... it has helped me tone my skills in shell scripting. I have a challenge here, which I'm sure you guys would help me in achieving...
File A has a list of job ids and I need to compare this with the File B (*.log) and File C (extend *.log) and copy... (6 Replies)
Discussion started by: asnandhakumar
6 Replies
8. Shell Programming and Scripting
Hi
I will appreciate it if you can help me out. I have a file that contains this data
System Load: 3244 card: 1903 CPU: 6% card: 1904 CPU: 6% card: 1905 CPU: 28% card: 1906 CPU: 28% card: 1907 CPU: 36% card: 1908 CPU: 37%
I need to manipulate and output this as
system_load:3244... (2 Replies)
Discussion started by: kaf3773
2 Replies
9. UNIX for Beginners Questions & Answers
I have two files and desire to use the strings from $1 of file 1 (file1.txt) as search criteria to find matches in $2 of file 2 (file2.txt). If matches are found I want to output the entire line of file 2 (file2.txt) followed by fields $2-$11 of file 1 (file1.txt). I can find the matches, I cannot... (7 Replies)
Discussion started by: jvoot
7 Replies
10. UNIX for Beginners Questions & Answers
I cannot seem to get what should be a simple awk one-liner to work correctly and cannot figure out why. I would like to use patterns from a specific field in one file as regex to search for matching strings in the entire line ($0) of another file.
I would like to output the lines of File2 which... (1 Reply)
Discussion started by: jvoot
1 Replies
LEARN ABOUT REDHAT
spline
spline(1) User Commands spline(1)
NAME
spline - interpolate smooth curve
SYNOPSIS
spline [-aknpx] ...
DESCRIPTION
spline takes pairs of numbers from the standard input as abcissas and ordinates of a function. It produces a similar set, which is approxi-
mately equally spaced and includes the input set, on the standard output. The cubic spline output (R. W. Hamming, Numerical Methods for
Scientists and Engineers,2nd ed., 349ff) has two continuous derivatives, and sufficiently many points to look smooth when plotted, for
example by graph(1).
OPTIONS
-a Supply abscissas automatically (they are missing from the input); spacing is given by the next argument, or is assumed to be 1 if
next argument is not a number.
-k The constant k used in the boundary value computation
(2nd deriv. at end) = k*(2nd deriv. next to end)
is set by the next argument. By default k = 0.
-n Space output points so that approximately n intervals occur between the lower and upper x limits. (Default n = 100.)
-p Make output periodic, that is, match derivatives at ends. First and last input values should normally agree.
-x Next 1 (or 2) arguments are lower (and upper) x limits. Normally these limits are calculated from the data. Automatic abcissas
start at lower limit (default 0).
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWesu |
+-----------------------------+-----------------------------+
SEE ALSO
graph(1), attributes(5)
R. W. Hamming, Numerical Methods for Scientists and Engineers, 2nd ed.
DIAGNOSTICS
When data is not strictly monotonic in x, spline reproduces the input without interpolating extra points.
BUGS
A limit of 1000 input points is enforced silently.
SunOS 5.10 14 Sep 1992 spline(1)