01-26-2012
[SOLVED] Delete multiple lines starting with a specific pattern
Hi, just tried some script, awk, sed for the last 2 hours and now need help.
Let's say I have a huge file of 800,000 lines like this :
Quote:
UPDATE abc.INVENTORY
SET ORD_30DAYS=33,
LAST_UPD_TIMESTAMP='2012/jan/18 06:11:11.621'
WHERE INVENTORY_ID=4274
UPDATE abc.INVENTORY
SET LAST_UPD_TIMESTAMP='2012/jan/18 06:11:11.621002'
WHERE INVENTORY_ID=5564
It's a tedious job to look through it, I'd like to remove those useless lines in it as there's a few thousands :
Quote:
UPDATE abc.INVENTORY
SET LAST_UPD_TIMESTAMP='2012/jan/18 06:11:11.621002'
WHERE INVENTORY_ID=5564
Or to be even more precise :
if line1 = UPDATE*
and line2 = SET LAST_UPD_TIMESTAMP=*
and line3 = WHERE*
then delete those lines
As I said, it's a huge file, the faster, the better. Thanks for any help.
Last edited by Zurd; 01-26-2012 at 05:16 AM..
Reason: Now solved
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi There!
My final task for today is to delete lines starting with certain numbers
for e.g., my text block is
and i want to delete all lines starting with 11 or 17 or 21
I know i can use multiple sed commands like
sed '/^11,/d' <filename>
sed '/^17,/d' <filename>
sed '/^21,/d'... (2 Replies)
Discussion started by: orno
2 Replies
2. Shell Programming and Scripting
Hi,
I have file 1.txt with following entries as shown:
0152364|134444|10.20.30.40|015236433
0233654|122555|10.20.30.50|023365433
**
**
**
In file 2.txt I have the following entries as shown:
0152364|134444|10.20.30.40|015236433
0233654|122555|10.20.30.50|023365433... (4 Replies)
Discussion started by: imas
4 Replies
3. Shell Programming and Scripting
Hi,
I have a file such as:
---
>contig00001 length=35524 numreads=2944
gACGCCGCGCGCCGCGGCCAGGGCTGGCCCA
CAGGCCGCGCGGCGTCGGCTGGCTGAG
>contig00002 length=4242 numreads=43423
ATGCCGAAGGTCCGCCTGGGGCTGG
CGCCGGGAGCATGTAGCG
---
I would like to concatenate the lines not starting with ">"... (9 Replies)
Discussion started by: s052866
9 Replies
4. Shell Programming and Scripting
I need to delete those lines from a file, which starts with 45.
How to do it? (3 Replies)
Discussion started by: mady135
3 Replies
5. Shell Programming and Scripting
Hey,I have a file in following format
>1
ABC........
>2
XYZ.....
>3
ABC........
>4
MNO.......
>5
ABC.......
now I would like to find only those entries that doesn't start with ABC (specific pattern)e.g preferred output:
>2
XYZ....
>4
MNO.......
it will be nice if anybody how... (2 Replies)
Discussion started by: ankitachaurasia
2 Replies
6. Shell Programming and Scripting
i have a file sample.txt containing
i want to delete lines starting with 123 neglecting spaces and tabs.
but not lines containing 123. i.e.
i want files sample.txt as
help me
thanxx (4 Replies)
Discussion started by: yashwantkumar
4 Replies
7. Shell Programming and Scripting
Dear all,
I would like to delete even lines starting with "N" together with their respective titles which are actually odd lines.
Below is the example of input file. I would like to remove line 8 and 12 together with its title line, i.e., line 7 and 11, respectively.... (2 Replies)
Discussion started by: huiyee1
2 Replies
8. Shell Programming and Scripting
Gents,
I am trying to delete all lines which start with "H" character, but keeping the fist header. Example In the input file I will delete all lines starting from line 8 which contents character "H" to the end of the file.
I try
sed '8,10000{/^H/d;}' file
But as don't know the end... (1 Reply)
Discussion started by: jiam912
1 Replies
9. Shell Programming and Scripting
Hi
This is my first post and I'm just a beginner. So please be nice to me.
I have a couple of html files where a pattern beginning with "http://www.site.com" and ending with "/resource.dat" is present on every 241st line. How do I extract this to a new text file?
I have tried sed -n 241,241p... (13 Replies)
Discussion started by: dejavo
13 Replies
10. UNIX for Dummies Questions & Answers
Hi all!
Thanks for taking the time to view this!
I want to grep out all lines of a file that starts with pattern 1 but also does not match with the second pattern.
Example:
Drink a soda
Eat a banana
Eat multiple bananas
Drink an apple juice
Eat an apple
Eat multiple apples
I... (8 Replies)
Discussion started by: demmel
8 Replies
LEARN ABOUT REDHAT
set_transaction
SET
TRANSACTION(7) SQL Commands SET TRANSACTION(7)
NAME
SET TRANSACTION - set the characteristics of the current transaction
SYNOPSIS
SET TRANSACTION ISOLATION LEVEL { READ COMMITTED | SERIALIZABLE }
SET SESSION CHARACTERISTICS AS TRANSACTION ISOLATION LEVEL
{ READ COMMITTED | SERIALIZABLE }
DESCRIPTION
This command sets the transaction isolation level. The SET TRANSACTION command sets the characteristics for the current SQL-transaction. It
has no effect on any subsequent transactions. This command cannot be used after the first query or data-modification statement (SELECT,
INSERT, DELETE, UPDATE, FETCH, COPY) of a transaction has been executed. SET SESSION CHARACTERISTICS sets the default transaction isolation
level for each transaction for a session. SET TRANSACTION can override it for an individual transaction.
The isolation level of a transaction determines what data the transaction can see when other transactions are running concurrently.
READ COMMITTED
A statement can only see rows committed before it began. This is the default.
SERIALIZABLE
The current transaction can only see rows committed before first query or data-modification statement was executed in this transac-
tion.
Tip: Intuitively, serializable means that two concurrent transactions will leave the database in the same state as if the two has
been executed strictly after one another in either order.
NOTES
The session default transaction isolation level can also be set with the command
SET default_transaction_isolation = 'value'
and in the configuration file. Consult the Administrator's Guide for more information.
COMPATIBILITY
SQL92, SQL99
SERIALIZABLE is the default level in SQL. PostgreSQL does not provide the isolation levels READ UNCOMMITTED and REPEATABLE READ. Because of
multiversion concurrency control, the SERIALIZABLE level is not truly serializable. See the User's Guide for details.
In SQL there are two other transaction characteristics that can be set with these commands: whether the transaction is read-only and the
size of the diagnostics area. Neither of these concepts are supported in PostgreSQL.
SQL - Language Statements 2000-11-24 SET TRANSACTION(7)