Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Duplicate Line Report per Section
Top Forums Shell Programming and Scripting Duplicate Line Report per Section Post 302391967 by radoulov on Wednesday 3rd of February 2010 03:00:58 AM
Old 02-03-2010
Quote:
Originally Posted by petersf
[...]
Could you explain this part?
Code:
"h=$2_[h,$2,$3]"

Thanks!
Yes,
but it's:

Code:
h=$2;_[h,$2,$3]++==1

not:

Code:
h=$2_[h,$2,$3]++==1

The statement separator ; matters.

There are two expressions in the code,
the first one is:

Code:
/ABC[13]/ && h=$2

If the current record matches the pattern ABC[13] AND the value returned by the assignment of the value of the second field to the variable h is true - print the record.
OK, I'm cheating here, it's a shortcut that will fail if the value of $2 is 0, on the other hand, if that value could never be 0, there's less code to write (the fact is that we don't care what's the return value of the assignment, we just need to print those records and save the value of $2).

So we print the records ABC1, ABC3 and save the numeric part of the header in the h variable.

The second expression is:

Code:
_[h,$2,$3]++==1

We build an associative array keyed by the concatenated values of the previously saved header number, the second and the third field. The values are an auto-incremented integers.
When the value is 1, we print the record, because we see it for the second time (the first time we see a key, the value is 0 (because of the post-incrementing operator).

Hope this helps.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

help find a section line of a file

hi, I have a 20 line file. I need a command which will brinf back a specific line based upon the line number I enter. e.g. the file looks like this and is called file1 jim is a man john is a woman james is a man wendy is a woman lesley is a woman i want a command that will... (4 Replies)
Discussion started by: sureshy
4 Replies

2. Shell Programming and Scripting

Using Sed to duplicate a section of a file....

hello all, I have a file like this: section 1 blah1 blah2 section 2 blah1 blah2 section 3 blah1 blah2 and I want to use sed to duplicate section 2, like this: section 1 blah1 blah2 section 2 blah1 blah2 section 2 blah1 (2 Replies)
Discussion started by: nick26
2 Replies

3. Shell Programming and Scripting

Remove certain section from the line

A typical line looks like this... ) ENGINE=MyISAM DEFAULT CHARSET=utf8 COLLATE=utf8_bin AUTO_INCREMENT=129 COMMENT='Compiled E-Mails';I want to remove DEFAULT CHARSET= and COLLATE= after resetting AUTO_INCREMENT=0 I do not want to change the engine and comment. (7 Replies)
Discussion started by: shantanuo
7 Replies

4. Shell Programming and Scripting

how to retreive certain section of the line

Hi I am using "grep" command to get certain pattern out of the file: PNUM=34 $ grep -w "#${PNUM}" myfile #34 * 2297 * 410 * 964 * * 4352 $ Is there a way to retrieve the section of the above output without #34 so the output would look like this:... (3 Replies)
Discussion started by: aoussenko
3 Replies

5. Shell Programming and Scripting

Removing Duplicate Lines per Section

Hello, I am in need of removing duplicate lines from within a file per section. File: ABC1 012345 header ABC2 7890-000 ABC3 012345 Header Table ABC4 ABC5 593.0000 587.4800 ABC5 593.5000 587.6580 <= dup need to remove ABC5 593.5000 ... (5 Replies)
Discussion started by: petersf
5 Replies

6. Shell Programming and Scripting

Placing Duplicate Lines per section into another file

Hello, I need help in putting duplicate lines within a section into another file. Here is what I'm struggling with: Using this file “data.txt”: ABC1 012345 header ABC2 7890-000 ABC3 012345 Header Table ABC4 ABC5 593.0000 587.4800 ABC5 593.5000 587.6580 <= dup need to remove ABC5... (4 Replies)
Discussion started by: petersf
4 Replies

7. Shell Programming and Scripting

Extract section of file based on word in section

I have a list of Servers in no particular order as follows: virtualMachines="IIBSBS IIBVICDMS01 IIBVICMA01"And I am generating some output from a pre-existing script that gives me the following (this is a sample output selection). 9/17/2010 8:00:05 PM: Normal backup using VDRBACKUPS... (2 Replies)
Discussion started by: jelloir
2 Replies

8. Shell Programming and Scripting

Prepend first line of section to each line until the next section header

I have searched in a variety of ways in a variety of places but have come up empty. I would like to prepend a portion of a section header to each following line until the next section header. I have been using sed for most things up until now but I'd go for a solution in just about anything--... (7 Replies)
Discussion started by: pagrus
7 Replies

9. Shell Programming and Scripting

Print the first n line in each section

Hi, i have a file like this: ... 11111111 22222222 33333333 # 4444444 5555555 6666666 7777777 # ... i want just print the 2 first line between each section (each section is separated with "#"). so desired output would be like this: ... 11111111 22222222 (3 Replies)
Discussion started by: saeed.soltani
3 Replies

10. Shell Programming and Scripting

How to change file section into each line?

Hi Gurus, I have below file which has different sections, need to move the sections to beginning of the each record. original file aaa bbb ccc ddd eee fff output file. aaa bbb ccc ddd eee fff (6 Replies)
Discussion started by: green_k
6 Replies

LEARN ABOUT CENTOS

mysql_fix_privilege_tables

MYSQL_FIX_PRIVILE(1)					       MySQL Database System					      MYSQL_FIX_PRIVILE(1)

NAME

       mysql_fix_privilege_tables - upgrade MySQL system tables

SYNOPSIS

       mysql_fix_privilege_tables --password=root_password

DESCRIPTION

	   Note
	   In MySQL 5.1.7, mysql_fix_privilege_tables was superseded by mysql_upgrade, which should be used instead. See mysql_upgrade(1).

       Some releases of MySQL introduce changes to the structure of the system tables in the mysql database to add new privileges or support new
       features. When you update to a new version of MySQL, you should update your system tables as well to make sure that their structure is up
       to date. Otherwise, there might be capabilities that you cannot take advantage of.

       mysql_fix_privilege_tables is an older script that previously was used to uprade the system tables in the mysql database after a MySQL
       upgrade.

       Before running mysql_fix_privilege_tables, make a backup of your mysql database.

       On Unix or Unix-like systems, update the system tables by running the mysql_fix_privilege_tables script:

	   shell> mysql_fix_privilege_tables

       You must run this script while the server is running. It attempts to connect to the server running on the local host as root. If your root
       account requires a password, indicate the password on the command line like this:

	   shell> mysql_fix_privilege_tables --password=root_password

       The mysql_fix_privilege_tables script performs any actions necessary to convert your system tables to the current format. You might see
       some Duplicate column name warnings as it runs; you can ignore them.

       After running the script, stop the server and restart it so that any changes made to the system tables take effect.

       On Windows systems, MySQL distributions include a mysql_fix_privilege_tables.sql SQL script that you can run using the mysql client. For
       example, if your MySQL installation is located at C:Program FilesMySQLMySQL Server 5.1, the commands look like this:

	   C:> cd "C:Program FilesMySQLMySQL Server 5.1"
	   C:> binmysql -u root -p mysql
	   mysql> SOURCE share/mysql_fix_privilege_tables.sql

	   Note
	   Prior to version 5.1.17, the mysql_fix_privilege_tables.sql script is found in the scripts directory.

       The mysql command will prompt you for the root password; enter it when prompted.

       If your installation is located in some other directory, adjust the path names appropriately.

       As with the Unix procedure, you might see some Duplicate column name warnings as mysql processes the statements in the
       mysql_fix_privilege_tables.sql script; you can ignore them.

       After running the script, stop the server and restart it.

COPYRIGHT

       Copyright 2007-2008 MySQL AB, 2008-2010 Sun Microsystems, Inc.

       This documentation is free software; you can redistribute it and/or modify it only under the terms of the GNU General Public License as
       published by the Free Software Foundation; version 2 of the License.

       This documentation is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
       MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along with the program; if not, write to the Free Software Foundation,
       Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA or see http://www.gnu.org/licenses/.

SEE ALSO

       For more information, please refer to the MySQL Reference Manual, which may already be installed locally and which is also available online
       at http://dev.mysql.com/doc/.

AUTHOR

       Sun Microsystems, Inc. (http://www.mysql.com/).

MySQL 5.1							    04/06/2010						      MYSQL_FIX_PRIVILE(1)
All times are GMT -4. The time now is 03:58 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy