Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Modify log files to get uniq data
Top Forums Shell Programming and Scripting Modify log files to get uniq data Post 302347067 by Smiling Dragon on Monday 24th of August 2009 08:21:42 PM
Old 08-24-2009
Code:
#!/bin/sh
for entry in `awk '{ print $1 }' < your.log.file | sort -u`
do
  string=""
  for result in `egrep "^$entry " your.log.file | awk '{ print $2 }'`
  do
    string="$result $string"
  done
  echo "$entry $string"
done

Exact grep syntax will depend on your version of grep available, egrep for Solaris, grep -e for most others, grep for the rest
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to replicate data using Uniq or awk

Hi, I have this scenario; where there are two classes:- apple and orange. 1,2,3,4,5,6,apple 1,1,0,4,2,3,apple 1,3,3,3,3,4,apple 1,1,1,1,1,1,orange 1,2,3,1,1,1,orange Basically for apple, i have 3 entries in the file, and for orange, I have 2 entries. Im trying to edit the file and find... (5 Replies)
Discussion started by: ahjiefreak
5 Replies

2. Shell Programming and Scripting

Help needed with Sort and uniq data

Hi All, After Sorting directories and files i have got following output as below, now i only want the strings common in them, so the actual output should be as below in the bottom. How do i do that? Thanks -adsi File to be modified:- Common Components for ----> AA... (4 Replies)
Discussion started by: asirohi
4 Replies

3. Shell Programming and Scripting

Using uniq on log files

I have this log file which I need to count the number of repeated line and do some manipulation. test.log: June 3 03:33:38 test 1 June 3 10:31:22 test 2 June 3 10:32:22 test 2 June 3 10:33:22 test 3 June 3 10:33:22 test 3 June 3 10:34:22 test 4 June 3 10:35:22 test 5 ... (4 Replies)
Discussion started by: jazzaddict
4 Replies

4. Shell Programming and Scripting

Dynamically modify data in file?

Hiya fellas, I have a data file which contains these fields... EMPID EMPNAME GENDER DESIGNATION AGE SALARY this datafile looks like this.. Now, i'm making a script which will allow me to edit anything on execution. ie. First it will ask which EMPID is to be modified. and then it... (3 Replies)
Discussion started by: rushyang
3 Replies

5. UNIX for Dummies Questions & Answers

Finding and Extracting uniq data in multiple files

Hi, I have several files that look like this: File1.txt Data1 Data2 Data20 File2.txt Data1 Data5 Data10 File3.txt Data1 Data2 Data17 File4.txt (6 Replies)
Discussion started by: Fahmida
6 Replies

6. Shell Programming and Scripting

How can I modify my script to include or substitute missing data?

Let me start off by saying I am a self taught sometimes scripter so what you will see below won't be pretty. I have created a script to parse through a file with a large amount of data and simply pull out what I need. In doing this I create several files and then paste them together in order to... (2 Replies)
Discussion started by: fsanchez
2 Replies

7. Shell Programming and Scripting

Filtering data using uniq and sed

Hello, Does anyone know an easy way to filter this type of file? I want to get everything that has score (column 2) 100.00 and get rid of duplicates (for example gi|332198263|gb|EGK18963.1| below), so I guess uniq can be used for this? gi|3379182634|gb|EGK18561.1| 100.00... (6 Replies)
Discussion started by: narachaid
6 Replies

8. UNIX for Dummies Questions & Answers

Modify Column Data using Shell Script

HI Guys, Input :- P081 wr1 12p0d5: 22.8 P081 wr1 12p2d18: 23.1 P149 wr1 1pxcud6/port_0_dev_7: 20.4 P149 wr1 1pxcud4/port_1_dev_10: 22.4 OutputP081 wr1 120 22.8 P081 wr1 122 23.1 P149 wr1 10 20.4 P149 wr1 11 22.4 In in First two line delete p and after d untill : In Last two line... (4 Replies)
Discussion started by: pareshkp
4 Replies

9. Shell Programming and Scripting

Combine data from two files base on uniq data

File 1 ID Name Po1 Po2 DD134 DD134_4A_1 NN-1 L_0_1 DD134 DD134_4B_1 NN-2 L_1_1 DD134 DD134_4C_1 NN-3 L_2_1 DD142 DD142_4A_1 NN-1 L_0_1 DD142 DD142_4B_1 NN-2 L_1_1 DD142 DD142_4C_1 NN-3 L_2_1 DD142 DD142_3A_1 NN-41 L_3_1 DD142 DD142_3A_1 NN-42 L_3_2 File 2 ( Combination of... (1 Reply)
Discussion started by: pareshkp
1 Replies

10. Shell Programming and Scripting

Need help in awk: running a loop with one column and segregate data 4 each uniq value in that field

Hi All, I have a file like this(having 2 column). Column 1: like a,b,c.... Column 2: having numbers. I want to segregate those numbers based on column 1. Example: file. a 5 b 9 b 620 a 710 b 230 a 330 b 1910 (4 Replies)
Discussion started by: Raza Ali
4 Replies

LEARN ABOUT SUSE

gtk2::pagesetup

Gtk2::PageSetup(3)					User Contributed Perl Documentation					Gtk2::PageSetup(3)

NAME

       Gtk2::PageSetup

HIERARCHY

	 Glib::Object
	 +----Gtk2::PageSetup

METHODS

   pagesetup = Gtk2::PageSetup->new
   pagesetup = Gtk2::PageSetup->new_from_file ($file_name)
       o   $file_name (localized file name)

       May croak with a Glib::Error in $@ on failure.

       Since: gtk+ 2.12

   pagesetup = Gtk2::PageSetup->new_from_key_file ($key_file, $group_name)
       o   $key_file (Glib::KeyFile)

       o   $group_name (string or undef)

       May croak with a Glib::Error in $@ on failure.

       Since: gtk+ 2.12

   double = $setup->get_bottom_margin ($unit)
       o   $unit (Gtk2::Unit)

   $setup->set_bottom_margin ($margin, $unit)
       o   $margin (double)

       o   $unit (Gtk2::Unit)

   double = $setup->get_left_margin ($unit)
       o   $unit (Gtk2::Unit)

   $setup->set_left_margin ($margin, $unit)
       o   $margin (double)

       o   $unit (Gtk2::Unit)

   $setup->load_file ($file_name)
       o   $file_name (string)

       May croak with a Glib::Error in $@ on failure.

       Since: gtk+ 2.14

   $setup->load_key_file ($key_file, $group_name)
       o   $key_file (Glib::KeyFile)

       o   $group_name (string or undef)

       May croak with a Glib::Error in $@ on failure.

       Since: gtk+ 2.14

   pageorientation = $setup->get_orientation
   $setup->set_orientation ($orientation)
       o   $orientation (Gtk2::PageOrientation)

   double = $setup->get_page_height ($unit)
       o   $unit (Gtk2::Unit)

   double = $setup->get_page_width ($unit)
       o   $unit (Gtk2::Unit)

   double = $setup->get_paper_height ($unit)
       o   $unit (Gtk2::Unit)

   $setup->set_paper_size_and_default_margins ($size)
       o   $size (Gtk2::PaperSize)

   papersize = $setup->get_paper_size
   $setup->set_paper_size ($size)
       o   $size (Gtk2::PaperSize)

   double = $setup->get_paper_width ($unit)
       o   $unit (Gtk2::Unit)

   double = $setup->get_right_margin ($unit)
       o   $unit (Gtk2::Unit)

   $setup->set_right_margin ($margin, $unit)
       o   $margin (double)

       o   $unit (Gtk2::Unit)

   $setup->to_file ($file_name)
       o   $file_name (localized file name)

       May croak with a Glib::Error in $@ on failure.

       Since: gtk+ 2.12

   $setup->to_key_file ($key_file, $group_name)
       o   $key_file (Glib::KeyFile)

       o   $group_name (string or undef)

       Since: gtk+ 2.12

   double = $setup->get_top_margin ($unit)
       o   $unit (Gtk2::Unit)

   $setup->set_top_margin ($margin, $unit)
       o   $margin (double)

       o   $unit (Gtk2::Unit)

ENUMS AND FLAGS

   enum Gtk2::PageOrientation
       o   'portrait' / 'GTK_PAGE_ORIENTATION_PORTRAIT'

       o   'landscape' / 'GTK_PAGE_ORIENTATION_LANDSCAPE'

       o   'reverse-portrait' / 'GTK_PAGE_ORIENTATION_REVERSE_PORTRAIT'

       o   'reverse-landscape' / 'GTK_PAGE_ORIENTATION_REVERSE_LANDSCAPE'

   enum Gtk2::Unit
       o   'pixel' / 'GTK_UNIT_PIXEL'

       o   'points' / 'GTK_UNIT_POINTS'

       o   'inch' / 'GTK_UNIT_INCH'

       o   'mm' / 'GTK_UNIT_MM'

SEE ALSO

       Gtk2, Glib::Object

COPYRIGHT

       Copyright (C) 2003-2008 by the gtk2-perl team.

       This software is licensed under the LGPL.  See Gtk2 for a full notice.

perl v5.12.1							    2010-07-05							Gtk2::PageSetup(3)
All times are GMT -4. The time now is 05:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy