awk solution to duplicate lines based on column

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk to select lines with maximum value of each record based on column value

Hello, I want to get the maximum value of each record separated by empty line based on the 3rd column of each row within each record? Input: A1 chr5D 634 7 82 707 A2 chr5D 637 6 82 713 A3 chr5D 637 5 82 713 A4 chr5D 626 1 82 704...

2. Shell Programming and Scripting

Solution for replacement of 4th column with 3rd column in a file using awk/sed preserving delimters

input "A","B","C,D","E","F" "S","T","U,V","W","X" "AA","BB","CC,DD","EEEE","FFF" required output: "A","B","C,D","C,D","F" "S", T","U,V","U,V","X" "AA","BB","CC,DD","CC,DD","FFF" tried using awk but double quotes not preserving for every field. any help to solve this is much...

3. Shell Programming and Scripting

Removing duplicate lines on first column based with pipe delimiter

Hi, I have tried to remove dublicate lines based on first column with pipe delimiter . but i ma not able to get some uniqu lines Command : sort -t'|' -nuk1 file.txt Input : 38376KZ|09/25/15|1.057 38376KZ|09/25/15|1.057 02006YB|09/25/15|0.859 12593PS|09/25/15|2.803...

4. Shell Programming and Scripting

Remove duplicate rows based on one column

Dear members, I need to filter a file based on the 8th column (that is id), and does not mather the other columns, because I want just one id (1 line of each id) and remove the duplicates lines based on this id (8th column), and does not matter wich duplicate will be removed. example of my file...

5. Shell Programming and Scripting

awk to sum a column based on duplicate strings in another column and show split totals

Hi, I have a similar input format- A_1 2 B_0 4 A_1 1 B_2 5 A_4 1 and looking to print in this output format with headers. can you suggest in awk?awk because i am doing some pattern matching from parent file to print column 1 of my input using awk already.Thanks! letter number_of_letters...

6. UNIX for Dummies Questions & Answers

awk to sum column field from duplicate row/lines

Hello, I am new to Linux environment , I working on Linux script which should send auto email based on the specific condition from log file. Below is the sample log file Name m/c usage abc xxx 10 abc xxx 20 abc xxx 5 xyz ...

7. Shell Programming and Scripting

Perl: filtering lines based on duplicate values in a column

Hi I have a file like this. I need to eliminate lines with first column having the same value 10 times. 13 18 1 + chromosome 1, 122638287 AGAGTATGGTCGCGGTTG 13 18 1 + chromosome 1, 128904080 AGAGTATGGTCGCGGTTG 13 18 1 - chromosome 14, 13627938 CAACCGCGACCATACTCT 13 18 1 + chromosome 1,...

8. Shell Programming and Scripting

awk print non matching lines based on column

My item was not answered on previous thread as code given did not work I wanted to print records from file2 where comparing column 1 and 16 for both files find rows where column 16 in file 1 does not match column 16 in file 2 Here was CODE give to issue ~/unix.com$ cat f1...

9. Shell Programming and Scripting

AWK Duplicate lines multiple times based on a calculated value

Hi, I'm trying to create an XML sitemap of our dynamic ecommerce sites SEO Friendly URLs and am trying to create the initial page listing. I have a CSV file that looks like the following and need duplicate the lines based on a value which needs calculating. ...

10. Shell Programming and Scripting

duplicate row based on single column

I am a newbie to shell scripting .. I have a .csv file. It has 1000 some rows and about 7 columns... but before I insert this data to a table I have to parse it and clean it ..basing on the value of the first column..which a string of phone number type... example below.. column 1 ...

LEARN ABOUT HPUX

expand

expand(1)						      General Commands Manual							 expand(1)

NAME

       expand, unexpand - expand tabs to spaces, and vice versa

SYNOPSIS

       tablist] [file ...]

       tablist] [file ...]

   Obsolescent:
       tabstop] tabn] [file ...]

DESCRIPTION

       processes  the named files or the standard input and writes to the standard output with tabs changed into spaces.  Backspace characters are
       preserved in the output, and the column count is decreased by one column for tab calculations.  For proper tab calculation, if a multi-col-
       umn  character  is  to be "backspace'd", it should be followed by multiple backspace characters which equal to it's column width.  If a tab
       character is found after the last tab position, it is replaced by a single space.  is useful for preprocessing character files that contain
       tabs (before sorting, looking at specific columns, etc).

       recognizes the following command-line options and arguments:

	      tablist	     specifies	where  to set the tab positions instead of the default tablist can take two forms.  If it is a single num-
			     ber, tabs are set tablist spaces apart.  tablist can also be a blank- or comma-separated list of increasing positions
			     where tabs are to be set.

	      This option is obsolescent and is equivalent to using

	      This option is obsolescent and is equivalent to using

       processes  the  named  files  or  the  standard	input  and writes to the standard output with spaces changed into tabs where possible.	By
       default, only leading spaces and tabs are converted to maximal strings of tabs.	The default tab position is every 8 characters.  Backspace
       characters  are	preserved  into the output, and the column count is decreased by one column for tab calculations.  For proper tab calcula-
       tion, if a multi-column character is to be "backspace'd", it should be followed by multiple backspace characters which equal to it's column
       width.

       recognizes the following command-line options and arguments:

	      Tabs are inserted whenever they would compress the resultant file
			     by replacing two or more spaces before a tab position.

	      tablist	     specifies	the tab positions.  tablist can take two forms.  If it is a single number, tabs are set every tablist spa-
			     ces apart.  If tablist is a blank- or comma-separated list of increasing positions, tabs are set at those	locations.
			     The  option  implies the option.  If the option is not specified, the default is equivalent to specifying except that
			     is not implied for this case.

EXTERNAL INFLUENCES

   Environment Variables
       determines the interpretation of text as single and/or multi-byte characters.

       determines the language in which messages are displayed.

       If or is not specified in the environment or is set to the empty string, the value of is used as a default for each  unspecified  or  empty
       variable.  If is not specified or is set to the empty string, a default of "C" (see lang(5)) is used instead of

       If  any internationalization variable contains an invalid setting, and behave as if all internationalization variables are set to "C".  See
       environ(5).

       If is set to a non-empty string value, it overrides the values of all the other internationalization variables.

   International Code Set Support
       Single- and multi-byte character code sets are supported with the exception that do not recognize multi-byte alternative space characters.

STANDARDS CONFORMANCE

																	 expand(1)

UNIX for Dummies Questions & Answers