Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help with duplicate common data content
Top Forums Shell Programming and Scripting Help with duplicate common data content Post 302697109 by elixir_sinari on Thursday 6th of September 2012 05:51:02 AM
Old 09-06-2012
Assuming lines are always this "good" (column 1 followed by at least 1 group of 2 columns):
Code:
awk '{for(i=2;i<=(NF-1);i+=2) print $1,$i,$(i+1)}' file

This User Gave Thanks to elixir_sinari For This Post:
perl_beginner
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract specific data content from a long list of data

My input: Data name: ABC001 Data length: 1000 Detail info Data Direction Start_time End_time Length 1 forward 10 100 90 1 forward 15 200 185 2 reverse 50 500 450 Data name: XFG110 Data length: 100 Detail info Data Direction Start_time End_time Length 1 forward 50 100 50 ... (11 Replies)
Discussion started by: patrick87
11 Replies

2. Shell Programming and Scripting

Help with remove duplicate content and only keep the first content detail

Input data_10 SSA data_2 TYUE data_3 PEOCV data_6 SSAT data_21 SSA data_19 TYUEC data_14 TYUE data_15 SSA data_32 PEOCV . . Desired Output data_10 SSA data_2 TYUE data_3 PEOCV data_6 SSAT data_19 TYUEC (9 Replies)
Discussion started by: patrick87
9 Replies

3. Shell Programming and Scripting

Delete duplicate data and pertain the latest month data.

Hi I have a file with following records It contains three months of data, some data is duplicated,i need to access the latest data from the duplicate ones. for e.g; i have foll data "200","0","","11722","-63","","","","11722","JUL","09" "200","0","","11722","-63","","","","11722","JUL","09"... (10 Replies)
Discussion started by: vee_789
10 Replies

4. Shell Programming and Scripting

Help with remove duplicate content

Input file data_1 10 US data_1 2 US data_1 5 UK data_2 20 ENGLAND data_2 12 KOREA data_3 4 CHINA . . data_60 123 US data_60 23 UK data_60 45 US Desired output file data_1 10 US data_1 5 UK data_2 20 ENGLAND data_2 12 KOREA (2 Replies)
Discussion started by: perl_beginner
2 Replies

5. Shell Programming and Scripting

Help with replace duplicate content

Input file: CCNI data564_input1 264 CORO1A data564_input2 155 ABC-B data17_input1 3466 ABC-B data17_input2 1133 ABC-B data17_input3 2162 ABC-B data17_input4 2019 HNRNPA2B1 data95_input1 101 HNRNPA2B1 data95_input2 340 IFITM1 data105_input2 291 IFITM2 data105_input1 505... (3 Replies)
Discussion started by: cpp_beginner
3 Replies

6. Shell Programming and Scripting

find common data

Hey guys, I have two files. file1 and file2. file1: a,1 b,2 c,343 d,343 e,4343 f,4544 file 2: a, d, e, Now i need to find the common data between these files from file1. i.e a,1 (8 Replies)
Discussion started by: jaituteja
8 Replies

7. Shell Programming and Scripting

Help with duplicate data content problem asking

Input file: A_69510335_ASD>aw 1199470 USA A_119571157_C>awe,QWEQE 113932840 USA C_34646666_qwe>TAWTT,G,TT 112736796 UK C_69510335_QW>T 1199470 USA D_70520237_WR>QEE,G 34459863 UK D_71380003_QWR>T 145418226 IK . Desired output: A_69510335_ASD>aw 1199470 USA... (1 Reply)
Discussion started by: perl_beginner
1 Replies

8. UNIX for Dummies Questions & Answers

Extract common data out of multiple files

I am trying to extract common list of Organisms from different files For example I took 3 files and showed expected result. In real I have more than 1000 files. I am aware about the useful use of awk and grep but unaware in depth so need guidance regarding it. I want to use awk/ grep/ cut/... (7 Replies)
Discussion started by: macmath
7 Replies

9. Shell Programming and Scripting

Common Issue: Table to be displayed in mail content and not as an attachment

The requirement is to send a report from an UNIX server. I have a list of data to be shown on the report, say from database. I am using sendexchange to send mail and it always send in plain text fromat and the data displayed are not aligned properly. I have seperated all the columns with fixed... (14 Replies)
Discussion started by: PikK45
14 Replies

10. Shell Programming and Scripting

Remove the duplicate content in a file

Here is the contents of test.txt Dependencies Resolved Changes in packages about to be updated: ChangeLog for: 1:perl-Archive-Extract-0.38-131.el6_4.x86_64, - Resolves: #915692 - CVE-2013-1667 (DoS in rehashing code) Dependencies Resolved Changes in packages about to be updated: ... (5 Replies)
Discussion started by: ashokvpp
5 Replies

LEARN ABOUT CENTOS

scap-workbench

scap-workbench(20)					  System Administration Utilities					scap-workbench(20)

NAME

       scap-workbench - GUI tool for systems compliance evaluation

SYNOPSIS

       scap-workbench [XCCDF_FILE]

DESCRIPTION

       scap-workbench is GUI tool for security compliance checking. Compliance can be described with SCAP standards - XCCDF and OVAL.

       This tool enables users to:
	       * evaluate local and/or remote machines using SCAP content (scanning)
	       * perform remediation on both local and remote machines (remediation)
	       * adjust XCCDF scanning profiles (tailoring)

OPTIONS

       XCCDF_FILE
	      If this parameter is provided the scanner will immediately open given XCCDF or source datastream (SDS) file after it starts.

SCAP CONTENT

       Sample content is provided by the OpenSCAP project (in the openscap-content package).

       Other sources of SCAP content are:

       National Vulnerability Database - http://web.nvd.nist.gov/view/ncp/repository

       Red Hat content repository - http://www.redhat.com/security/data/oval/

       scap-security-guide project - http://fedorahosted.org/scap-security-guide/

       sce-community-content project - http://fedorahosted.org/sce-community-content/

AUTHORS

       Martin Preisler <mpreisle@redhat.com>

NOTES

       scap-workbench uses the OpenSCAP library, see http://www.open-scap.org

SEE ALSO

       oscap(8)

Red Hat 							     Sep 2013							scap-workbench(20)
All times are GMT -4. The time now is 02:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy