Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help - manipulate data by columns and repeated
Top Forums Shell Programming and Scripting Help - manipulate data by columns and repeated Post 302978020 by rdrtx1 on Monday 25th of July 2016 11:37:54 AM
Old 07-25-2016
Code:
infile=Dato01.txt                                            # set input file name variable
outfile=Dato02.txt                                           # set second file (repeat lines) name variable

[[ ! -f $infile.bk ]] && cp $infile $infile.bk               # backup input file

ex $infile <<EDIT                                            # invoke inline editor (ex) for input file (ex script built by awk)
$(awk '                                                      # uset awk to build commands for ex
  NR==1 {print ":" NR " w " outfile; next;}                  # write first line to second file (done by ex)
  {if (a[$1]++) r[c++]=NR}                                   # build repeat lines array
  END {
     for (i=0; i<c; i++) print ":" r[i] " w >> " outfile;    # write repeat lines to second file (done by ex)
     for (i=c-1; i>=0; i--) print ":" r[i] " d";             # delete repeat lines from input file (done by ex)
     print ":wq!";                                           # write input file (done by ex)
  }
' outfile=$outfile $infile)                                  # end of awk
EDIT                                                         # end of ex script

 

10 More Discussions You Might Find Interesting

1. Filesystems, Disks and Memory

manipulate csv file to add columns

Hi, I have a csv file with a key composed by 3 columns and some other numeric fields and I need to obtain the partial amounts by some part of the key. This may be some difficult to understand, so better see an example, where my input file is: name,surname,department,y2004,y2005,y2006... (6 Replies)
Discussion started by: oscarmon
6 Replies

2. UNIX for Dummies Questions & Answers

Excel data manipulate

All, I have the following format of data in a spreadsheet A 1 2 3 4 B 1 2 3 4 where 'A' is value of 'A1', '1 2 3 4' is value of cell B1, 'B' is value of cell A2, and '1 2 3 4' is value of cell B2. There... (12 Replies)
Discussion started by: rahulrathod
12 Replies

3. Shell Programming and Scripting

comparing the values of repeated keys in multiple columns

Hi Guyz The 1st column of the input file has repeated keys like x,y and z. The ist task is if the 1st column has unique key (say x) and then need to consider 4th column, if it is + symbol then subtract 2nd column value with 3rd column value (we will get 2(10-8)) or if it is - symbol subtract 3rd... (3 Replies)
Discussion started by: repinementer
3 Replies

4. Shell Programming and Scripting

how to manipulate with lines while playing with data

hello everyone, well I have a file which contains data, I want to add the data on hourly basis, like my file contains data for 24 hours, (so a total of 1440 ) lines. Now i want to add the data on hourly basis to get average values. like if I use (head) command it is ok for first go, but... (5 Replies)
Discussion started by: jojo123
5 Replies

5. Shell Programming and Scripting

Converted repeated rows into splitted columns

Dear Friends, I have an input file contains lot of datas, which is like repaeated rows report. The output file need to have column wise report, rather than row-wise. Input File random line 1 random line 2 random line 3 ------------------------------------- Start line 1.1 (9.9) ... (1 Reply)
Discussion started by: vasanth.vadalur
1 Replies

6. Shell Programming and Scripting

Manipulate columns using sed

Hello, I would like to remove the first column of lines beginning by a character (in my case is an open square bracket) and finishing by a space (or any other delimiter). For example: string1 string2 string3 to string2 string3 I found this previous topic: ... (1 Reply)
Discussion started by: stoyanova
1 Replies

7. UNIX for Dummies Questions & Answers

Manipulate and move columns in a file

Hello Unix Gurus, I have a request 2 perform several functions on a file, delete columns, delete rows based on column value, and finally move around columns in the final output. Consider the following input file with 12 columns; ... (1 Reply)
Discussion started by: chumsky
1 Replies

8. Shell Programming and Scripting

Transposing Repeated Rows to Columns.

I have 1000s of these rows that I would like to transpose to columns. However I would like the transpose every 3 consecutive rows to columns like below, sorted by column 3 and provide a total for each occurrences. Finally I would like a grand total of column 3. 21|FE|41|0B 50\65\78 15... (2 Replies)
Discussion started by: ravzter
2 Replies

9. Shell Programming and Scripting

Need help to manipulate data using script

Hi i want to manipulate my data to convert row to column name 600 Slno vlan 1 600 2 609 3 700 name 700 Slno vlan 1 600 2 609 3 700 (8 Replies)
Discussion started by: nith_anandan
8 Replies

10. Shell Programming and Scripting

Manipulate the columns of 2 files

Hello, I have two files to be treated. First file: col1 col2 col3 col4 Second file: colbis - I try to add the unique column of the file 2 towards the file 1. - To obtain the following result with a shell script ksh: col1 col2 col3 col4 colbis (4 Replies)
Discussion started by: khalidou13
4 Replies

LEARN ABOUT MOJAVE

make_sockdfr

MAKE_SOCKDFR(8) 					      System Manager's Manual						   MAKE_SOCKDFR(8)

NAME

       make_sockdfr -  Generates frozen route file for SOCKS server

SYNOPSIS

       make_sockdfr [infile [outfile] ]

DESCRIPTION

       make_sockdfr reads in a plain-text route file for the SOCKS server and produces a frozen route file as the output.

       Both  arguments	are optional. The default for infile is /etc/sockd.route; the default for outfile is /etc/sockd.fr. You may specify infile
       while omitting outfile, but you cannot specify outfile without also speficying infile.

       The contents of the frozen route file is essentially the memory image of the parsed input file. Using the frozen route file can reduce  the
       start-up delay of the SOCKS server program since it no longer has to parse the file contents.

       When  the  SOCKS  server starts, it always looks for the frozen route file /etc/sockd.fr first. If that file is not found, it then tries to
       use the plain-text route file /etc/sockd.route. If you use frozen route file, you must remember to run make_sockdfr every  time	after  you
       modify the plain-text file or the SOCKS server will continue to use the frozen version of a previous route file.

       To find out the contents of a frozen route file, use dump_sockdfr.

FILES

       /etc/sockd.fr, /etc/sockd.route

SEE ALSO

       dump_sockdfr(8), sockd.fr(5), sockd.route(5)

AUTHOR

       Ying-Da Lee, yingda@esd.sgi.com or yingda@best.com

								    May 6, 1996 						   MAKE_SOCKDFR(8)
All times are GMT -4. The time now is 09:35 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy