Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Linux - Transpose rows into column
Top Forums Shell Programming and Scripting Linux - Transpose rows into column Post 303001065 by capitain25 on Wednesday 26th of July 2017 07:00:37 AM
Old 07-26-2017
Hello,

thank you durden_tyler for your answer, your perl script work perfectly but it’s static, and I’ld like to have a dynamic script file to use it on a cronjob (every 5min) to collect the following KPIs:
dynamic script mean that the KPI and server name and time need to be collected from the input file.

Code:
Inputfile= counter_2017072516

KPI2= Used Physical Mem MB %, (4th position data on the line)
KPI4= Total CPU Usage of tcs SERVER Component %,
KPI5= Total CPU Usage of tcs Node %,

Server1= m07tcs1
Server2= m05tcs2
Server3= m04tcs3
Server4= m07tcs4

Time=2017-07-25 16:46:04 (dynamic)

Code:
$ cat counter_2017072516
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Used Physical Mem MB,5
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Used Physical Mem %,29
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Used Heap Mem MB,9662
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Total CPU Usage of tcs SERVER Component %,0.0
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Total CPU Usage of tcs Node %,0.67

2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Used Physical Mem MB,6.4
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Used Physical Mem %,28
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Used Heap Mem MB,666
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Total CPU Usage of tcs SERVER Component %,0.0
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Total CPU Usage of tcs Node %,1.65

2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Used Physical Mem MB,8
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Used Physical Mem %,15
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Used Heap Mem MB,366
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Total CPU Usage of tcs SERVER Component %,0.0
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Total CPU Usage of tcs Node %,04

2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Used Physical Mem MB,13
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Used Physical Mem %,45.5
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Used Heap Mem MB,778
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Total CPU Usage of tcs SERVER Component %,1.0
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Total CPU Usage of tcs Node %,0.8

The output files need to be like

Code:
$ cat m07tcs1_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,29,0.0,0.67

$ cat m05tcs2_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,28,0.0,0.4

$ cat m04tcs3_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,15,1.0,04

$ cat m07tcs4_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,45.5,1.0,0.8

Thanks again for your replies
Last edited by capitain25; 07-26-2017 at 08:07 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Transpose Rows

Hi, Am trying to transpose a set of rows into a set of comma separated values. For eg. if the output of ps -ef | tail +2 | awk 'BEGIN{ FS=" " } { print $2 }' is 0 1 3 4 I need to transpose it to - '0','1','3','4' Am currently trying - (4 Replies)
Discussion started by: iamwha1am
4 Replies

2. Shell Programming and Scripting

transpose rows to columns

Any tips on how I can awk the input data to display the desired output per below? Thanking you in advance. input test data: 2 2010-02-16 10:00:00 111111111111 bytes 99999999999 bytes 90% 4 2010-02-16 12:00:00 333333333333 bytes 77777777777 bytes 88% 5 2010-02-16 11:00:00... (4 Replies)
Discussion started by: ux4me
4 Replies

3. Shell Programming and Scripting

awk transpose rows to column

Need to transpose in awk rows to column like this: input: A1,6,5,4 3,2,1, A2,8,7,9,10,11,12,13,14 A3,1,2,3,5,7,8,9 A4,9,4,8,1,5,3, output: A1,1 A1,2 A1,4 ... A2,7 A2,8 ... A3,1 A3,2 ... A4,1 A4,3 (5 Replies)
Discussion started by: sdf
5 Replies

4. Shell Programming and Scripting

Transpose Datefield from rows to column + Print time diff

Hi Experts, Can you please help me in transposing Datefield from rows to column and calculate the time difference for each of the Jobids: Input File: 08/23/2012 12:36:09,JOB_5340 08/23/2012 12:36:14,JOB_5340 08/23/2012 12:36:22,JOB_5350 08/23/2012 12:36:26,JOB_5350 Required Output:... (6 Replies)
Discussion started by: asnandhakumar
6 Replies

5. Shell Programming and Scripting

awk to transpose preceding row to 1st column of next rows

Gurus: How can I transpose the output below to a format in which I can plot a graph to show VSZ memory usage by PIDs? stdout: Tue Jan 22 07:29:19 CUT 2013 42336296 1841272 java wilyadm 21889232 438616 jlaunch sidadm 42532994 414336 jlaunch sidadm Tue Jan 22 07:49:20 CUT 2013... (1 Reply)
Discussion started by: ux4me
1 Replies

6. Shell Programming and Scripting

Transpose Column of Data to Rows

I can no longer find my commands, but I use to be able to transpose data with common fields from a single column to rows using a command line. My data is separated as follows: NAME=BOB ADDRESS=COLORADO PET=CAT NAME=SUSAN ADDRESS=TEXAS PET=BIRD NAME=TOM ADDRESS=UTAH PET=DOG I would... (7 Replies)
Discussion started by: docdave78
7 Replies

7. Shell Programming and Scripting

Transpose multiple rows (with a mix of space and enter) to a single column

How to change the uploaded weekly file data to the following format? New Well_Id,Old Well_Id,District,Thana,Date,Data,R.L,WellType,Lati.,Longi. BAG001,PT006,BARGUNA,AMTALI,1/2/1978,1.81,2.29,Piezometer,220825,901430 BAG001,PT006,BARGUNA,AMTALI,1/9/1978,1.87,2.29,Piezometer,220825,901430... (3 Replies)
Discussion started by: sara.nowreen
3 Replies

8. Shell Programming and Scripting

Peel syntax for transpose rows into column

Dear all, Plz let me know syntax for transposing rows into column in perl, I am having 30 csv files which are merged into a single xls sheet. but i want to transpose each row into column in excel sheet in each tab (1 CSV = 1tab in xls sheet) example is as below ... (0 Replies)
Discussion started by: sagar_1986
0 Replies

9. Programming

To transpose rows to column in hadoop

Hi, i am having an HDFS file which is comma seperated, i need to transpose from rows to column only the header columns text.csv cnt,name,place 1,hi,nz 2,hello,aus I need cnt, name, place while using below command in hadoop getting the error hadoop fs -fmt -1 text.csv (0 Replies)
Discussion started by: rohit_shinez
0 Replies

10. UNIX for Beginners Questions & Answers

How to transpose pieces of data in a column to multiple rows?

Hello Everyone, I am very new to the world of regular expressions. I am trying to use grep/sed for the following: Input file is something like this and there are multiple such files: abc 1 2 3 4 5 ***END*** abc 6 7 8 9 ***END*** abc 10 (2 Replies)
Discussion started by: shellnewuser
2 Replies

LEARN ABOUT DEBIAN

bup-margin

bup-margin(1)						      General Commands Manual						     bup-margin(1)

NAME

       bup-margin - figure out your deduplication safety margin

SYNOPSIS

       bup margin [options...]

DESCRIPTION

       bup margin  iterates  through  all  objects  in	your  bup repository, calculating the largest number of prefix bits shared between any two
       entries.  This number, n, identifies the longest subset of SHA-1 you could use and still encounter a collision between your object ids.

       For example, one system that was tested had a collection of 11 million objects (70 GB), and bup margin returned 45.  That  means  a  46-bit
       hash  would be sufficient to avoid all collisions among that set of objects; each object in that repository could be uniquely identified by
       its first 46 bits.

       The number of bits needed seems to increase by about 1 or 2 for every doubling of the number of objects.  Since SHA-1 hashes have 160 bits,
       that  leaves 115 bits of margin.  Of course, because SHA-1 hashes are essentially random, it's theoretically possible to use many more bits
       with far fewer objects.

       If you're paranoid about the possibility of SHA-1 collisions, you can monitor your repository by running bup margin occasionally to see	if
       you're getting dangerously close to 160 bits.

OPTIONS

       --predict
	      Guess  the offset into each index file where a particular object will appear, and report the maximum deviation of the correct answer
	      from the guess.  This is potentially useful for tuning an interpolation search algorithm.

       --ignore-midx
	      don't use .midx files, use only .idx files.  This is only really useful when used with --predict.

EXAMPLE

	      $ bup margin
	      Reading indexes: 100.00% (1612581/1612581), done.
	      40
	      40 matching prefix bits
	      1.94 bits per doubling
	      120 bits (61.86 doublings) remaining
	      4.19338e+18 times larger is possible

	      Everyone on earth could have 625878182 data sets
	      like yours, all in one repository, and we would
	      expect 1 object collision.

	      $ bup margin --predict
	      PackIdxList: using 1 index.
	      Reading indexes: 100.00% (1612581/1612581), done.
	      915 of 1612581 (0.057%)

SEE ALSO

       bup-midx(1), bup-save(1)

BUP

       Part of the bup(1) suite.

AUTHORS

       Avery Pennarun <apenwarr@gmail.com>.

Bup unknown-															     bup-margin(1)
All times are GMT -4. The time now is 02:04 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy