Sponsored Content
Top Forums Shell Programming and Scripting Linux - Transpose rows into column Post 303001065 by capitain25 on Wednesday 26th of July 2017 07:00:37 AM
Old 07-26-2017
Hello,

thank you durden_tyler for your answer, your perl script work perfectly but it’s static, and I’ld like to have a dynamic script file to use it on a cronjob (every 5min) to collect the following KPIs:
dynamic script mean that the KPI and server name and time need to be collected from the input file.

Code:
Inputfile= counter_2017072516

KPI2= Used Physical Mem MB %, (4th position data on the line)
KPI4= Total CPU Usage of tcs SERVER Component %,
KPI5= Total CPU Usage of tcs Node %,

Server1= m07tcs1
Server2= m05tcs2
Server3= m04tcs3
Server4= m07tcs4

Time=2017-07-25 16:46:04 (dynamic)

Code:
$ cat counter_2017072516
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Used Physical Mem MB,5
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Used Physical Mem %,29
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Used Heap Mem MB,9662
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Total CPU Usage of tcs SERVER Component %,0.0
2017-07-25 16:46:04,m07tcs1,SERVER@m07tcs1,Total CPU Usage of tcs Node %,0.67

2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Used Physical Mem MB,6.4
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Used Physical Mem %,28
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Used Heap Mem MB,666
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Total CPU Usage of tcs SERVER Component %,0.0
2017-07-25 16:46:04,m05tcs2,SERVER@m05tcs2,Total CPU Usage of tcs Node %,1.65

2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Used Physical Mem MB,8
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Used Physical Mem %,15
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Used Heap Mem MB,366
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Total CPU Usage of tcs SERVER Component %,0.0
2017-07-25 16:46:04,m04tcs3,SERVER@m04tcs3,Total CPU Usage of tcs Node %,04

2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Used Physical Mem MB,13
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Used Physical Mem %,45.5
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Used Heap Mem MB,778
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Total CPU Usage of tcs SERVER Component %,1.0
2017-07-25 16:46:04,m07tcs4,SERVER@m07tcs4,Total CPU Usage of tcs Node %,0.8

The output files need to be like

Code:
$ cat m07tcs1_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,29,0.0,0.67

$ cat m05tcs2_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,28,0.0,0.4

$ cat m04tcs3_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,15,1.0,04

$ cat m07tcs4_2017072516.csv
Time, Used Physical Mem %, Total CPU Usage of tcs SERVER Component %, Total CPU Usage of tcs Node %
2017-07-25 16:46:04,45.5,1.0,0.8

Thanks again for your replies

Last edited by capitain25; 07-26-2017 at 08:07 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Transpose Rows

Hi, Am trying to transpose a set of rows into a set of comma separated values. For eg. if the output of ps -ef | tail +2 | awk 'BEGIN{ FS=" " } { print $2 }' is 0 1 3 4 I need to transpose it to - '0','1','3','4' Am currently trying - (4 Replies)
Discussion started by: iamwha1am
4 Replies

2. Shell Programming and Scripting

transpose rows to columns

Any tips on how I can awk the input data to display the desired output per below? Thanking you in advance. input test data: 2 2010-02-16 10:00:00 111111111111 bytes 99999999999 bytes 90% 4 2010-02-16 12:00:00 333333333333 bytes 77777777777 bytes 88% 5 2010-02-16 11:00:00... (4 Replies)
Discussion started by: ux4me
4 Replies

3. Shell Programming and Scripting

awk transpose rows to column

Need to transpose in awk rows to column like this: input: A1,6,5,4 3,2,1, A2,8,7,9,10,11,12,13,14 A3,1,2,3,5,7,8,9 A4,9,4,8,1,5,3, output: A1,1 A1,2 A1,4 ... A2,7 A2,8 ... A3,1 A3,2 ... A4,1 A4,3 (5 Replies)
Discussion started by: sdf
5 Replies

4. Shell Programming and Scripting

Transpose Datefield from rows to column + Print time diff

Hi Experts, Can you please help me in transposing Datefield from rows to column and calculate the time difference for each of the Jobids: Input File: 08/23/2012 12:36:09,JOB_5340 08/23/2012 12:36:14,JOB_5340 08/23/2012 12:36:22,JOB_5350 08/23/2012 12:36:26,JOB_5350 Required Output:... (6 Replies)
Discussion started by: asnandhakumar
6 Replies

5. Shell Programming and Scripting

awk to transpose preceding row to 1st column of next rows

Gurus: How can I transpose the output below to a format in which I can plot a graph to show VSZ memory usage by PIDs? stdout: Tue Jan 22 07:29:19 CUT 2013 42336296 1841272 java wilyadm 21889232 438616 jlaunch sidadm 42532994 414336 jlaunch sidadm Tue Jan 22 07:49:20 CUT 2013... (1 Reply)
Discussion started by: ux4me
1 Replies

6. Shell Programming and Scripting

Transpose Column of Data to Rows

I can no longer find my commands, but I use to be able to transpose data with common fields from a single column to rows using a command line. My data is separated as follows: NAME=BOB ADDRESS=COLORADO PET=CAT NAME=SUSAN ADDRESS=TEXAS PET=BIRD NAME=TOM ADDRESS=UTAH PET=DOG I would... (7 Replies)
Discussion started by: docdave78
7 Replies

7. Shell Programming and Scripting

Transpose multiple rows (with a mix of space and enter) to a single column

How to change the uploaded weekly file data to the following format? New Well_Id,Old Well_Id,District,Thana,Date,Data,R.L,WellType,Lati.,Longi. BAG001,PT006,BARGUNA,AMTALI,1/2/1978,1.81,2.29,Piezometer,220825,901430 BAG001,PT006,BARGUNA,AMTALI,1/9/1978,1.87,2.29,Piezometer,220825,901430... (3 Replies)
Discussion started by: sara.nowreen
3 Replies

8. Shell Programming and Scripting

Peel syntax for transpose rows into column

Dear all, Plz let me know syntax for transposing rows into column in perl, I am having 30 csv files which are merged into a single xls sheet. but i want to transpose each row into column in excel sheet in each tab (1 CSV = 1tab in xls sheet) example is as below ... (0 Replies)
Discussion started by: sagar_1986
0 Replies

9. Programming

To transpose rows to column in hadoop

Hi, i am having an HDFS file which is comma seperated, i need to transpose from rows to column only the header columns text.csv cnt,name,place 1,hi,nz 2,hello,aus I need cnt, name, place while using below command in hadoop getting the error hadoop fs -fmt -1 text.csv (0 Replies)
Discussion started by: rohit_shinez
0 Replies

10. UNIX for Beginners Questions & Answers

How to transpose pieces of data in a column to multiple rows?

Hello Everyone, I am very new to the world of regular expressions. I am trying to use grep/sed for the following: Input file is something like this and there are multiple such files: abc 1 2 3 4 5 ***END*** abc 6 7 8 9 ***END*** abc 10 (2 Replies)
Discussion started by: shellnewuser
2 Replies
TCS(1)							      General Commands Manual							    TCS(1)

NAME
tcs - translate character sets SYNOPSIS
tcs [ -slcv ] [ -f ics ] [ -t ocs ] [ file ... ] DESCRIPTION
Tcs interprets the named file(s) (standard input default) as a stream of characters from the ics character set or format, converts them to runes, and then converts them into a stream of characters from the ocs character set or format on the standard output. The default value for ics and ocs is utf, the UTF encoding described in utf(6). The -l option lists the character sets known to tcs. Processing continues in the face of conversion errors (the -s option prevents reporting of these errors). The -c option forces the output to contain only cor- rectly converted characters; otherwise, 0x80 characters will be substituted for UTF encoding errors and 0xFFFD characters will substituted for unknown characters. The -v option generates various diagnostic and summary information on standard error, or makes the -l output more verbose. Tcs recognizes an ever changing list of character sets. In particular, it supports a variety of Russian and Japanese encodings. Some of the supported encodings are utf The Plan 9 UTF encoding, known by ISO as UTF-8 utf1 The deprecated original UTF encoding from ISO 10646 ascii 7-bit ASCII 8859-1 Latin-1 (Central European) 8859-2 Latin-2 (Czech .. Slovak) 8859-3 Latin-3 (Dutch .. Turkish) 8859-4 Latin-4 (Scandinavian) 8859-5 Part 5 (Cyrillic) 8859-6 Part 6 (Arabic) 8859-7 Part 7 (Greek) 8859-8 Part 8 (Hebrew) 8859-9 Latin-5 (Finnish .. Portuguese) koi8 KOI-8 (GOST 19769-74) jis-kanji ISO 2022-JP ujis EUC-JX: JIS 0208 ms-kanji Microsoft, or Shift-JIS jis (from only) guesses between ISO 2022-JP, EUC or Shift-Jis gb Chinese national standard (GB2312-80) big5 Big 5 (HKU version) unicode Unicode Standard 1.0 tis Thai character set plus ASCII (TIS 620-1986) msdos IBM PC: CP 437 atari Atari-ST character set EXAMPLES
tcs -f 8859-1 Convert 8859-1 (Latin-1) characters into UTF format. tcs -s -f jis Convert characters encoded in one of several shift JIS encodings into UTF format. Unknown Kanji will be converted into 0xFFFD char- acters. tcs -lv Print an up to date list of the supported character sets. SOURCE
/sys/src/cmd/tcs SEE ALSO
ascii(1), rune(2), utf(6). TCS(1)
All times are GMT -4. The time now is 02:33 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy