Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Parsing file: preparing data for charts (gnuplot, calc,...)
Top Forums Shell Programming and Scripting Parsing file: preparing data for charts (gnuplot, calc,...) Post 302575653 by gray380 on Tuesday 22nd of November 2011 10:11:55 AM
Old 11-22-2011
Parsing file: preparing data for charts (gnuplot, calc,...)
Hi there,

I have files (tsv) like this:
Code:
CTLPort	IO Rate(IOPS)	Read Hit(%)	Write Hit(%)	Timestamp
0A	136	97	100	 09:36:48
0B	3	100	100	 09:36:48
0C	88	35	100	 09:36:48
0A	87	100	100	 09:37:49
0B	3	97	100	 09:37:49
0C	83	45	100	 09:37:49
0A	108	83	100	 09:38:48
0B	3	100	100	 09:38:48
0C	190	49	100	 09:38:48

I can transform it to the following view:
Code:
CTLPort	IO Rate(IOPS)	Read Hit(%)	Write Hit(%)	Timestamp
0A	136	97	100	 09:36:48
0A	87	100	100	 09:37:49
0A	108	83	100	 09:38:48
0B	3	100	100	 09:36:48
0B	3	97	100	 09:37:49
0B	3	100	100	 09:38:48
0C	88	35	100	 09:36:48
0C	83	45	100	 09:37:49
0C	190	49	100	 09:38:48

with next commands:
Code:
head -1 sample2 > sample4
awk 'BEGIN {FS="\t"; OFS="\t"} NR==1 {next} 1' sample2 |sort -k 1,1 -k 5 >> sample4

but I need for all fields except $1 & $NF something like this:
Code:
Timestamp	0A	0B	0C	0D
09:36	97	100	35	44
09:37	100	97	45	39
09:38	83	100	49	45

Any ideas?

PS number of ""timestamps" is known (fixed) value.
PPS preferred method is awk
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parsing the data in a file

Hi, I have file (FILE.tmp) having contents, FILE.tmp ======== filename=menudata records=0000000000037 ldbname=pinsys timestamp=2005/05/14-18:32:33 I want to parse it bring a new file which will look like, filename records ldbname timestamp... (2 Replies)
Discussion started by: Omkumar
2 Replies

2. Shell Programming and Scripting

parsing data and incorporating it into another file

Hi All I have two files: file 1 >AB_1 MLKKPIIIGVTGGSGGGKTSVSRAILDSFPNARIAMIQHDSYYKDQSHMSFEERVKTNYDHPLAFDTDFM IQQLKELLAGRPVDIPIYDYKKHTRSNTTFRQDPQDVIIVEGILVLEDERLRDLMDIKLFVDTDDDIRII RRIKRDMMERGRSLESIIDQYTSVVKPMYHQFIEPSKRYADIVIPEGVSNVVAIDVINSKIASILGEV >AB_2... (5 Replies)
Discussion started by: Lucky Ali
5 Replies

3. Shell Programming and Scripting

parsing data and incorporating it into another file

Hi, I have a folder that contains many (multiple) files 1.fasta 2.fasta 3.fasta 4.fasta 5.fasta . . 100's of files Each such file have data in the following format for example: vi 1.fasta >AB_1 gi|15835212|ref|NP_296971.1| preprotein translocase subunit SecE... (3 Replies)
Discussion started by: Lucky Ali
3 Replies

4. Shell Programming and Scripting

placeholder in gnuplot data

My input data has occasional holes in it, spots where a sensor couldn't be read. These are ERR in the data file instead of a floating point number. What should I change them to, for gnuplot to ignore these values instead of whining about them? (1 Reply)
Discussion started by: Corona688
1 Replies

5. Shell Programming and Scripting

Parsing txt, xml files and preparing csv file

Hi, I need to parse text, xml files to get the statistic numbers and prepare summary csv file. What is the best way to parse these file and prepare csv file. Any idea you have , please? Regards, (2 Replies)
Discussion started by: LinuxLearner
2 Replies

6. Shell Programming and Scripting

Parsing data using keys from one file

I have 2 text files where I need to parse data from file 2 using the data from file 1. Below are my sample files File 1 (tab delimited) 257 350 670 845 725 1025 767 820 ... .... .... file 2 (tab delimited) 220..450 TA AB650 ABCED 520..850 GA AB720 ABCDE 700..1100 TC AB820 ABCDE... (2 Replies)
Discussion started by: Lucky Ali
2 Replies

7. Shell Programming and Scripting

Parsing file data

Hey Guys, I'm a novice at shell scripts and i need some help parsing file data. Basically, I want to write a script that retrieves URLs. Here is what I have so far. #!/bin/bash echo "Please enter start date (format: yyyy-mm-dd):\c" read STARTDATE echo "Please enter end date... (7 Replies)
Discussion started by: silverdust
7 Replies

8. Shell Programming and Scripting

Gnuplot Time Data Question

I have a data file of the following format: servername,2013-05-11 17:46:03,SomeText,195,195,11,202 servername,2013-05-11 17:47:03,SomeText,192,192,23,103 servername,2013-05-11 17:48:03,SomeText,189,190,14,117 servername,2013-05-11 17:49:03,SomeText,196,195,24,231 ... ... I want to... (0 Replies)
Discussion started by: BeeryM
0 Replies

9. UNIX and Linux Applications

Gnuplot Same Data Two Axes Different Units)

I'm pretty familiar with Gnuplot, but I've never actually come across a reasonable solution to this problem and I'm hoping someone can help me out! I think it's because I don't know how to pose the problem neatly, so please bare with me. Also new to the forum....so yeah... I have one data set (x... (3 Replies)
Discussion started by: TC69
3 Replies

LEARN ABOUT NETBSD

xi

XI(4)							   BSD Kernel Interfaces Manual 						     XI(4)

NAME

     xi -- Xircom CreditCard Ethernet device driver

SYNOPSIS

     xi* at xirc?

     Configuration of PHYs may also be necessary.  See mii(4).

DESCRIPTION

     The xi driver provides support for the Xircom CreditCard family of PCMCIA Ethernet adapters.  Supported cards include:

	   Xircom CreditCard Ethernet II
	   Xircom CreditCard 10/100 Ethernet
	   Xircom RealPort 10/100 Ethernet + Modem (Ethernet function only)
	   Intel EtherExpress Pro/100
	   Compaq Netelligent 10/100

     Cards which should work, but have not been confirmed include:

	   Xircom RealPort Ethernet
	   Xircom RealPort 10/100 Ethernet

     Some Xircom Ethernet products are supported by the tlp(4) driver.

MEDIA SELECTION

     Media selection is done using ifconfig(8) using the standard ifmedia(4) mechanism.  Refer to those manual pages for more information.

SEE ALSO

     ifmedia(4), mii(4), netintro(4), pcmcia(4), tlp(4), xirc(4), ifconfig(8)

HISTORY

     The xi device driver appeared in NetBSD 1.5.

BUGS

     The driver suffers from poor performance.	Even with the 10/100 cards, do not expect more than ~450KB/s.  Some 10/100 cards may not autonego-
     tiate reliably and require manual media selection.

     The Xircom multifunction cards which contain both Ethernet and modem interfaces are known to have problems.  This is due to the card not
     reporting itself correctly as a multifunction card.

BSD
								   June 1, 2007 							       BSD
All times are GMT -4. The time now is 08:11 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy