08-09-2019
So from your description, you seem to be saying that the output you want instead of the output you've shown us would be just the two lines consisting of the one containing the dates and the line that contains the RAM values 99, 99, and .25???
The first line in the image you showed us is not produced by the script you have shown us (so I am not seeing how anything that awk might do will affect that line of output) and every other line in that image has the same value in all three columns. The output described above doesn't seem to be very useful.
Note that the awk code '!a[$0]++' will discard duplicated lines within all of the files processed by a single invocation of awk. But, since you are processing each of your 276 CSV input files in a separate invocation of awk there is no way for any of those invocations of awk to compare any input values from one input file to any input values from any other input file.
This User Gave Thanks to Don Cragun For This Post:
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have following file content (3 fields each line):
23 888 10.0.0.1
dfh 787 10.0.0.2
dssf dgfas 10.0.0.3
dsgas dg 10.0.0.4
df dasa 10.0.0.5
df dag 10.0.0.5
dfd dfdas 10.0.0.5
dfd dfd 10.0.0.6
daf nfd 10.0.0.6
...
as can be seen, that the third field is ip address and sorted. but... (3 Replies)
Discussion started by: fredao
3 Replies
2. Shell Programming and Scripting
Hello,
Can anyone tell Command/Script to remove duplicate lines from the file? (2 Replies)
Discussion started by: Rahulpict
2 Replies
3. Shell Programming and Scripting
i have the long file more than one ns and www and mx in the line like .
i need the first ns record and first www and first mx from line .
the records are seperated with tthe ; i am try ing in awk scripting not getiing the solution.
... (4 Replies)
Discussion started by: kiranmosarla
4 Replies
4. Shell Programming and Scripting
Input:
hello hello
hello hello
monkey
donkey
hello hello
drink
dance
drink
Output should be:
hello hello
monkey
donkey
drink
dance (9 Replies)
Discussion started by: cola
9 Replies
5. Shell Programming and Scripting
Hi,
I came to know that using awk '!x++' removes the duplicate lines. Can anyone please explain the above syntax. I want to understand how the above awk syntax removes the duplicates.
Thanks in advance,
sudvishw :confused: (7 Replies)
Discussion started by: sudvishw
7 Replies
6. Shell Programming and Scripting
Hi, I have a huge file which is about 50GB. There are many lines. The file format likes
21 rs885550 0 9887804 C C T C C C C C C C
21 rs210498 0 9928860 0 0 C C 0 0 0 0 0 0
21 rs303304 0 9941889 A A A A A A A A A A
22 rs303304 0 9941890 0 A A A A A A A A A
The question is that there are a few... (4 Replies)
Discussion started by: zhshqzyc
4 Replies
7. Shell Programming and Scripting
Hello again, I am wanting to remove all duplicate blocks of XML code in a file. This is an example:
input:
<string-array name="threeItems">
<item>item1</item>
<item>item2</item>
<item>item3</item>
</string-array>
<string-array name="twoItems">
<item>item1</item>
<item>item2</item>... (19 Replies)
Discussion started by: raidzero
19 Replies
8. Shell Programming and Scripting
Hi,
I have a file with date in it like:
UserString1
UserString2
UserString3
UserString4
UserString5
I need two entries for each line so it reads like
UserString1
UserString1
UserString2
UserString2
etc. Can someone help me with the awk command please?
Thanks (4 Replies)
Discussion started by: Grueben
4 Replies
9. Shell Programming and Scripting
Hi,
I am on a Solaris8 machine
If someone can help me with adjusting this awk 1 liner (turning it into a real awkscript) to get by this "event not found error"
...or
Present Perl solution code that works for Perl5.8 in the csh shell ...that would be great.
******************
... (3 Replies)
Discussion started by: andy b
3 Replies
10. Shell Programming and Scripting
Hi All,
I am storing the result in the variable result_text using the below code.
result_text=$(printf "$result_text\t\n$name") The result_text is having the below text. Which is having duplicate lines.
file and time for the interval 03:30 - 03:45
file and time for the interval 03:30 - 03:45 ... (4 Replies)
Discussion started by: nalu
4 Replies
LEARN ABOUT REDHAT
amplot
AMPLOT(8) System Manager's Manual AMPLOT(8)
NAME
amplot - visualize the behavior of Amanda
SYNOPSIS
amplot [ -c ] [ -e ] [ -g ] [ -l ] [ -p ] [ -t T ] amdump_files
DESCRIPTION
Amplot reads an amdump output file that Amanda generates each run (e.g. amdump.1) and translates the information into a picture format
that may be used to determine how your installation is doing and if any parameters need to be changed. Amplot also prints out amdump lines
that it either does not understand or knows to be warning or error lines and a summary of the start, end and total time for each backup
image.
Amplot is a shell script that executes an awk program (amplot.awk) to scan the amdump output file. It then executes a gnuplot program
(amplot.g) to generate the graph. The awk program is written in an enhanced version of awk, such as GNU awk (gawk version 2.15 or later)
or nawk.
During execution, amplot generates a few temporary files that gnuplot uses. These files are deleted at the end of execution.
See the amanda(8) man page for more details about Amanda.
OPTIONS
-c Compress amdump_files after plotting.
-e Extend the X (time) axis if needed.
-g Direct gnuplot output directly to the X11 display (default).
-p Direct postscript output to file YYYYMMDD.ps (opposite of -g).
-l Generate landscape oriented output.
-t T Set the right edge of the plot to be T hours.
The amdump_files may be in various compressed formats (compress, gzip, pact, compact).
INTERPRETATION
The figure is divided into a number of regions. There are titles on the top that show important statistical information about the configu-
ration and from this execution of amdump. In the figure, the X axis is time, with 0 being the moment amdump was started. The Y axis is
divided into 5 regions:
QUEUES: How many backups have not been started, how many are waiting on space in the holding disk and how many have been transferred
successfully to tape.
%BANDWIDTH: Percentage of allowed network bandwidth in use.
HOLDING DISK: The higher line depicts space allocated on the holding disk to backups in progress and completed backups waiting to be
written to tape. The lower line depicts the fraction of the holding disk containing completed backups waiting to be written to tape
including the file currently being written to tape. The scale is percentage of the holding disk.
TAPE: Tape drive usage.
%DUMPERS: Percentage of active dumpers.
The idle period at the left of the graph is time amdump is asking the machines how much data they are going to dump. This process can take
a while if hosts are down or it takes them a long time to generate estimates.
AUTHOR
Olafur Gudmundsson ogud@tis.com
Trusted Information Systems
formerly at University of Maryland, College Park
BUGS
Reports lines it does not recognize, mainly error cases but some are legitimate lines the program needs to be taught about.
SEE ALSO
amanda(8), amdump(8), gawk(1), nawk(1), awk(1), gnuplot(1), sh(1), compress(1), gzip(1)
4th Berkeley Distribution AMPLOT(8)