And we have tousands of DRs which are produced everyday and every day we use previous day's records for reporting purpose. Daily we have many files generated like the following and each of them have hundreds of rows like the format above:
Code:
-rw-r--r-- 1 sscm sscm 8556408 Mar 15 00:29 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_00.1.gz
-rw-r--r-- 1 sscm sscm 8503748 Mar 15 00:49 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_00.2.gz
-rw-r--r-- 1 sscm sscm 3883294 Mar 15 01:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_00.3.gz
-rw-r--r-- 1 sscm sscm 8808936 Mar 15 01:28 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_01.0.gz
-rw-r--r-- 1 sscm sscm 6367825 Mar 15 02:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_01.1.gz
-rw-r--r-- 1 sscm sscm 8169001 Mar 15 03:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_02.0.gz
-rw-r--r-- 1 sscm sscm 5149508 Mar 15 04:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_03.0.gz
-rw-r--r-- 1 sscm sscm 2770578 Mar 15 05:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_04.0.gz
-rw-r--r-- 1 sscm sscm 6679069 Mar 15 05:57 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_05.0.gz
.
.
.
-rw-r--r-- 1 sscm sscm 7077509 Mar 15 22:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_21.3.gz
-rw-r--r-- 1 sscm sscm 8943708 Mar 15 22:16 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_22.0.gz
-rw-r--r-- 1 sscm sscm 8620239 Mar 15 22:33 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_22.1.gz
-rw-r--r-- 1 sscm sscm 8936831 Mar 15 22:51 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_22.2.gz
-rw-r--r-- 1 sscm sscm 4066354 Mar 15 23:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_22.3.gz
-rw-r--r-- 1 sscm sscm 8818361 Mar 15 23:17 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_23.0.gz
-rw-r--r-- 1 sscm sscm 8592770 Mar 15 23:34 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_23.1.gz
-rw-r--r-- 1 sscm sscm 8749865 Mar 15 23:51 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_23.2.gz
-rw-r--r-- 1 sscm sscm 4520274 Mar 16 00:00 log.SSCM-ESB1.sscm_esb.14622.2016-03-15_23.3.gz
We use some special fields to filter and create our reports. I use the following code but it does not give me what actually I want:
Hi,
I have two variables - A and B - containing a bunch of file paths. I am comparing them and when I find a match I want to remove that entry from A so that as the compare proceeds A shrinks entry by entry.
How can I remove a matched entry from A whilst leaving the non matched entries... (6 Replies)
i have a input file which does not have a delimiter
All i Need to do is to identify a line and extract the data from it and run the loop again and need to ensure that it was not extracted earlier
Input file
------------
abcd 12345 egfhijk ip 192.168.0.1 CNN.com
abcd 12345 egfhijk ip... (12 Replies)
Hi.
I am reasonably new to awk, but have done quite a lot of unix scripting in the past. I have resolved the issues below with unix scripting but it runs like a dog. Moved to awk for speed and functionality but running up a big learning curve in a hurry, so hope there is some help here.
I... (6 Replies)
Hi. I haven't had to write bash scripts in a long time and have a simple task to do, but need some help:
Input:
chrY:22627291-22651542
chrY:23045932-23070172
chrY:23684890-23696359
chrY:25318610-25330083
chrY:25451096-25462570
chr10:1054847-1061799
chr10:1058606-1080131... (7 Replies)
Hi guys
Firstly, I'd like to say hi and how great this forum is. I'm not new to UNIX but am relatively new to scripting. I have a personal project that I'm working on just to try and speed up my learning.
I working with a text file, well more of a logfile really. It has several columns of... (6 Replies)
hi
i have a file of the following format
FILE1
5 937 8
1860 1850 1
683 2 1
129 2 2
5 938 8
1122 1123 1
20 520 4
1860 1851 1
5 939 8
1122 1124 1
20 521 4i have another file which... (3 Replies)
Hi guys, I need to do a bit of work to a file.
Basically I want to run a SQL statement against each record in this file (hundreds of lines):
sample input:
233333
233334
233335
233336
I want to do the following:
1. Add a some text at the beginning to prepare the SQL (3 lines)
2. Add... (7 Replies)
Hi everyone,
I have a little bit of complicated task to finish with AWK. Here it is;
I have a data file in xml format which looks like this
<data>
a1 a2 a3 a4 a5
b1 b2 b3 b4 b5
c1 c2 c3 c4 c5
d1 d2 d3 d4 d5
e1 e2 e3 e4 e5
</data>
lets say each data block contains 5 rows and 5 columns,... (13 Replies)
Hi,
My file is seperated with ";" delimiter, after 13 delimiter i want to put the data in new line...
eg:
My current file:-
a;b;c;d;e;f;g;h;e;f;h;s;t;a;i;o;q;t;q;r;yu;f;sz;f;t;r...........
i want o/p as:-
a;b;c;d;e;f;g;h;e;f;h;s;t
a;i;o;q;t;q;r;yu;f;sz;f;t;r
How to achieve ths,... (2 Replies)
Dear friends,
I'm struggling to preparing a bunch of gromacs input files, say manually. It's really a time-consuming work without any techniques. I suppose that it could be done by a smart script automatically. But I lack some basic knowledge on scripting. Please help!
My original input looks... (3 Replies)