|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Help me pls : splitting single file in unix into different files based on data
Post 302715277 by Ravindra Swan on Sunday 14th of October 2012 10:23:07 AM
10-14-2012
Clarification
The relation ship b/w middle lines can be achieved by +/-5000 logic.
I am explaining this for u in a simpler way. Assume evry thing i am mentioning below just suppose the numbers but the logic is the same we need to implement.
for suppose:
i/p1 file has O/P numer 1000
join2 has I/P number 5555 , O/P number 1111
reformat3 has I/P number 6666 , O/P number 2222
output has I/P number 7777
1.) Now we need to go like this comming frm i/p1 take 1000
2.) add 5000 which gives 6000
3.) now go to XXGFlow file search for line 6000
4.) So, from the XXGFlow file we will take 10555
5.) Substract 5000, 10555-5000=5555
6.) Go back to files search for 5555 , you will get it in join2 I/P number
7.) search in the same file (join2) for O/P number , u will get 1111
8.) add 5000 , 1111+5000 = 6111
9.) search in XXGFlow for 6111 and u got 11666
10.) substract 5000 , 11666-5000= 6666
11.) search for 6666 in our files u will get in reformat3
12.) now search for O/P number in reformat3, u will get 2222
13.) add 5000, 7222 . Search in XXGFlow , u got 12777.
14.) sub 5000 , u got 7777, search for 7777 in our files , it is Output_File
15.) job done.
Now in Input_File_f , we have
i/p1,join2,reformat3,output
Got it???
I just mentioned a small example , we can have n number of I/P files , many other files and may be more than one O/P files(im some cases we will have more than one O/P files).
So dude this is what i need.
I want u to be very clear abt this, bcz mostly dependent on u.
If u have still any doubts , come back to me.
Just for now get to know abt logic and then i'll tell u the key words for every number (I/P and O/P) and then we will try to figure it out.
I know it is a little bit difficult bcz even for me it took 1.5 month to figure it out. basically my need is:
I am working in Ab initio tool (some GE tool) , it stores every thing in unix.
Now i am in a situation to automate some thing , so i analysed how a gaph is stored in unix , how is it interpretating. At present we are now in the stage of scripting what i analysed and need.
Thanks a lot for ur patience
I am explaining this for u in a simpler way. Assume evry thing i am mentioning below just suppose the numbers but the logic is the same we need to implement.
for suppose:
i/p1 file has O/P numer 1000
join2 has I/P number 5555 , O/P number 1111
reformat3 has I/P number 6666 , O/P number 2222
output has I/P number 7777
1.) Now we need to go like this comming frm i/p1 take 1000
2.) add 5000 which gives 6000
3.) now go to XXGFlow file search for line 6000
Quote:
Quote:
{2010210004|XXGflow|35|0|69|0|{@{}@384|.5|.994955837726593|{12|207000|6000|227000|6000|2149000|6000|2149000|1069000|2159000|1069000|2180000|10555|}39469|17|}}
4.) So, from the XXGFlow file we will take 10555
5.) Substract 5000, 10555-5000=5555
6.) Go back to files search for 5555 , you will get it in join2 I/P number
7.) search in the same file (join2) for O/P number , u will get 1111
8.) add 5000 , 1111+5000 = 6111
9.) search in XXGFlow for 6111 and u got 11666
10.) substract 5000 , 11666-5000= 6666
11.) search for 6666 in our files u will get in reformat3
12.) now search for O/P number in reformat3, u will get 2222
13.) add 5000, 7222 . Search in XXGFlow , u got 12777.
14.) sub 5000 , u got 7777, search for 7777 in our files , it is Output_File
15.) job done.
Now in Input_File_f , we have
i/p1,join2,reformat3,output
Got it???
I just mentioned a small example , we can have n number of I/P files , many other files and may be more than one O/P files(im some cases we will have more than one O/P files).
So dude this is what i need.
I want u to be very clear abt this, bcz mostly dependent on u.
If u have still any doubts , come back to me.
Just for now get to know abt logic and then i'll tell u the key words for every number (I/P and O/P) and then we will try to figure it out.
I know it is a little bit difficult bcz even for me it took 1.5 month to figure it out. basically my need is:
I am working in Ab initio tool (some GE tool) , it stores every thing in unix.
Now i am in a situation to automate some thing , so i analysed how a gaph is stored in unix , how is it interpretating. At present we are now in the stage of scripting what i analysed and need.
Thanks a lot for ur patience
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I need to split a file based on certain context inside the file. Is there a unix command that can do this? I have looked into split and csplit but it does not seem like those would work because I need to split this file based on certain text. The file has multiple records and I need to split this... (1 Reply)
Discussion started by: matrix1067
1 Replies
2. Shell Programming and Scripting
I need to write a shell script for below scenario
My input file has data in format:
qwerty0101TWE 12345 01022005 01022005 datainala alanfernanded 26
qwerty0101mXZ 12349 01022005 06022008 datainalb johngalilo 28
qwerty0101TWE 12342 01022005 07022009 datainalc hitalbert 43
qwerty0101CFG 12345... (19 Replies)
Discussion started by: jimmy12
19 Replies
3. Shell Programming and Scripting
I have a file as:
I/P File:
Ground Car 2009
Lib 2008
Lib 2003
Ground Car 2009
Ground Car 2003
Car 2005
Car 2003
Car 2005
Sita 2900 2006
Car 2007
I have to split the file into two: - one for names and second for years.
O/p1 (Names):
Ground Car (3 Replies)
Discussion started by: karumudi7
3 Replies
4. Shell Programming and Scripting
Hi all,
I am new to scripting and I have a requirement
we have source file as
HEADER 01.10.2010 14:32:37 NAYA
TA0022
TA0000
20000001;20060612;99991231;K4;02;3
20000008;20080624;99991231;K4;02;3
20000026;19840724;99991231;KK;01;3
20000027;19840724;99991231;KK;01;3... (6 Replies)
Discussion started by: srk409
6 Replies
5. Shell Programming and Scripting
Hi Friends,
Newbie to shell scripting. Currently i have used the below to sort data based on filenames and datestamp
$ printf '%s\n' *.dat* | sort -t. -k3,4
filename_1.dat.20120430.Z
filename_2.dat.20120430.Z
filename_3.dat.20120430.Z
filename_1.dat.20120501.Z
filename_2.dat.20120501.Z... (1 Reply)
Discussion started by: robertbrown624
1 Replies
6. Shell Programming and Scripting
I will simplify the explaination a bit, I need to parse through a 87m file -
I have a single text file in the form of :
<NAME>house........
SOMETEXT
SOMETEXT
SOMETEXT
.
.
.
.
</script>
MORETEXT
MORETEXT
.
.
. (6 Replies)
Discussion started by: sumguy
6 Replies
7. UNIX for Dummies Questions & Answers
Dear All,
I have two files but want to extract data from one based on another... can you please help me
file 1
David
Tom
Ellen
and file 2
David|0010|testnamez|resultsz
David|0004|testnamex|resultsx
Tom|0010|testnamez|resultsz
Tom|0004|testnamex|resultsx
Ellen|0010|testnamez|resultsz... (12 Replies)
Discussion started by: A-V
12 Replies
8. Shell Programming and Scripting
Hi Friends ,
Please guide me with the code to extract multiple files from one file .
The File Looks like ( Suppose a file has 2 tables list ,column length may vary )
H..- > File Header....
H....- >Table 1 Header....
D....- > Table 1 Data....
T....- >Table 1 Trailer....
H..-> Table 2... (1 Reply)
Discussion started by: AspiringD
1 Replies
9. Shell Programming and Scripting
Hi All,
I have the sales_data.csv file in the directory as below.
SDDCCR; SOM ; MD6546474777 ;05-JAN-16
ABC ; KIRAN ; CB789 ;04-JAN-16
ABC ; RAMANA; KS566767477747 ;06-JAN-16
ABC ; KAMESH; A33535335 ;04-JAN-16
SDDCCR; DINESH; GD6674474747 ;08-JAN-16... (4 Replies)
Discussion started by: ROCK_PLSQL
4 Replies
10. Shell Programming and Scripting
We have the data looks like below in a log file.
I want to generat files based on the string between two hash(#) symbol like below
Source:
#ext1#test1.tale2 drop
#ext1#test11.tale21 drop
#ext1#test123.tale21 drop
#ext2#test1.tale21 drop
#ext2#test12.tale21 drop
#ext3#test11.tale21 drop... (5 Replies)
Discussion started by: Sanjeev G
5 Replies
LEARN ABOUT DEBIAN
iwn
IWN(4) BSD Kernel Interfaces Manual IWN(4) NAME
iwn -- Intel Wireless WiFi Link 4965/1000/5000/5150/5300/6000/6050 IEEE 802.11n driver SYNOPSIS
To compile this driver into the kernel, include the following lines in your kernel configuration file: device iwn device pci device wlan device firmware You also need to select a firmware for your device. Choose one from: device iwn4965fw device iwn1000fw device iwn5000fw device iwn5150fw device iwn6000fw device iwn6050fw Or you can use device iwnfw to include them all. Alternatively, to load the driver as a module at boot time, place the following lines in loader.conf(5): if_iwn_load="YES" iwn4965fw_load="YES" iwn1000fw_load="YES" iwn5000fw_load="YES" iwn5150fw_load="YES" iwn6000fw_load="YES" iwn6050fw_load="YES" DESCRIPTION
The iwn driver provides support for Intel Wireless WiFi Link 4965, 1000, 5000 and 6000 series of PCI-Express network adapters. iwn supports station, adhoc, and monitor mode operation. Only one virtual interface may be configured at any time. For more information on configuring this device, see ifconfig(8). This driver requires the firmware built with the iwnfw module to work. EXAMPLES
Join an existing BSS network (i.e., connect to an access point): ifconfig wlan create wlandev iwn0 inet 192.168.0.20 netmask 0xffffff00 Join a specific BSS network with network name ``my_net'': ifconfig wlan create wlandev iwn0 ssid my_net up Join a specific BSS network with 64-bit WEP encryption: ifconfig wlan create wlandev iwn0 ssid my_net wepmode on wepkey 0x1234567890 weptxkey 1 up Join a specific BSS network with 128-bit WEP encryption: ifconfig wlan create wlandev iwn0 wlanmode adhoc ssid my_net wepmode on wepkey 0x01020304050607080910111213 weptxkey 1 DIAGNOSTICS
iwn%d: device timeout The driver will reset the hardware. This should not happen. iwn%d: firmware error The onboard microcontroller crashed for some reason. The driver will reset the hardware. This should not happen. iwn%d: timeout waiting for firmware initialization to complete The onboard microcontroller failed to initialize in time. This should not happen. iwn%d: could not load firmware image '%s' The driver failed to load the firmware image using the firmware(9) subsystem. Verify the iwnfw(4) firmware module is present. iwn%d: could not load boot firmware An attempt to upload the boot firmware image to the onboard microcontroller failed. This should not happen. iwn%d: could not load microcode An attempt to upload the microcode image to the onboard microcontroller failed. This should not happen. iwn%d: could not load main firmware An attempt to upload the main firmware image to the onboard microcontroller failed. This should not happen. SEE ALSO
iwnfw(4), pci(4), wlan(4), wlan_ccmp(4), wlan_tkip(4), wlan_wep(4), ifconfig(8), wpa_supplicant(8) AUTHORS
The original iwn driver was written by Damien Bergamini <damien.bergamini@free.fr> BSD
July 20, 2010 BSD