Sponsored Content
Top Forums Shell Programming and Scripting Extract header data from one file and combine it with data from another file Post 302738861 by nex_asp on Monday 3rd of December 2012 03:28:21 AM
Old 12-03-2012
Its not easy it seems..

from 2nd post,

see https://www.unix.com/members/31298.html

file base of asc and hdr must match then only it should add latitude, longitude, etc...to main file, solution given by pamu is working fine, but to process number of files I have to include for loop, so I had asked...if anybody knows any good book or link to learn shell scripting please put link, I am very poor, in shell scripting..I know only C...

---------- Post updated at 03:28 AM ---------- Previous update was at 03:07 AM ----------

actually header file is having more information when I tried with another file I got wrong result....

Pamu's script reads, full header file, it should not read actually it has to filter out only particular information only...

they are ship,cruise,station, lat,long,DEPTH(SONIC),DEPTH(CAST),sst, and cast

Code:
* Sea-Bird SBE19plus Data File: 
* FileName = D:\SK-296_CTD_portable\Hex_data\n12a001001.hex 
* Software Version 1.59 
* Temperature SN =  6336 
* Conductivity SN =  6336 
* System UpLoad Time = Jul 14 2012 18:12:59 
** SHIP : India-ship 
** CRUISE : 500
** STATION : n12a001 
** LAT : 21 12.1985 N 
** LONG : 89 27.016 E 
** DEPTH(SONIC) : 93 m 
** DEPTH(CAST) : 77.7 m 
** SST : 29 degC 
* ds 
* SBE 19plus V 2.3  SERIAL NO. 6336    14 Jul 2012 17:58:03 
* vbatt = 12.2, vlith =  8.6, ioper =  61.8 ma, ipump =  39.9 ma, 
* iext01 =   4.6 ma, iext2345 =  27.1 ma 
* status = not logging 
* number of scans to average = 1 
* samples = 103375, free = 3767104, casts = 11 
* mode = profile, minimum cond freq = 2700, pump delay = 60 sec 
* autorun = no, ignore magnetic switch = no 
* battery type = alkaline, battery cutoff =  7.5 volts 
* pressure sensor = strain gauge, range = 5076.0 
* SBE 38 = no, WETLABS = no, OPTODE = no, Gas Tension Device = no 
* Ext Volt 0 = yes, Ext Volt 1 = no 
* Ext Volt 2 = yes, Ext Volt 3 = no 
* Ext Volt 4 = yes, Ext Volt 5 = no 
* echo characters = yes 
* output format = raw HEX 
 
* S> 
* 19plus 
* dh 
* cast   1 13 Jul 2012 07:31:59 samples 1 to 8619, avg = 1, stop = mag switch

-----
still some texts are there...not including...

Pls help....

Last edited by Scott; 12-03-2012 at 03:15 PM.. Reason: Code tags
 

10 More Discussions You Might Find Interesting

1. Programming

to find header in Mp3 file and retrieve data

hi all, In an mp3 file , data is arranged in sequence of header and data ,how to retrieve data between two headers. Is the data between two headers fixed? because as per theory it says 1152 samples will be there , but dont knw how many bits one sample correspond to? it would help if any c... (2 Replies)
Discussion started by: shashi
2 Replies

2. Shell Programming and Scripting

insert a header in a huge data file without using an intermediate file

I have a file with data extracted, and need to insert a header with a constant string, say: H|PayerDataExtract if i use sed, i have to redirect the output to a seperate file like sed ' sed commands' ExtractDataFile.dat > ExtractDataFileWithHeader.dat the same is true for awk and... (10 Replies)
Discussion started by: deepaktanna
10 Replies

3. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

4. Shell Programming and Scripting

Extract specific content from data and rename its header problem asking

Input file 1: >pattern_5 GAATTCGTTCATGTAGGTTGASDASFGDSGRTYRYGHDGSDFGSDGGDSGSDGSDFGSDF ATTTAATTATGATTCATACGTCATATGTTATTATTCAATCGTATAAAATTATGTGACCTT SDFSDGSDFKSDAFLKJASLFJASKLFSJAKJFHASJKFHASJKFHASJKFHSJAKFHAW >pattern_1 AAGTCTTAAGATATCACCGTCGATTAGGTTTATACAGCTTTTGTGTTATTTAAATTTGAC... (10 Replies)
Discussion started by: patrick87
10 Replies

5. Shell Programming and Scripting

Extract data from an XML file & write into a CSV file

Hi All, I am having an XML tag like: <detail sim_ser_no_1="898407109001000090" imsi_1="452070001000090"> <security>ADM1=????</security> <security>PIN1=????</security> <security>PIN2=????</security> ... (2 Replies)
Discussion started by: ss_ss
2 Replies

6. Shell Programming and Scripting

get data from files combine them to a file

hi people; this is my file1.txt:192.168.1.1 192.168.1.2 192.168.1.3 192.168.1.4 ... this is my file2.txt:portnames usernames maxusercap ... i want to write to file3.txt:l ./getports 192.168.1.1 'get all;l+;get . portnames;l-' l ./getports 192.168.1.1 'get all;l+;get . usernames;l-'... (4 Replies)
Discussion started by: gc_sw
4 Replies

7. Shell Programming and Scripting

Extract data from XML file and write in CSV file

Hi friend i have input as following XML file <?xml version="1.0"?> <Document xmlns="urn:iso:std:iso:20022:tech:xsd:camt.054.001.02"> <BkToCstmrDbtCdtNtfctn> <GrpHdr><MsgId>LBP-RDJ-TE000000-130042430010001001</MsgId><CreDtTm>2013-01-04T03:21:30</CreDtTm></GrpHdr>... (3 Replies)
Discussion started by: mohan sharma
3 Replies

8. Shell Programming and Scripting

How to combine data from 2 file ? How to print ?

Dear friends, I am just trying to print data from 2 file,namely file_1.txt and file_1.dat (specific column of ROW 1) file_1.txt 12 13 14 15 99 AMC 69 36 89 12 13 14 15 99 AMC 69 84 -12 12 13 14 ... (6 Replies)
Discussion started by: nex_asp
6 Replies

9. Shell Programming and Scripting

Combine data out of 3 files into one new file

Hi, How can I combine the data of of three files into one new file? I try to give as much informations as possible. The three existing files are called file1 file2 and file3 the new file should named output_combined. The size of the files will be around 900 words/lines each .. but always... (5 Replies)
Discussion started by: MyMemberName
5 Replies

10. Shell Programming and Scripting

Bash to verify and validate file header and data type

The below bash is a file validation check executed that will verify the correct header count of 10 and the correct data type in each field of the tab-delimited file. The key has the data type of each field in it. My real data has 58 headers in it but only the header and next row need to be... (6 Replies)
Discussion started by: cmccabe
6 Replies
AnyEvent::XMPP::Ext(3pm)				User Contributed Perl Documentation				  AnyEvent::XMPP::Ext(3pm)

NAME
AnyEvent::XMPP::Ext - Extension baseclass and documentation DESCRIPTION
This module also has documentation about the supported extensions and also is a base class for all extensions that can be added via the "add_extension" method of the classes that derive from AnyEvent::XMPP::Extendable. (That are: AnyEvent::XMPP::Client, AnyEvent::XMPP::Connection and AnyEvent::XMPP::IM::Connection) Methods disco_feature This method can be overwritten by the extension and should return a list of namespace URIs of the features that the extension enables. Supportet extensions This is the list of supported XMPP extensions: XEP-0004 - Data Forms (Version 2.8) This extension handles data forms as described in XEP-0004. AnyEvent::XMPP::Ext::DataForm allows you to construct, receive and answer data forms. This is neccessary for all sorts of things in XMPP. For example XEP-0055 (Jabber Search) or also In-band registration. XEP-0030 - Service Discovery (Version 2.3) This extension allows you to send service discovery requests and define a set of discoverable information. See also AnyEvent::XMPP::Ext::Disco. XEP-0054 - vcard-temp (Version 1.1) This extension allows the retrieval and storage of XMPP vcards as defined in XEP-0054. It is implemented by AnyEvent::XMPP::Ext::VCard. XEP-0066 - Out of Band Data (Version 1.5) This extension allows to receive and send out of band data URLs and provides helper functions to handle jabber:x:oob data. See also AnyEvent::XMPP::Ext::OOB. XEP-0077 - In-Band Registration (Version 2.2) This extension lets you register new accounts "in-band". For details please take a look at AnyEvent::XMPP::Ext::Registration. XEP-0078 - Non-SASL Authentication (Version 2.3) After lots of sweat and curses I implemented finally iq auth. Unfortunately the XEP-0078 specifies things that are not implemented, in fact the only server that worked was openfire and psyced.org. So I de-analyzed the iq auth and now it just barfs the IQ set out on the stream with the username and the password. If you insist on XEP-0078 behaviour enable the "anal_iq_auth" option when creating the stream. You can also completely disable iq auth, well, just see the documentation of AnyEvent::XMPP::Connection XEP-0082 - XMPP Date and Time Profiles (Version 1.0) Implemented some functions to deal with XMPP timestamps, see AnyEvent::XMPP::Util "to_xmpp_time", "to_xmpp_datetime", "from_xmpp_datetime". They are meant as simple formatters for you, you will still need to handle timezone stuff and such yourself. XEP-0086 - Error Condition Mappings (Version 1.0) "A mapping to enable legacy entities to correctly handle errors from XMPP-aware entities." This extension will enable sending of the old error codes when generating a stanza error with for example the "write_error_tag" method of AnyEvent::XMPP::Writer. Also if only the old numeric codes are supplied the AnyEvent::XMPP::Error::Stanza class tries to map the numeric codes to the new error conditions if possible. XEP-0091 - Delayed Delivery (Version 1.3) See also XEP-0203 below. XEP-0092 - Software Version (Version 1.1) The ability to answer to software version, name and operating system requests and being able to send such requests is implemented in AnyEvent::XMPP::Ext::Version. XEP-0114 - Jabber Component Protocol (Version 1.5) This extension allows you to connect to a server as a component and makes it possible to implement services like pubsub, muc, or whatever you can imagine (even gateways). See documentation of AnyEvent::XMPP::Component and the example "samples/simple_component". XEP-0153 - vCard-Based Avatars (Version 1.0) This extension allows to store and retrive avatars from vcards. On top of that it will also signal others that you support avatars and that they might have changed. See AnyEvent::XMPP::Ext::VCard. XEP-0199 - XMPP Ping (Version 1.0) You can send ping requests to other entities and also are able to reply to them. On top of that the AnyEvent::XMPP::Ext::Ping extension implements a connection timeout mechanism based on this. XEP-0203 - Delayed Delivery (Version 1.0) Both delayed delivery XEPs are supported and are implemented by AnyEvent::XMPP::IM::Delayed which is a super class of AnyEvent::XMPP::IM::Message and AnyEvent::XMPP::IM::Presence. If you need to fetch delay from stanzas you caught yourself in an event you can use a AnyEvent::XMPP::IM::Delayed object to parse/fetch the delay out of the AnyEvent::XMPP::Node. Use the functions described above in the XEP-0082 item to decode the timestamps of delays. AUTHOR
Robin Redeker, "<elmex at ta-sa.org>", JID: "<elmex at jabber.org>" COPYRIGHT &; LICENSE Copyright 2007, 2008 Robin Redeker, all rights reserved. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself. perl v5.14.2 2012-01-23 AnyEvent::XMPP::Ext(3pm)
All times are GMT -4. The time now is 03:00 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy