05-24-2010
Extract repeating data from file
I want to extract the last rows of a data file, similar to that one below:
C1 xxx
C2 rrr
C3 ttt
....
Cn-1 hhh
Cn bbb
C1 yyy
C2 sss
C3 uuu
...
Cn-1 iii
Cn ccc
...
I just want to extract the final rows between C1 and Cn at each data file. n is not a constant, but depends on the data itself. Is there a way to do this with awk?
Thank you,
n
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
My file in ksh consists of message data of varying lengths (lines), separated with headers.
I would like to find a string from this file, and print out the whole message data including the headers.
my plan of attack is to search the strings, print the top header, and print the whole message... (2 Replies)
Discussion started by: apalex
2 Replies
2. Shell Programming and Scripting
Dear All ,
I am posting first time in this forum . Please ignore my mistakes .
I am learning Unix and i need help to extract specific data from file .
1. I want to grep number of fails from log . The file contains "fails" word in line if test cases are failed .
2. The log contains... (20 Replies)
Discussion started by: getdpg
20 Replies
3. Shell Programming and Scripting
I'm not a unix guy so excuses my ignorance... I'm the database ETL guy.
I'm trying to be proactive and devise a plan B for a ETL process where I expect a file 10X larger than what I process daily for a recast job. The ETL may handle it but I just don't know.
This file may need to be split... (3 Replies)
Discussion started by: john091
3 Replies
4. Shell Programming and Scripting
Hey Guys!
I have written a code which combines lots of files into one big file(.csv).
However, each of the original files had headers on the first line, and now that I've combined the files the headers are interspersed throughout the new combined data frame. For example, throughout the data... (21 Replies)
Discussion started by: gd9629
21 Replies
5. Shell Programming and Scripting
Hi,
I am new to shell scripting. I need to extract data between repeating tags from an xml file and store the data in an array to process it further.
<ns1:root xmlns:ns1="http://example.com/config">
<ns1:interface>in1</ns1:interface>
<ns1:operation attribute1="true" attribute2="abd"... (2 Replies)
Discussion started by: sailendra
2 Replies
6. Shell Programming and Scripting
Hi, Great minds, I have some files, in fact header files, of CTD profiler, I tried a lot C programming, could not get output as I was expected, because my programming skills are very poor, finally, joined unix forum with the hope that, I may get what I want, from you people,
Here I have attached... (17 Replies)
Discussion started by: nex_asp
17 Replies
7. Shell Programming and Scripting
Hello All,
I have a small xml file which looks like below:
<Check:defaultval Val="crash" value="crash_report_0013
generate_check_0020 generate_check_0022

This is where the fault is."/>
<Check:defaultval Val="crash" value="crash_report_1001
generate_check_1001... (9 Replies)
Discussion started by: suvendu4urs
9 Replies
8. Shell Programming and Scripting
I need to send email to receipient in each block of data in a file which has the sender address under TO and just send that block of data where it ends as COMPANY.
I tried to work this out by getting line numbers of the string HELLO but unable to grab the next block of data to send the next... (5 Replies)
Discussion started by: loggedout
5 Replies
9. Shell Programming and Scripting
I have a text file that contains the following data. For example, aa.txt has some numbers. I need to extract the continuous numbers(minimum 3 numbers) from it.How can I do this with awk?
>aa.txt
31
35
36
37
38
39
44
169
170
173
174
175
177
206
>1a.txt
39 (5 Replies)
Discussion started by: rahmanabdulla
5 Replies
10. Shell Programming and Scripting
Hi guys
I have an log from an regular application processing where the processing is done every 10 minutes and is written to the same log which is rotated on daily basis.
the block of log starts always with "Starting" and ends with a certain pattern "Completed"
The catch is I want to... (7 Replies)
Discussion started by: kl1ngac1k
7 Replies
LEARN ABOUT CENTOS
tracker-extract
tracker-extract(1) User Commands tracker-extract(1)
NAME
tracker-extract - Extract metadata from a file.
SYNOPSYS
tracker-extract [OPTION...] FILE...
DESCRIPTION
tracker-extract reads the file and mimetype provided in stdin and extract the metadata from this file; then it displays the metadata on the
standard output.
NOTE: If a FILE is not provided then tracker-extract will run for 30 seconds waiting for DBus calls before quitting.
OPTIONS
-?, --help
Show summary of options.
-v, --verbosity=N
Set verbosity to N. This overrides the config value. Values include 0=errors, 1=minimal, 2=detailed and 3=debug.
-f, --file=FILE
The FILE to extract metadata from. The FILE argument can be either a local path or a URI. It also does not have to be an absolute
path.
-m, --mime=MIME
The MIME type to use for the file. If one is not provided, it will be guessed automatically.
-d, --disable-shutdown
Disable shutting down after 30 seconds of inactivity.
-i, --force-internal-extractors
Use this option to force internal extractors over 3rd parties like libstreamanalyzer.
-m, --force-module=MODULE
Force a particular module to be used. This is here as a convenience for developers wanting to test their MODULE file. Only the MOD-
ULE name has to be specified, not the full path. Typically, a MODULE is installed to /usr/lib/tracker-0.7/extract-modules/. This
option can be used with or without the .so part of the name too, for example, you can use --force-module=foo
Modules are shared objects which are dynamically loaded at run time. These files must have the .so suffix to be loaded and must con-
tain the correct symbols to be authenticated by tracker-extract. For more information see the libtracker-extract reference documen-
tation.
-V, --version
Show binary version.
EXAMPLES
Using command line to extract metadata from a file:
$ tracker-extract -v 3 -f /path/to/some/file.mp3
Using a specific module to extract metadata from a file:
$ tracker-extract -v 3 -f /path/to/some/file.mp3 -m mymodule
ENVIRONMENT
TRACKER_EXTRACTORS_DIR
This is the directory which tracker uses to load the shared libraries from (used for extracting metadata for specific file types).
These are needed on each invocation of tracker-store. If unset it will default to the correct place. This is used mainly for testing
purposes. The default location is /usr/lib/tracker-0.10/extract-modules/.
TRACKER_EXTRACTOR_RULES_DIR
This is the directory which tracker uses to load the rules files from. The rules files describe extractor modules and their sup-
ported MIME types. The default location is /usr/share/tracker/extract-rules/.
TRACKER_USE_CONFIG_FILES
Don't use GSettings, instead use a config file similar to how settings were saved in 0.10.x. That is, a file which is much like an
.ini file. These are saved to $HOME/.config/tracker/
SEE ALSO
tracker-store(1), tracker-sparql(1), tracker-stats(1), tracker-info(1).
/usr/lib/tracker-0.10/extract-modules/
/usr/share/tracker/extract-rules/
GNU
July 2007 tracker-extract(1)