|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
How to extract specific data and count number containing sets from a file?
Post 302442499 by Daniel8472 on Wednesday 4th of August 2010 01:04:05 PM
08-04-2010
How to extract specific data and count number containing sets from a file?
Hello everybody!
I am quit new here and hope you can help me.
Using an awk script I am trying to extract data from several files. The structure of the input files is as follows:
TimeStep parameter1 parameter2 parameter3 parameter4
e.g.
1 X Y Z L
1 D H Z I
1 H Y E W
2 D H G F
2 R T U V
3
.
.
.
I would like to count the number entries from time step 1, 2, 3... containing certain parameters, respectively.
I already wrote a script that is extracting entries with specific parameters. However I am still struggling with getting with the information how many entries of time step 1, 2 and 3 contain e.g. parameter Z in $4 (2 for time step 1 and 0 for all other in the example above).
I Would prefer to do everything within a single script awk because I got a lot of data and later only want to change the parameter selection.
I already tried to do it within for and while loops but it did not work as I wanted it to... well I am just starting with awk
Thanks for your help guys!
I am quit new here and hope you can help me.
Using an awk script I am trying to extract data from several files. The structure of the input files is as follows:
TimeStep parameter1 parameter2 parameter3 parameter4
e.g.
1 X Y Z L
1 D H Z I
1 H Y E W
2 D H G F
2 R T U V
3
.
.
.
I would like to count the number entries from time step 1, 2, 3... containing certain parameters, respectively.
I already wrote a script that is extracting entries with specific parameters. However I am still struggling with getting with the information how many entries of time step 1, 2 and 3 contain e.g. parameter Z in $4 (2 for time step 1 and 0 for all other in the example above).
I Would prefer to do everything within a single script awk because I got a lot of data and later only want to change the parameter selection.
I already tried to do it within for and while loops but it did not work as I wanted it to... well I am just starting with awk
Thanks for your help guys!
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I need to extract the start time value (bold, red font) under the '<LogEvent ID="Timer Start">' tag (black bold) from a file with the following pattern. There are other LogEventIDs listed in the file as well, making it harder for me to extract out the specific start time that I need.
.
.... (7 Replies)
Discussion started by: 60doses
7 Replies
2. Shell Programming and Scripting
Hi , I am having a script which will start a process and appends the process related logs to a log file. The log file writes logs with every line starting with date in the format of: date +"%Y %b %d %H:%M:%S".
So, in the script, before I start the process, I am storing the date as DATE=`date +"%Y... (5 Replies)
Discussion started by: chiru_h
5 Replies
3. Shell Programming and Scripting
Hi
I want to extract certain text between two line numbers like
23234234324 and
54446655567567
How do I do this with a simple sed or awk command?
Thank you.
---------- Post updated at 06:16 PM ---------- Previous update was at 05:55 PM ----------
found it:
sed -n '#1,#2p'... (1 Reply)
Discussion started by: return_user
1 Replies
4. Shell Programming and Scripting
:confused: I have a tab delimited file that I need to extract data from and into a file with specific field specs. Each field has to be a certain amount of characters. So, the name field (from delimited file) might have only 15 characters but needs to be 25 (in new file) so I need to insert spaces... (5 Replies)
Discussion started by: criddel
5 Replies
5. UNIX for Dummies Questions & Answers
Hello People,
I have the following contents in an XML file
...........
...........
..........
...........
<Details = "Sample Details">
<Name>Bob</Name>
<Age>34</Age>
<Address>CA</Address>
<ContactNumber>1234</ContactNumber>
</Details>
...........
.............
.............. (4 Replies)
Discussion started by: sushant172
4 Replies
6. Shell Programming and Scripting
My input:
Data name: ABC001
Data length: 1000
Detail info
Data Direction Start_time End_time Length
1 forward 10 100 90
1 forward 15 200 185
2 reverse 50 500 450
Data name: XFG110
Data length: 100
Detail info
Data Direction Start_time End_time Length
1 forward 50 100 50 ... (11 Replies)
Discussion started by: patrick87
11 Replies
7. Shell Programming and Scripting
Hi,
I search all forum, but I can not find solutions of my problem :(
I have multiple files (5000 files), inside there is this data :
FILE 1:
1195.921 -898.995 0.750312E-02-0.497526E-02 0.195382E-05 0.609417E-05
-2021.287 1305.479-0.819754E-02 0.107572E-01 0.313018E-05 0.885066E-05
... (15 Replies)
Discussion started by: guns
15 Replies
8. Shell Programming and Scripting
hi I want to write a script which count the number of subdirectories in the current root directory that contain more than a specified number of files of a specific type. Is there an easy way to do this?
Thanks
Robert (2 Replies)
Discussion started by: piynik
2 Replies
9. Shell Programming and Scripting
Hi All,
I'm stuck-up in finding a way to skip the delimiter which come within double quotes using awk or any other better option. can someone please help me out.
Below are the details:
Delimited: |
Sample data: 742433154|"SYN|THESIS MED CHEM PTY.... (2 Replies)
Discussion started by: BrahmaNaiduA
2 Replies
10. Shell Programming and Scripting
data.txt has several information like the below..
<SERVER>:WEB:MYDOM01:/tmp/cong/MYDOM01,/tmp/app/MYDOM01
<WEBER>:CANES:https-web01,https-web02:/web/apps/https-web01/config
<SERVER>:WEB:MYDOM07:/tmp/cong/MYDOM07,/tmp/app/MYDOM07... (7 Replies)
Discussion started by: mohtashims
7 Replies
LEARN ABOUT OPENSOLARIS
file-roller
file-roller(1) User Commands file-roller(1) NAME
file-roller - create, view, modify, or unpack an archive SYNOPSIS
file-roller [--add] [--add-to=archive] [--default-dir=folder] [--extract] [--extract-here] [--extract-to=folder] [--force] [gnome-std- options] DESCRIPTION
The File Roller application enables you to create, view, modify, or unpack an archive. An archive is a file that acts as a container for other files. An archive can contain many files, folders, and subfolders, usually in compressed form. OPTIONS
The following options are supported: -d, --add Ask for the name of the archive, then add the files, then quit the application. -a, --add-to=archive Add files to the specified archive, then quit the application. --default-dir=folder Specify the default folder for the --add and --extract options. -f, --extract Ask for the name of the destination folder, then extract the files, then quit the application. -h, --extract-here Extract archives using the archive name as destination folder and quit the program. -e, --extract-to=folder Extract archives to the specified folder, then quit the application. --force Create the destination folder without asking for confirmation. gnome-std-options Standard options available for use with most GNOME applications. See gnome-std-options(5) for more infor- mation. EXAMPLES
Example 1: Unpacking an Archive example% file-roller --extract archive EXIT STATUS
The following exit values are returned: 0 Application exited successfully >0 Application exited with failure FILES
The following files are used by this application: /usr/bin/file-roller Executable for File Roller application. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNW | +-----------------------------+-----------------------------+ |Interface stability |Volatile | +-----------------------------+-----------------------------+ SEE ALSO
File Roller Manual ar(1), tar(1), unzip(1), zip(1), attributes(5), gnome-std-options(5) NOTES
Written by Laszlo Kovacs, Sun Microsystems Inc., 2003, 2004, 2007. SunOS 5.11 08 Nov 2007 file-roller(1)