Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Most efficient method to extract values from text files
Top Forums Shell Programming and Scripting Most efficient method to extract values from text files Post 302915634 by h0x0r21 on Thursday 4th of September 2014 04:42:53 AM
Old 09-04-2014
Quote:
Originally Posted by Scrutinizer
Yes that would be very inefficient..

You can operate the greps on all the files at once, or if there are too many and the names of the files do not need to be in the result you can concatenate the files first and run your greps on that, maybe you can combine greps?

Bit of a guess because it is not clear at this point what you need to do with the results, what the files and the output looks like and what results you are looking for..
I need the file names also , so i guess concatenation is not possible.

From the multiple values that i extract , i have to add them(comma separated for each individual file) to an already existing file .
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File transformation - what is most efficient method

I've done quite a bit of searching on this but cannot seem to find exactly what I'm looking for. Say I have a | delimited input file with 6 columns and I need to change the value of a few columns and create an output file. With my limited knowledge I can do this with many lines of code but want... (5 Replies)
Discussion started by: 1superdork
5 Replies

2. Shell Programming and Scripting

multiplying values from two text files

Im very new to programming. But I would like to write a script which extracts and multiply values from 2 txt and output as a new file. Can someone please teach me how to write it? Thank you so much for example File A File B 1 34 1 2 2 13 2 2 3 8 3 3 File C output 1 68 2... (2 Replies)
Discussion started by: crunchichichi
2 Replies

3. Shell Programming and Scripting

Extract text and store in separate files

Hi, I have a file which looks like this: .I 1 some text .A this is the first line .I 2 some text again .B this is the second line .I 3 again some text .C this is the third line I want to have my output like this in separate files: (7 Replies)
Discussion started by: shoaibjameel123
7 Replies

4. Programming

modifying 2 or more values using method in Java

i wanna make modification in two or more identifiers,using a method in JAVA , but the only way to do this is by returning a value ,then also only one variable value can be modified .. one way 2 do do this is by use of array and passing its name in method ,, please suggest a different way of doing... (2 Replies)
Discussion started by: upvan111
2 Replies

5. Homework & Coursework Questions

Efficient Text File Writing

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: Write a template main.c file via shell script to make it easier for yourself later. The issue here isn't writing... (2 Replies)
Discussion started by: george3isme
2 Replies

6. Shell Programming and Scripting

Efficient population of array from text file

Hi, I am trying to populate an array with data from a text file. I have a working method using awk but it is too slow and inefficent. See below. The text file has 70,000 lines. As awk is a line editor it reads each line of the file until it gets to the required line and then processes it.... (3 Replies)
Discussion started by: carlr
3 Replies

7. Shell Programming and Scripting

Efficient method of determining if a string is in a file.

Hi, I was hoping someone could suggest an alternative to code I currently have as mine takes up far too much processor time and it to slow. The situation: I have a programme that runs on some files just before they are zipped up and archived, the program appends a one line summary of the... (4 Replies)
Discussion started by: RECrerar
4 Replies

8. Shell Programming and Scripting

Extract lines from text files

I have some files containing the following data # RESIDUE AA STRUCTURE BP1 BP2 ACC N-H-->O O-->H-N N-H-->O O-->H-N TCO KAPPA ALPHA PHI PSI X-CA Y-CA Z-CA 1 196 A M 0 0 230 0, 0.0 2,-0.2 0, 0.0 0, 0.0 0.000 360.0 360.0 360.0 76.4 21.7 -6.8 11.3 2 197 A D + 0 0 175 1,-0.1 2,-0.1 0, 0.0 0, 0.0... (10 Replies)
Discussion started by: edweena
10 Replies

9. UNIX for Dummies Questions & Answers

More efficient way to print variable values?

Hello, Through the process of a executing a shell script, I extract the values for a number of variables (arbitrarily declared as a through i) and towards the end I print them out like shown below: #!bin/sh # bits of code to get values for the variables ...... ...... # print the values... (4 Replies)
Discussion started by: Gussifinknottle
4 Replies

10. Shell Programming and Scripting

Portable and efficient way to add text after pattern

Shell: sh/bash OS: Linux (all unix flavors) Suppose i have a variable with this content: ArgZ=' import os import sys MySpecialpath = os.path.abspath(sys.argv) # ' ArgZB='#REGEN #REGEN #REGEN ' I want to add this text to a file/script, only under the following conditions: 1. ... (1 Reply)
Discussion started by: SkySmart
1 Replies

LEARN ABOUT LINUX

grep-excuses

GREP-EXCUSES(1)                                               General Commands Manual                                              GREP-EXCUSES(1)

NAME

       grep-excuses - search the testing excuses files for a specific maintainer

SYNOPSIS

       grep-excuses [options] [maintainer|package]

DESCRIPTION

       grep-excuses  downloads  the  update_excuses.html file and greps it for the specified maintainer name.  The libwww-perl package is required
       for this script.  If no name is given on the command line, first the environment variable DEBFULLNAME is used if it is defined, and failing
       that, the configuration variable described below is used.

OPTIONS

       --no-conf, --noconf
              Do not read any configuration files.  This can only be used as the first option given on the command-line.

       --wipnity, -w
              Get information from <http://release.debian.org/migration/>.  A package name must be given when using this option.

       --help Show a brief usage message.

       --version
              Show version and copyright information.

CONFIGURATION VARIABLES

       The  two configuration files /etc/devscripts.conf and ~/.devscripts are sourced in that order to set configuration variables.  Command line
       options can be used to override configuration file settings.  Environment variable settings are ignored for this  purpose.   The  currently
       recognised variable is:

       GREP_EXCUSES_MAINTAINER
              The default maintainer, email or package to grep for if none is specified on the command line.

SEE ALSO

       devscripts.conf(5).

AUTHOR

       Joey Hess <joeyh@debian.org>; modifications by Julian Gilbey <jdg@debian.org>.

DEBIAN                                                           Debian Utilities                                                  GREP-EXCUSES(1)
All times are GMT -4. The time now is 12:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy