Quick way to select many records from a large file Post: 302942390

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Using a variable to select records with awk

As part of a bigger task, I had to read thru a file and separate records into various batches based on a field. Specifically, separate records based on the value in the batch field as defined below. The batch field left-justified numbers. The datafile is here > cat infile 12345 1 John Smith ...

2. UNIX for Dummies Questions & Answers

Quick question about finding a large file

what is the correct command for finding the largest file and displaying it without any error information? I can find it, but how do I display it in the same command?

3. Shell Programming and Scripting

Extract data from large file 80+ million records

Hello, I have got one file with more than 120+ million records(35 GB in size). I have to extract some relevant data from file based on some parameter and generate other output file. What will be the besat and fastest way to extract the ne file. sample file format :--...

4. Shell Programming and Scripting

select records from one file based on a second file

Hi all: I have two files: file1: 74 DS 9871 199009871 1 1990 4 1 165200 Sc pr de te sa ox 1.0 1.0 13.0000 35.7560 5.950 3.0 3.0 13.0100 35.7550 5.970 ** 74 DS 99004 74DS99004 6738 1990 4 1 165200 Eb pr de te sa ox 1.0 1.0 13.0000 ...

5. Shell Programming and Scripting

How to Pick Random records from a large file

Hi, I have a huge file say with 2000000 records. The file has 42 fields. I would like to pick randomly 1000 records from this huge file. Can anyone help me how to do this?

6. Shell Programming and Scripting

Automatically select records from several files and then run a C executable file inside the script

Dear list its my first post and i would like to greet everyone What i would like to do is select records 7 and 11 from each files in a folder then run an executable inside the script for the selected parameters. The file format is something like this 7 100 200 7 100 250 7 100 300 ...

7. Shell Programming and Scripting

awk - splitting 1 large file into multiple based on same key records

Hello gurus, I am new to "awk" and trying to break a large file having 4 million records into several output files each having half million but at the same time I want to keep the similar key records in the same output file, not to exist accross the files. e.g. my data is like: Row_Num,...

8. Shell Programming and Scripting

Block of records to select from a file

Hello: I am new to shell script programming. Now I would like to select specific records block from a file. For example, current file "xyz.txt" is containing 1million records and want to select the block of records from line number 50000 to 100000 and save into a file. Can anyone suggest me how...

9. Shell Programming and Scripting

Split a large file in n records and skip a particular record

Hello All, I have a large file, more than 50,000 lines, and I want to split it in even 5000 records. Which I can do using sed '1d;$d;' <filename> | awk 'NR%5000==1{x="F"++i;}{print > x}'Now I need to add one more condition that is not to break the file at 5000th record if the 5000th record...

10. Shell Programming and Scripting

Select records and fields

Hi All I would like to modify a file like this: >antax gioq21 tris notes abcdefghij klmnopqrs >betax gion32 ter notes2 tuvzabcdef ahgskslsooin this: >tris abcdefghij klmnopqrs >ter tuvzabcdef ahgskslsoo So, I would like to remove the first two fields(and output field 3) in record...

LEARN ABOUT DEBIAN

interface-order

INTERFACE-ORDER(5)						    resolvconf							INTERFACE-ORDER(5)

NAME

       interface-order - resolvconf configuration file

DESCRIPTION

       The  file  /etc/resolvconf/interface-order is used to control the order in which resolvconf nameserver information records are processed by
       those resolvconf update scripts that consult this file.	(The name of the file is apt because a resolvconf nameserver information record is
       named after the interface with which it is associated.)

       The  file  contains  a sequence of shell glob patterns, one per line.  The position of a record in the order is the point at which its name
       first matches a pattern.

       Patterns may not contain whitespace, slashes or initial dots or tildes.	Blank lines and lines beginning with a '#' are ignored.

       Resolvconf update scripts in /etc/resolvconf/update.d/ that consult this file include the current default versions of  dnsmasq,	pdnsd  and
       libc.   (Actually  they don't read the file directly; they call the utility program /lib/resolvconf/list-records which lists records in the
       specified order and omits the names of empty records.)

EXAMPLE

       # /etc/resolvconf/interface-order
       # Use nameservers on the loopback interface first.
       lo*
       # Next use records for Ethernet interfaces
       eth*
       # Next use records for Wi-Fi interfaces
       wlan*
       # Next use records for PPP interfaces
       ppp*
       # Last use other interfaces
       *

AUTHOR

       Resolvconf was written by Thomas Hood <jdthood@gmail.com>.

COPYRIGHT

       Copyright (C) 2004, 2011 Thomas Hood
       This is free software; see the source for copying conditions.  There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICU-
       LAR PURPOSE.

SEE ALSO

       resolvconf(8)

resolvconf							    18 May 2011 						INTERFACE-ORDER(5)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Using a variable to select records with awk

Discussion started by: joeyg

2. UNIX for Dummies Questions & Answers

Quick question about finding a large file

Discussion started by: raidkridley

3. Shell Programming and Scripting

Extract data from large file 80+ million records

Discussion started by: learner16s

4. Shell Programming and Scripting

select records from one file based on a second file

Discussion started by: rleal