Grep matched records from huge file Post: 302338870

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed, grep, awk, regex -- extracting a matched substring from a file/string

Ok, I'm stumped and can't seem to find relevant info. (I'm not even sure, I might have asked something similar before.): I'm trying to use shell scripting/UNIX commands to extract URLs from a fairly large web page, with a view to ultimately wrapping this in PHP with exec() and including the...

2. Shell Programming and Scripting

deleting multiple records from a huge file at one time

I have a very big file of 5gb size and there are about 50 million records in there. I have to delete the records based on recrord number that I know fromoutside with out opening the file. The record numbers are very random like 5000678, 7890005 etc. Can somebody let me know how i can...

3. Shell Programming and Scripting

grep all records in a file and get a word count -perl

Hi, I have a file .. file.txt .. i need to get a total record count in the files into a $variable.. im using perl script thanks

4. UNIX for Dummies Questions & Answers

Parsing out records from one huge record

Hi, I have one huge record and know that each record in the file is 550 bytes long. How do I parse out individual records from the single huge record. Thanks,

5. UNIX for Dummies Questions & Answers

Grep specific records from a file of records that are separated by an empty line

Hi everyone. I am a newbie to Linux stuff. I have this kind of problem which couldn't solve alone. I have a text file with records separated by empty lines like this: ID: 20 Name: X Age: 19 ID: 21 Name: Z ID: 22 Email: xxx@yahoo.com Name: Y Age: 19 I want to grep records that...

6. HP-UX

Performance issue with 'grep' command for huge file size

I have 2 files; one file (say, details.txt) contains the details of employees and another file (say, emp.txt) has some selected employee names. I am extracting employee details from details.txt by using emp.txt and the corresponding code is: while read line do emp_name=`echo $line` grep -e...

7. Shell Programming and Scripting

Grep records out of file

Hi, I have a file where there "Tab" seperated values are present.I need to identify duplicate entries based on column 1 & 6 only . For e.g : I tried using uniq ..but the output is only having one duplicate entry, instead of both the entries.I need both the above entries . uniq -f5...

8. UNIX for Dummies Questions & Answers

What is the faster way to grep from huge file?

Hi All, I am new to this forum and this is my first post. My requirement is like to optimize the time taken to grep the file with 40000 lines. There are two files FILEA(40000 lines) FILEB(40000 lines). The requirement is like this, both the file will be in the format below...

9. Shell Programming and Scripting

Extract Matched Records from XML

Hi All, I have a requirement to extract para in XML file on the basis of another list file having specific parameters. I will extract these para from XML and import in one scheduler tool. file2 <FOLDER DATACENTER="ControlMserver" VERSION="800" PLATFORM="UNIX" FOLDER_NAME="SH_AP_INT_B01"...

10. Shell Programming and Scripting

How to fetch matched records from files between two different directory?

awk 'NR==FNR{arr;next} $0 in arr' /tmp/Data_mismatch.sh /prd/HK/ACCTCARD_20160115.txt edit by bakunin: seems that one CODE-tag got lost somewhere. i corrected that, but please check your posts more carefully. Thank you.

LEARN ABOUT DEBIAN

getds

GETDS(1p)						User Contributed Perl Documentation						 GETDS(1p)

NAME

       getds - Create a DS record from DNSKEYing information

SYNOPSIS

	 getds <domain>

DESCRIPTION

       getds will create a DS record from DNSKEYs for the specified DNS domain.  It does this by converting DNSKEYs to DS records using the
       specified hashing algorithm.  The results can then be passed to upstream DNSSEC-supporting parents or to DLV registries.

       getds will also pull the parent's published DS records and compare them against the existing keys.  It will then list any DS records not
       published in the parent, as well as any DS records that are published in the parent but which don't match an existing key.

OPTIONS

       getds takes the following options:

       -a ALGORITHMS
       --hash-algorithm algorithm ALGORITHMS
	   This option specifies the hash algorithm to use when converting DNSKEYs to DS records.  It may be a comma-separated list if multiple
	   algorithms are desired.  The algorithms to choose from may be either SHA256 or SHA1.

	   The default is SHA256,SHA1

       -z
       --print-zsks
	   This option causes getds to print ZSK DS records, as well as KSK records.

       -p
       --dont-check-parent
	   Instructs getds to not check the records in the parent for their published DS records.

       -q
       --quiet
	   Produces quiet output with no explanatory headers.  In other words, it only prints the DS records generated from the DNSKEYs.

	   Note: Running with -q implies -p.

SECURITY CONSIDERATIONS

       By default, getds pulls data from the live DNS.	If your DNS resolver isn't configured so that this is pulled securely, then the results
       can't be trusted.

COPYRIGHT

       Copyright 2008-2012 SPARTA, Inc.  All rights reserved.  See the COPYING file included with the DNSSEC-Tools package for details.

AUTHOR

       Wes Hardaker, hardaker AT AT AT users.sourceforge.net

perl v5.14.2							    2012-06-21								 GETDS(1p)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed, grep, awk, regex -- extracting a matched substring from a file/string

Discussion started by: ropers

2. Shell Programming and Scripting

deleting multiple records from a huge file at one time

Discussion started by: dsravan

3. Shell Programming and Scripting

grep all records in a file and get a word count -perl

Discussion started by: meghana

4. UNIX for Dummies Questions & Answers

Parsing out records from one huge record

Discussion started by: bwrynz1