Sponsored Content
Top Forums Shell Programming and Scripting Optimised way for search & replace a value on one line in a very huge file (File Size is 24 GB). Post 302552327 by manishkomar007 on Friday 2nd of September 2011 12:16:53 PM
Old 09-02-2011
Hammer & Screwdriver

Thanks Corona688...!!

While doing this we are excatly searching & replacing 8 character like 20110901 to 20110902. And we were monitoring the performance of the server which was very good. It didn't swaped out on memory. Still it took so much time .. rite.. i think on Linux if its takes 11 mins which is still more. Please correct me if I am wrong.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

In Line File Modifications: Search and Replace

grep -il "TEST" ${ENVIRON}/*.pde| while read pde   do     cat $pde | sed s/"TEST 3,1"/"TEST 3,0"/g | sed s/"TEST  3,1"/"TEST  3,0"/g > ${pde}.tmp     if ; then       mv ${pde}.tmp $pde ... (2 Replies)
Discussion started by: Shakey21
2 Replies

2. UNIX for Dummies Questions & Answers

how can search a String in one text file and replace the whole line in another file

i am very new to UNIX plz help me in this scenario i have two text files as below file1.txt name=Rajakumar. Discipline=Electronics and communication. Designation=software Engineer. file2.txt name=Kannan. Discipline=Mechanical. Designation=CADD Design Engineer. ... (6 Replies)
Discussion started by: kkraja
6 Replies

3. UNIX for Dummies Questions & Answers

How to search and replace a particular line in file with sed command

Hello, I have a file and in that, I want to search for a aprticular word and then replace another word in the same line with something else. Example: In file abc.txt, there is a line <host oa_var="s_hostname">test</host> I want to search with s_hostname text and then replace test with... (2 Replies)
Discussion started by: sshah1001
2 Replies

4. Shell Programming and Scripting

Search & Replace in Multiple Files by reading a input file

Hi, I have a folder which contains multiple config.xml files and one input file, Please see the below format. Config Files format looks like :- Code: <application name="SAMPLE-ARCHIVE"> <NVPairs name="Global Variables"> <NameValuePair> ... (0 Replies)
Discussion started by: haiksuresh
0 Replies

5. Shell Programming and Scripting

Implement in one line sed or awk having no delimiter and file size is huge

I have file which contains around 5000 lines. The lines are fixed legth but having no delimiter.Each line line contains nearly 3000 characters. I want to delete the lines a> if it starts with 1 and if 576th postion is a digit i,e 0-9 or b> if it starts with 0 or 9(i,e header and footer) ... (4 Replies)
Discussion started by: millan
4 Replies

6. Shell Programming and Scripting

Global search and replace multi line file

Hello I need to search for a mult-line strngs(with spaces in between and qoted) in a file1 and replace that text with Fixed string globally in file1. The strng to search for is in file2. The file is big with some 20K records. so speed and effciency is required file1: (where srch & rplc... (0 Replies)
Discussion started by: Hiano
0 Replies

7. Shell Programming and Scripting

Mutli line pattern search & replace in a xml file

Hello guys, I need your help for a specific sed command that would search for a multi line pattern and if found, would replace it by another multi line pattern. For instance, here is the input: <RefNickName>abcd</RefNickName> <NickName>efgh</NickName> <Customize> ... (0 Replies)
Discussion started by: xciteddd
0 Replies

8. Shell Programming and Scripting

awk search/replace specific field, using variables for regexp & subsitution then overwrite file

Hello, I'm trying the solve the following problem. I have a file which I intend to use as a csv called master.csv The columns are separated by commas. I want to change the text on a specific row in either column 3,4,5 or 6 from xxx to yyy depending upon if column 1 matches a specified pattern.... (3 Replies)
Discussion started by: cyphex
3 Replies

9. Shell Programming and Scripting

Search & Replace in Multiple Files by reading a input file

I have a environment property file which contains: Input file: value1 = url1 value2 = url2 value3 = url3 and so on. I need to search all *.xml files under directory for value1 and replace it with url1. Same thing I have to do for all values mentioned in input file. I need script in unix bash... (7 Replies)
Discussion started by: Shamkamde
7 Replies

10. UNIX for Dummies Questions & Answers

Need to replace new line characters in a huge file

Hi , I would like to replace new line characters(\n) in a huge file of about 2 million records . I tried this one (:%s/\n//g) but it's hanging there and no result. Does this command do not work if the file is big. Please let me know if you have any other options Regards Raj (1 Reply)
Discussion started by: rajeevm
1 Replies
PERFMONCTL(2)						     Linux Programmer's Manual						     PERFMONCTL(2)

NAME
perfmonctl - interface to IA-64 performance monitoring unit SYNOPSIS
#include <syscall.h> #include <perfmon.h> long perfmonctl(int fd, int cmd, void *arg, int narg); Note: There is no glibc wrapper for this system call; see NOTES. DESCRIPTION
The IA-64-specific perfmonctl() system call provides an interface to the PMU (performance monitoring unit). The PMU consists of PMD (per- formance monitoring data) registers and PMC (performance monitoring control) registers, which gather hardware statistics. perfmonctl() applies the operation cmd to the input arguments specified by arg. The number of arguments is defined by narg. The fd argu- ment specifies the perfmon context to operate on. Supported values for cmd are: PFM_CREATE_CONTEXT perfmonctl(int fd, PFM_CREATE_CONTEXT, pfarg_context_t *ctxt, 1); Set up a context. The fd parameter is ignored. A new perfmon context is created as specified in ctxt and its file descriptor is returned in ctxt->ctx_fd. The file descriptor can be used in subsequent calls to perfmonctl() and can be used to read event notifications (type pfm_msg_t) using read(2). The file descriptor is pollable using select(2), poll(2), and epoll(7). The context can be destroyed by calling close(2) on the file descriptor. PFM_WRITE_PMCS perfmonctl(int fd, PFM_WRITE_PMCS, pfarg_reg_t *pmcs, n); Set PMC registers. PFM_WRITE_PMDS perfmonctl(int fd, PFM_WRITE_PMDS, pfarg_reg_t *pmds, n); Set PMD registers. PFM_READ_PMDS perfmonctl(int fd, PFM_READ_PMDS, pfarg_reg_t *pmds, n); Read PMD registers. PFM_START perfmonctl(int fd, PFM_START, NULL, 0); Start monitoring. PFM_STOP perfmonctl(int fd, PFM_STOP, NULL, 0); Stop monitoring. PFM_LOAD_CONTEXT perfmonctl(int fd, PFM_LOAD_CONTEXT, pfarg_load_t *largs, 1); Attach the context to a thread. PFM_UNLOAD_CONTEXT perfmonctl(int fd, PFM_UNLOAD_CONTEXT, NULL, 0); Detach the context from a thread. PFM_RESTART perfmonctl(int fd, PFM_RESTART, NULL, 0); Restart monitoring after receiving an overflow notification. PFM_GET_FEATURES perfmonctl(int fd, PFM_GET_FEATURES, pfarg_features_t *arg, 1); PFM_DEBUG perfmonctl(int fd, PFM_DEBUG, val, 0); If val is nonzero, enable debugging mode, otherwise disable. PFM_GET_PMC_RESET_VAL perfmonctl(int fd, PFM_GET_PMC_RESET_VAL, pfarg_reg_t *req, n); Reset PMC registers to default values. RETURN VALUE
perfmonctl() returns zero when the operation is successful. On error, -1 is returned and errno is set to indicate the cause of the error. VERSIONS
perfmonctl() is available since Linux 2.4. CONFORMING TO
perfmonctl() is Linux-specific and is available only on the IA-64 architecture. NOTES
Glibc does not provide a wrapper for this system call; call it using syscall(2). SEE ALSO
gprof(1) The perfmon2 interface specification COLOPHON
This page is part of release 4.15 of the Linux man-pages project. A description of the project, information about reporting bugs, and the latest version of this page, can be found at https://www.kernel.org/doc/man-pages/. Linux 2017-09-15 PERFMONCTL(2)
All times are GMT -4. The time now is 04:39 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy