@ Chubler_XL
You are abolutely right. I was only using the provided data.
This might work for the situation you presented... sed -i "$lines s/\b$kee2/$repl/g" trydata1
I'll do the edit.
But that still doesn't cure the 'other columns' bit, does it?
---------- Post updated at 07:15 PM ---------- Previous update was at 04:22 PM ----------
The theory here is to reduce disk reads by a margin.
Disk writes can't be helped unless one builds a file
in memory and writes it out all at once.
Bash speed just is what it is...and so is my skill set.
Your AWK example is 9 times faster on my machine! That's BIG!
Code:
#!/bin/bash
# Load both data files into memory
< trydata1 mapfile data1
< trydata2 mapfile data2
for f1 in ${data1[*]};
do
lines=$(( $lines + 1 ))
kee2=$(echo $f1 | cut -d, -f4)
for val2 in ${data2[*]};
do
if [[ $val2 =~ ^$kee2 ]]; then
repl=${val2##*,}
sed -i "$lines s/\b$kee2/$repl/g" trydata1
fi
done
done
cat trydata1
# Using this data set with no column issues...
# ----------------------
# xyz,122,913,opq,876
# rst,956,921,xyz,012
# 456,890,903,rst,467
# 000,5xyz1,000,xyz,000
# 4567,5rst1,opq,xyz,000
# rst,5opq1,rst,02opq,000
# 000,5xyz1,xyz,opq,000
# real 0m0.028s
# user 0m0.008s
# sys 0m0.009s
# On a machine running @ 2GHz
# If my math is right...
# 0.028 seconds to process 7 lines
# time to process 30,000 lines ~ 2 minutes
hi,
i want to create a script that will search and replace the values inside a particular file. i have 5 files that i need to change some values inside and i don't want to use vi to edit these files. All the inputted values on the script below will be passed into the files.
cho ""
echo... (3 Replies)
I have a rather complicated search and replace I need to do among several dozen files and over a hundred occurrences. My site is written in PHP and throughout the old code, you will find things like
die("Operation Aborted due to.....");
For my new design skins for the site, I need to get... (2 Replies)
This should be somewhat simple, but I need some help with this one.
I have a bunch of files with tags on the end like so...
Filename {tag1}.ext
Filename2 {tag1} {tag2}.ext
I want to hold in a variable just the filename with all the " {tag}" removed. The tag can be anything so I'm looking... (4 Replies)
Hi,
I have to write one script that has to search a list of numbers in certain zipped files.
For eg. one file file1.txt contains the numbers. File1.txt contains 5,00,000 numbers and I have to search each number in zipped files(The number of zipped files are around 1000 each file is 5 MB)
I have... (10 Replies)
I have two lists in a file that look like
a b
b a
e f
c d
f e
d c
I would like a final list
a b
c d
e f
I've tried multiple grep and awk but can't get it to work (8 Replies)
Hi,
I tried to search multiple pattern using awk
trans=1234
reason=LN MISMATCH
rec=`awk '/$trans/ && /'"$reason"'/' file`
whenevr i tried to run on command promt it is executing but when i tried to implment same logic in shell script,it is failing i.e $rec is empty
... (6 Replies)
If U have a question
if a file is
33 ABC 276 LRR pir UJU
45 BCD 777 HIGH pred IJJ
67 BGH 66 LRR_1 prcc KIK
77 GYH 88 LOW pol KKK
perl -lne '$a++ if /LRR/,/LOW/, /HIGH/; END {print $a+0}' (2 Replies)
Hi All,
I am starting a service which will redirect its out put into 2 logs say A and B.
Now for succesful startup of the service i need to search pattern1 in log A and pattern2 in log B which are writen continuosly.
Now my requirement is to find the patterns in the increasing logs A and B... (19 Replies)
Hi Team
I have the following text in one of the file
j1738-abc-system_id(in.value1)-2838 G566-deF-system_id(in.value2)-7489
I want to remove system_id(...) combination completely The output should look like this
j1738-abc-in.value1-2838 G566-deF-in.value2-7489
Any help is appreciated... (4 Replies)
Hi,
I have scenario like below and need to search for multiple patterns
Eg:
Test
Time Started= secs
Time Ended = secc
Green test
Test
Time Started= secs
Time Ended = secc
Green test
Output:
I need to display the text starting with Test and starting with Time... (2 Replies)
Discussion started by: weknowd
2 Replies
LEARN ABOUT DEBIAN
byteprefix
BYTEPREFIX(5) File Formats Manual BYTEPREFIX(5)NAME
byteprefix - Configuration for display of sizes
DESCRIPTION
There are two standard ways to use units in computing: base 10 (1 k = 10^3 = 1 000) and base 2 (1 K = 2^10 = 1 024). Historically, most
computer programs have used units in base 2, where 1 KB = 1 024 bytes, 1 MB = 1 048 576 bytes, etc. However, users are more likely to
expect and understand sizes in base 10, as this is the norm outside of computing.
This configuration file is a method for configuring programs (that use libkibi) to display sizes in the user's preferred style. It can be
configured through a configuration file or environment variable (which takes precedence).
When not using the "historic" style, IEC-style prefixes (KiB, MiB, etc.) are used for base 2 units, to disambiguate them from base 10 units
(kB, MB, etc.).
OPTIONS
There are three possible styles (Default: base10):
base2 Display all sizes in Base 2 with IEC prefixes.
1 KiB = 1 024 bytes.
1 MiB = 1 024 KiB = 1 048 576 bytes.
1 GiB = 1 024 MiB = 1 048 576 KiB = 1 073 741 824 bytes.
base10 Display all sizes in Base 10, except for sizes of RAM, which use base 2 with IEC prefixes.
Everything except RAM:
1 kB = 1 000 bytes.
1 MB = 1 000 kB = 1 000 000 bytes.
1 GB = 1 000 MB = 1 000 000 kB = 1 000 000 000 bytes.
RAM:
1 KiB = 1 024 bytes.
1 MiB = 1 024 KiB = 1 048 576 bytes.
1 GiB = 1 024 MiB = 1 048 576 KiB = 1 073 741 824 bytes.
historic
Display all sizes in Base 2, without IEC prefixes.
1 KB = 1 024 bytes.
1 MB = 1 024 KB = 1 048 576 bytes.
1 GB = 1 024 MB = 1 048 576 KB = 1 073 741 824 bytes.
Not recommended. This style uses base units 2 with prefixes usually associated with base 10 units. While it uses KB rather than the
SI (base 10) kB, there is no such distinction beyond the kilobyte range, and the units are ambiguous.
ENVIRONMENT
BYTEPREFIX
This environment variable will override the configured or default style. It should just contain one of the style names, listed in
OPTIONS above.
XDG_CONFIG_HOME
The location of the user's configuration files. If not set, it will be assumed to be ~/.config.
FILES
The preferred style can be set in a system-wide configuration file and/or in user's own configuration file (which will take precedence).
If no configuration file exists, the default style is base10.
/etc/byteprefix or XDG_CONFIG_HOME/byteprefix
This file should contain a single line: format=style. Lines beginning with # are treated as comments.
EXAMPLE
A user wanting base 2 display can set the following in ~/.config/byteprefix:
format=base2
SEE ALSO units(7)libkibi January 2011 BYTEPREFIX(5)
11-26-2014
