Sponsored Content
Top Forums Shell Programming and Scripting How to replace all but the first 3 characters with sed? Post 302935121 by disedorgue on Thursday 12th of February 2015 06:09:03 PM
Old 02-12-2015
Ok, I understand better, so here:

Time reference:
Code:
time awk '{x=substr($0,N+1); gsub(".","*",x); print substr($0,1,N) x}' N=3 file1 > /dev/null
real	0m0.038s
user	0m0.037s
sys	0m0.000s

The better such as wisecracker:
Code:
time { while read ; do X="${REPLY:3}" ; echo "${REPLY:0:3}${X//?/*}" ;done <file1 >/dev/null ;}
real	0m0.177s
user	0m0.163s
sys	0m0.013s

My part (for fun because use a lot of memory and slower previous):
Code:
time { F(){ set -- "${2:3}" "${2:0:3}" ; echo "$2${1//?/*}" ;} ; mapfile -c 1 -C F <file1 >/dev/null ;} 
real	0m0.286s
user	0m0.280s
sys	0m0.000s

Of sea (really slow):
Code:
time { while read line; do len=${#line} ; [ $len -gt 3 ] && len=$(( $len - 3)); tmp="$(printf '%*s' $len|sed s,\ ,*,g)"; echo "${line:0:3}${tmp}"; done<file1 >/dev/null;}
real	0m27.940s
user	0m12.867s
sys	0m1.340s

And a perl version seems faster that awk:
Code:
time perl -ne 'print substr($_,0,3)."*"x(length()-4)."\n"' file1 >/dev/null 
real	0m0.014s
user	0m0.010s
sys	0m0.000s

Regards.

Last edited by disedorgue; 02-12-2015 at 07:14 PM.. Reason: Replace in perl version length()-3 by length()-4
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to replace control characters using sed?

How can I use sed to replace a ctrl character such as 'new line' (\0a) to something else? Or any other good command can do this job? Thanks, Hillxy (5 Replies)
Discussion started by: hillxy
5 Replies

2. Shell Programming and Scripting

Sed replace characters not equal to an expression

Hi all, Suppose I have a file with the contents below, and I only want to print words %S_ then | sort -u. ------------------------------ The %S_MSG that starts with '%.*s' is too long. Maximum length is %d. The %S_MSG name '%.*s' contains more than the maximum number of prefixes. The... (5 Replies)
Discussion started by: poldo
5 Replies

3. Shell Programming and Scripting

Using sed to replace special characters

Hi everyone I have file1 contains: '7832' ' 8765 6543 I want a sed command that will format as: '7832' , '8765' , '6543' I tried sed -e s/\'//g -e 's/^*//;s/*$//' file1 > file2 sed -e :a -e '$!N; s/\n/ /; ta' file2 which gives: 7832 8765 6543 I need some help to continue with... (5 Replies)
Discussion started by: nimo
5 Replies

4. Shell Programming and Scripting

Bash: using SED, trying to replace some characters except first or last line

Hi, I require to replace 2 items: 1. replace start of all lines in a file with ' except the first line 2. replace end of all lines in a file with '||chr( except last line I am able to do the entire file using sed -e s/^/\'/g -e s/$/\'\|\|chr\(/g "$file" > newfile.txt but am not yet able... (0 Replies)
Discussion started by: Chella15
0 Replies

5. UNIX for Dummies Questions & Answers

Bash: using SED, trying to replace some characters except first or last line

Hi, I require to replace 2 items: 1. replace start of all lines in a file with ' except the first line 2. replace end of all lines in a file with '||chr( except last line I am able to do the entire file using sed -e s/^/\'/g -e s/$/\'\|\|chr\(/g "$file" > newfile.txt but am not yet... (3 Replies)
Discussion started by: Chella15
3 Replies

6. Shell Programming and Scripting

sed replace range of characters in each line

Hi, I'm trying to replace a range of characters by their position in each line by spaces. I need to replace characters 95 to 145 by spaces in each line. i tried below but it doesn't work sed -r "s/^(.{94})(.{51})/\ /" inputfile.txt > outputfile.txt can someone please help me... (3 Replies)
Discussion started by: Kevin Tivoli
3 Replies

7. Shell Programming and Scripting

Replace characters infile with sed

I have several files in a directory that look like this: jacket-n r potential-n - outcome-n f reputation-n b I want to replace the characters in the second column with certain numbers. For instance, I want the letters 'f', 'r' and 'b' in the second column to replaced with 0 and I want the... (1 Reply)
Discussion started by: owwow14
1 Replies

8. Shell Programming and Scripting

sed replace nth characters with string

Hi, I hope you can help me out please? I need to replace from character 8-16 with AAAAAAAA and the rest should stay the same after character 16 gtwrhtrd11111111rjytwyejtyjejetjyetgeaEHT wrehrhw22222222hytekutkyukrylryilruilrGEQTH hrwjyety33333333gtrhwrjrgkreglqeriugn;RUGNEURGU ... (4 Replies)
Discussion started by: stinkefisch
4 Replies

9. Shell Programming and Scripting

sed replace characters using a wildcard

Hello, I have some data that looks like the following, > <SALTDATA> (OVS0199262) HCl > <IDNUMBER> (OVS0199262) OVS0199262 > <SUPPLIER> (OVS0199262) TimTec > <EMAIL> (OVS0199262) info@timtec.net > <WEBSITE> (OVS0199262) http://www.timtec.net I need to remove the data in... (3 Replies)
Discussion started by: LMHmedchem
3 Replies

10. Shell Programming and Scripting

sed command on AIX, replace specific characters

Hi, Im using sed on an AIX machine. I am trying to change the 137-139 characters if they are a ' 36'/'000' to a '036'. The positions that need to be changed are fixed. the source data that I have is$cat v.txt 4000422985400050462239065593606500000007422985707771046154054910075641MC0318AMWAY... (9 Replies)
Discussion started by: dsid
9 Replies
File::Path::Tiny(3pm)					User Contributed Perl Documentation				     File::Path::Tiny(3pm)

NAME
File::Path::Tiny - recursive versions of mkdir() and rmdir() without as much overhead as File::Path VERSION
This document describes File::Path::Tiny version 0.3 SYNOPSIS
use File::Path::Tiny; if(!File::Path::Tiny::mk($path)) { die "Could not make path '$path': $!"; } if(!File::Path::Tiny::rm($path)) { die "Could not remove path '$path': $!"; } DESCRIPTION
The goal here is simply to provide recursive versions of mkdir() and rmdir() with as little code and overhead as possible. This module is in no way meant to derogate File::Path and is in no way an endorsement to go out and replace all use of File::Path with File::Path::Tiny. File::Path is very good at what it does but there's simply a lot happening that we can do without much of the time. Here are some things File::Path has/does that this module attempts to do without: o multiple interfaces Backwards compatibility brings in a lot of code and logic that we don't need from here on out. o chdir's It does a ton of chdir's which could leave you somewhere you're not planning on being and requires much more overhead to do. o can croak not allowing you to detect and handle failure Just let me handle errors how I want. Don't make my entire app die or have to wrap it in an eval o A well intentioned output system Just let me do the output how I want. (Nothing, As HTML, print to a filehandle, etc...) o A well intentioned and experimental (IE subject to change) error handling system. Just keep it simple and detect failure via a boolean check and do what I want with the error. See "How can I make/remove multiple paths?" o According to its POD, removing a tree is apparently not safe unless you tell it to be with the 'safe' or 'keep_root' attributes. Seems like that should just happen, I don't want to worry about accidentally removing / when I pass it /tmp INTERFACE
Nothing in exported or exportable, that helps keep it '::Tiny'. File::Path::Tiny::mk() Takes a single path (like mkdir()) to recursively create and, optionally, a mask (like mkdir()) for all subsequent mkdir() calls. Mask defaults to 0700 (also like mkdir()) Returns false if it could not be made, true otherwise (returns '2' if it is -d already) It is recursive in the sense that given foo/bar/baz as the path to create all 3 will be created if necessary. File::Path::Tiny::rm() Takes a single path (like rmdir()) to recursively empty and remove. Returns false if it could not be emptied or removed, true otherwise. (returns '2' if it is !-d already) It is recursive in the sense that given /foo/bar/baz as the path to remove it will recursively empty 'baz' and then remove it from /foo/bar. Its parents, /, /foo, and /foo/bar are *not* touched. File::Path::Tiny::empty_dir() Takes a single path to recursively empty but not remove. Returns false when there is a problem. DIAGNOSTICS
Throws no warnings or errors of its own If the functions ever return false, $! will have been set either explicitly or by the mkdir(), rmdir(), unlink(), or opendir() that ultimately returned false. MISC
How can I make/remove multiple paths? For simplicity sake && ::Tiny status this module must be very very very simple. That said it is also very simple to do muliple paths: for my $path (@paths) { File::Path::Tiny::::mk($path) or _my_handle_failed_mk($path, $!); } for my $path (@paths) { File::Path::Tiny::::rm($path) or _my_handle_failed_rm($path, $!); } That also lets you keep going or short circuit it or handle errors however you like: PATH: for my $path qw(foo/bar bar/rat) { if (!File::Path::Tiny::mk($path)) { print "problem unlinking '$path': $! "; last PATH; } else { print "No error encountered with '$path' " } } About the '::Tiny' status See Acme::Tiny for information on the ::Tiny suffix. #3 is almost there (< 1/5th +/-), a bit more trimming and I think we'll have it! #8 is N/A since part of the "sub set" is to do single paths like their non-recursive core counterparts and there are so many ways to invoke it with different consequences [ -- RSS Memory -- ] Baseline perl 1168 File::Path 1808 (+640) File::Path::Tiny 1288 (+120) Even though "time" isn't really a ::Tiny factor, it does improve loading a bit: [ -- time -- ] Baseline perl real 0m0.007s user 0m0.002s sys 0m0.004s File::Path real 0m0.017s user 0m0.011s sys 0m0.005s File::Path::Tiny real 0m0.007s user 0m0.003s sys 0m0.004s As time allows and more tests are added I'll try to include more comprehensive benchmark results. How do I make sure the path is safe to create or remove? Of course the answer depends on what you mean by "safe". This module makes no assumptions on interpreting the "safeness" of a path, just like mkdir() and rmdir(). Also like mkdir() and rmdir() typically you'll find that filesystem permissions are a pretty reliable tool (of course if the code will be run as root you would want to setuid first...) You might use Cwd::abs_path() to sanitize a path before sending it to be made or removed. Even after that it might not be "safe" so you'll need to discern what your particular definition of "safe" is and take appropriate action. DEPENDENCIES
File::Spec of course but its only loaded if needed INCOMPATIBILITIES
None reported. BUGS AND LIMITATIONS
No bugs have been reported. Please report any bugs or feature requests to "bug-file-path-tiny@rt.cpan.org", or through the web interface at <http://rt.cpan.org>. AUTHOR
Daniel Muey "<http://drmuey.com/cpan_contact.pl>" LICENCE AND COPYRIGHT
Copyright (c) 2008, Daniel Muey "<http://drmuey.com/cpan_contact.pl>". All rights reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic. DISCLAIMER OF WARRANTY
BECAUSE THIS SOFTWARE IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE SOFTWARE, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE SOFTWARE "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE SOFTWARE IS WITH YOU. SHOULD THE SOFTWARE PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR, OR CORRECTION. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE SOFTWARE AS PERMITTED BY THE ABOVE LICENCE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE SOFTWARE (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE SOFTWARE TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. perl v5.14.2 2012-04-04 File::Path::Tiny(3pm)
All times are GMT -4. The time now is 06:43 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy