Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Replace randomly occurrences bash
Top Forums UNIX for Beginners Questions & Answers Replace randomly occurrences bash Post 303044397 by allabiba on Thursday 20th of February 2020 10:24:45 AM
Old 02-20-2020
1- I tried to turn text to one array and replace them something like this:
Code:
text=(
    a a a a a a a a a a
    a a a a a a a a a a
)
Get the number of items

number=${#text[@]}
Get half of it

half=$((number/2))
In a loop from 1 to the half of the text get random number and using it as index change item in text array

for i in $(seq $half); {
    rnd=$((RANDOM % (number-1)))
    text[$rnd]=b
}
Echo result

echo ${text[@]}

But this code doesn't keep the new line and echo all text in one line and my text is so big about 15 Gb and can't put it in one array.

2- Choose randomly from all occurrences of one word or token in the whole text.
simply can get number of repetition by something like this ( grep "a" | wc -l )

3- I can use python to do this but my text is huge and I want to use bash since it is faster than python. In python I use a set contains (a,b) and in replace function use a random function to choose (a or b) from that set.

4- I use Ubuntu 18.04, sed (GNU sed) 4.4, GNU Awk 4.1.4, API: 1.1 (GNU MPFR 4.0.1, GNU MP 6.1.2)

5- I simplify the problem, the main problem is that: I want to normalize a text corpus for training a tri-gram language model, in the language model, the sequence of words is important. I normalize the numbers to letters so for example, I convert all 30 to thirty but we use often half instead of thirty for reporting hour (e.g 8:30). I want to replace randomly things like this not whole of them.

best regards
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to select a value randomly

on my desktop i am using the kde rotating desktop image option. this rotates images randomly every half hour. now, i would like to write an html file which will have an inline frame with some text, maybe system messages, or my friends live journal thati read alot, or unix.com! however, i dont want... (1 Reply)
Discussion started by: norsk hedensk
1 Replies

2. UNIX for Dummies Questions & Answers

randomly renaming files

I have a directory of files that look like filename 001.ext, filename 002.ext, etc. I'd like to rename the files with unique random numbered names, so that the original filenames are stripped and the files are given a new, random number name. I'm not super new to UNIX, but I don't often use it for... (2 Replies)
Discussion started by: platz
2 Replies

3. Shell Programming and Scripting

sed replace multiple occurrences on the same line, but not all

Hi there! I am really enjoying working with sed. I am trying to come up with a sed command to replace some occurrences (not all) in the same line, for instance: I have a command which the output will be: 200.300.400.5 0A 0B 0C 01 02 03 being that the last 6 strings are actually one... (7 Replies)
Discussion started by: ppucci
7 Replies

4. Shell Programming and Scripting

awk and gsub - how to replace only the first X occurrences

I have a text (text.txt) and I would like to replace only the first 2 occurrences of a word (but I might need to replace more): For example, if text is this: CAR sweet head hat red yellow CAR book brown tiger CAR cow CAR CAR milk I would like to replace the word "CAR" with word... (12 Replies)
Discussion started by: bingel
12 Replies

5. Shell Programming and Scripting

Cron job randomly once a day

I want to create a cron job randomly once a day for my site's registration. The responsible file for registrations is a config file and I need to change the contents twice on day (on and off) I know the way for random cron job for example */n * * * * /usr/local/bin/php... (6 Replies)
Discussion started by: lucker
6 Replies

6. UNIX for Dummies Questions & Answers

Replace all occurrences of strings with parentheses

Hi, I tried to adapt bartus's solution to my problem, without success. I want to replace all the occurences of this: with: , where something can contain an arbitrary number of balanced parens and brakets. Any ideas ? Best, (1 Reply)
Discussion started by: ff1969ff1969
1 Replies

7. Programming

Java application dying randomly

Hi, (First post, please be gental!) I have a java app that I am running on unix (centos) But it keeps dying randomly. The times seem random from anything between 3 hours and 3 days. I have a cronjob running to restart it when ever it dies but I would rather this happened less often. ... (2 Replies)
Discussion started by: sm9ai
2 Replies

8. Shell Programming and Scripting

Get 20% of lines in File randomly

Hello, This is my code: nb_lignes=`wc -l $1 | cut -d " " -f1` for i in $(seq $nb_lignes) do m=`head $1 -n $i | tail -1` //command done Please how can i change it to get Get 20% of lines in File randomly to apply "command" on each line ? 20% or 40% or 60 % (it's a parameter) Thank you. (15 Replies)
Discussion started by: chercheur857
15 Replies

9. UNIX for Dummies Questions & Answers

BASH - Counting word occurrences in a Web Page

Hi all, I have to do a script bash (for university) that counts all word occurrences in a specific web page. anyone can help me?. Thanks :) (1 Reply)
Discussion started by: piacentero
1 Replies

10. Shell Programming and Scripting

Randomly create time in UNIX

Hey, How can i create randomly create time N times. Suppose i want to create data for a particualr date 5 times... Mon Jan 19 11:42:50 Mon Jan 19 19:16:40 Mon Jan 19 12:12:33 Mon Jan 19 14:26:27 Mon Jan 19 12:29:53 Mon Jan 19 13:30:31 I want the script to create N times randome... (2 Replies)
Discussion started by: jaituteja
2 Replies

LEARN ABOUT DEBIAN

ipcheck

IPCHECK(8)						  System Administration Utilities						IPCHECK(8)

NAME

       ipcheck - dyndns.org client

DESCRIPTION

       Usage  : ipcheck.py [options] Username Password Hostnames or	  ipcheck.py [options] --acctfile acct_info_file

       Options: -a address     manually specify the address

       -r URL NAT router, use web IP detection

       -A text
	      scan syslog for an IP after text (Unix only)

       -F filename
	      guess the WAN IP from a firewall log

       -b     backup mx option ON (default OFF)

       -c     custom dns option (default dynamic)

       -d dir directory for data files (default current)

       -e script
	      execute script after a successful update

       -f     force update regardless of current state

       -g     NAT router, let dyndns guess your IP (do not use this in a cronjob, try -r)

       -h     print this help text

       --help print all available help text

       -i interface
	      interface for local address (default ppp0)

       -j     disable https

       -l     log debugging text to ipcheck.log file

       --syslog
	      log debugging text to syslog (Unix only)

       -m mxhost
	      mx host (default NOCHG)

       -o     set dyndns offline mode

       -p     proxy bypass on port 8245

       -q     quiet mode (unless there is an error)

       -s     static dns option (default dynamic)

       -t     test run, do not send the update

       -v     verbose mode

       -w     wildcard mode ON (default OFF)

       --makedat
	      create the ipcheck.dat file by dns lookup

       --devices
	      print router options (Linksys, Netgear, etc)

       -n ip  the router IP address on the internal lan

       For  help  with different options: python ipcheck.py -h For supported devices listing  : python ipcheck.py --devices For long detailed help
       text    : python ipcheck.py --help

       Make sure you can write to the current directory for data files and that you always run from the same directory.  The first  time  you  run
       the  script,  you will be asked to run with the --makedat option in addition to any other options.  This will create the data files for the
       hostnames and options your specify on the command line.	You should only do this once.  Subsequent runs should be made without the  --make-
       dat option.

       For  help  with different options: python ipcheck.py -h For supported devices listing  : python ipcheck.py --devices For long detailed help
       text    : python ipcheck.py --help

       Example 1: the external IP is on eth0 of the current machine python ipcheck.py -l -i eth0 username password hostnames

       Example 2: you are using the Linksys routing device python ipcheck.py -l -L linksyspassword username password hostnames

       Example 3: you want to use web based ip detection python ipcheck.py -l -r checkip.dyndns.org:8245 ...

       where ... is your dyndns username password and hostnames.  Hostnames should be comma delimited if there are more than one.

Debian GNU/Linux						   January 2012 							IPCHECK(8)
All times are GMT -4. The time now is 02:41 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy