Combine two arrays. for in for ?..


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers Combine two arrays. for in for ?..
# 1  
Old 01-07-2020
Combine two arrays. for in for ?..

Hello all,
I have 2 very long list of elements. f.e.:

List 1
Code:
1 2 3 4 5

List 2
Code:
a b c

How can I combine the two with other. Like this:

Code:
1 a
1 b
1 c
2 a
2 b
2 c
3 a

etc.

Thank you in advance!

I made such construction, but it works very slowSmilie

Code:
declare -a itemid=($(cat ITEMID.txt))
declare -a elementen=($(cat elementen.txt))

for i in ${elementen[@]}
	do 
		for b in ${itemid[@]}
			do
				db2 -x "select DOCID from ICMADMIN."$i" where ITEMID='"$b"'" && echo "$i"
		done
done


Last edited by rbatte1; 01-07-2020 at 01:59 PM..
# 2  
Old 01-07-2020
You can save half of the memory by not storing in arrays.
Code:
set -f # for safety: no filename generation
for i in $(cat elementen.txt)
do 
  for b in $(cat ITEMID.txt)
  do
    db2 -x "select DOCID from ICMADMIN."$i" where ITEMID='"$b"'" && echo "$i"
  done
done

bash even allows to replace $(cat ...) with $(< ...).
This User Gave Thanks to MadeInGermany For This Post:
# 3  
Old 01-07-2020
Hi
Code:
eval echo {$(tr ' ' , <ITEMID.txt)}{$(tr ' ' , <elementen.txt)} | fmt -1

--- Post updated at 17:50 ---

It's quite possible
Code:
eval echo {0..10}{$(tr ' ' , <file2)} | fmt -1

or even such
Code:
echo {1..5}{a..c} | fmt -1

--- Post updated at 17:58 ---

Code:
echo -n {1..5}{a..c} | xargs -d' ' -I{} echo {}

--- Post updated at 18:08 ---

I was wrong, did not pay attention to the command "db2"

--- Post updated at 18:37 ---

But continue, very interesting Smilie
Code:
eval echo {$(tr ' ' , <ITEMID.txt)}\' \'{$(tr ' ' , <elementen.txt)} | fold -w4 |
    while read i b; do
        db2 -x "select DOCID from ICMADMIN."$i" where ITEMID='"$b"'" && echo "$i"
    done

should change fold -w4 for grep -o '\w\+ \w\+'

Last edited by nezabudka; 01-07-2020 at 10:52 AM..
# 4  
Old 01-07-2020
How about trying, given your shell offers

- the mapfile command
- "here documents",


and db2 reads from stdin,



Code:
mapfile -td" " F1 < file1                                                                                               
mapfile -td" " F2 < file2                                                                                               
IFS=$'\n'
for i in ${F1[*]}
  do    db2 -x  <<< ${F2[*]/#/select DOCID from ICMADMIN.$i where ITEMID= }
  done
db2 -x
select DOCID from ICMADMIN.1 where ITEMID= a
select DOCID from ICMADMIN.1 where ITEMID= b
select DOCID from ICMADMIN.1 where ITEMID= c
db2 -x
select DOCID from ICMADMIN.2 where ITEMID= a
select DOCID from ICMADMIN.2 where ITEMID= b
select DOCID from ICMADMIN.2 where ITEMID= c
db2 -x
select DOCID from ICMADMIN.3 where ITEMID= a
select DOCID from ICMADMIN.3 where ITEMID= b
select DOCID from ICMADMIN.3 where ITEMID= c
db2 -x
select DOCID from ICMADMIN.4 where ITEMID= a
select DOCID from ICMADMIN.4 where ITEMID= b
select DOCID from ICMADMIN.4 where ITEMID= c
db2 -x
select DOCID from ICMADMIN.5 where ITEMID= a
select DOCID from ICMADMIN.5 where ITEMID= b
select DOCID from ICMADMIN.5 where ITEMID= c

This User Gave Thanks to RudiC For This Post:
# 5  
Old 01-07-2020
And I managed to throw out an extra command
Code:
eval echo -en "{$(tr ' ' , <file1)}' '{$(tr ' ' , <file2)}'\n'" |
    while read a b; do
        echo "$a $b"
    done

--- Post updated at 20:12 ---

Just how do I know the length of the string?
getconf LINE_MAX ?

--- Post updated at 20:22 ---

it yields out even with such a set
echo -en {1..30000}' '{a..z}'\n'

--- Post updated at 20:33 ---

Or this expression echo {1..5} does not expand into a string like this echo {1,2,3,4,5}

--- Post updated at 20:43 ---

issued all 30,000 lines
Code:
for((i=1;i<30000; i++)); do echo -n "$i "; done >file1
eval echo -en "{$(tr ' ' , <file1)}' '{a..z}'\n'" | while read a b; do echo "$a.$b."; done

Ok

--- Post updated at 21:38 ---

Code:
for i in $(eval echo {$(tr ' ' , <file1)}_{$(tr ' ' , <file2)}); do
    echo "index ${i%_*} value ${i#*_}"
done


Last edited by nezabudka; 01-07-2020 at 01:03 PM..
# 6  
Old 01-07-2020
I would think that you are spending a lot of time in your loop repeatedly opening the database connection. Could you build all the queries into a single command file and execute one DB read? The output could be caught to a file or into a variable and then processed further. You might need to add extra columns to the output so you can tell which is from which query if that's necessary.

Can you tell us more about the overall aim of the process and perhaps we can help you towards a more efficient solution. The variable names don't give much away. Perhaps more meaning ful names (even if it takes marginally longer to type) will be far clearer to understand later on.





Kind regards,
Robin
# 7  
Old 01-07-2020
Pertaining to post #1: Try:
Code:
join -12 -22 -o 1.1,2.1 <(xargs -n1 <file1) <(xargs -n1 <file2)

This User Gave Thanks to Scrutinizer For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Arrays

Am using bash For eg: Suppose i have a array arr=(1 2 3 4 5 6 7 8 9 10 11 12) suppose i give input 5 to a script and script should able to print values greater than or equal to 5 like below: Input: 5 output: 5,6,7,8,9,10,11,12 (7 Replies)
Discussion started by: manid
7 Replies

2. Shell Programming and Scripting

Using arrays?

I have never used arrays before but I have a script like this: var1=$(for i in $(cat /tmp/jobs.021013);do $LIST -job $i -all | perl -ne 'print /.*(\bInfo.bptm\(pid=\d{3,5}).*/' | tr -d "(Info=regpid" | tr -d ')'; $LIST -job $i -all | cut -f7 -d','| sed -e "s/^\(*\)\(*\)\(*\)\(.*\)/\1... (2 Replies)
Discussion started by: newbie2010
2 Replies

3. Programming

Arrays in C++

I've noticed something interesting in C++ programming. I've always done tricky stuff with pointers and references to have functions deal with arrays. Doing exercises again out of a C++ book has shown me an easier way, I didn't even know was there. It's weird to me. When dealing with arrays, it... (4 Replies)
Discussion started by: John Tate
4 Replies

4. Shell Programming and Scripting

How can I use the arrays ?

Hi all, I have a file test1.txt with the below contents abc def ghj xyz I tried printing these values using arrays. Script tried : =========== set -A array1 `cat test1.txt` count=${#array1 } i=0 while do echo "element of array $array1" done (1 Reply)
Discussion started by: dnam9917
1 Replies

5. Programming

question about int arrays and file pointer arrays

if i declare both but don't input any variables what values will the int array and file pointer array have on default, and if i want to reset any of the elements of both arrays to default, should i just set it to 0 or NULL or what? (1 Reply)
Discussion started by: omega666
1 Replies

6. Shell Programming and Scripting

bash: combine arrays with weird substitution/references

Hi all. I'm trying to finish a bash script with the following elements: ARRAY="blah $ITEM blah blah" ARRAY="blah blah $ITEM blah bluh" #ARRAY="...." # ...the ARRAY elements represent a variable but defined # syntax and they're all hard-coded in the script. #(...) ITEMS='1.0 2.3... (2 Replies)
Discussion started by: yomaya
2 Replies

7. Shell Programming and Scripting

combine

Hi I am having text file like this 001|ramu|hno221|>< sheshadripuram|delhi|560061>< 002|krishna|hno225|>< newdelhimain|delhi|560061>< i want to combine every two lines as single...line... i.e 001|ramu|hno221|sheshadripuram|delhi|560061 can u pls help me (3 Replies)
Discussion started by: suryanarayana
3 Replies

8. UNIX for Dummies Questions & Answers

arrays how to?

Hello, I am some what of a newbie to awk scripting and I seem to be struggling with this problem. I know I need to use arrays but I can't figure out how to use them. I have an input file that looks like this; Name,Team,First Test, Second Test, Third Test Crystal,Red,5,17,22... (1 Reply)
Discussion started by: vlopez
1 Replies

9. Web Development

PHP arrays in arrays

PHP question... I have an SQL query that's pulled back user IDs as a set of columns. Rather than IDs, I want to use their names. So I have an array of columns $col with values 1,7,3,12 etc and I've got an array $person with values "Fred", "Bert", "Tom" etc So what I want to do is display the... (3 Replies)
Discussion started by: JerryHone
3 Replies

10. Shell Programming and Scripting

Arrays

Dear all, How can i unset arrays. I mean all the subscripts including the array after using them. Could you direct me to some links of array memory handling in the korn shell. Thanks (2 Replies)
Discussion started by: earlysame55
2 Replies
Login or Register to Ask a Question