I will assume that you already made a pipe file with something like mknod /$PIPEDIR/nvpipe p however I would be concerned that you have no idea which thread is reading the (now) input at any time.
You might find that the first reading process locks up the pipe, I'm not sure. It might be more sensible to ignore the pipe altogether and do something more like this:-
Split metadata.csv into 30 roughly equal files
Fire off 30 processes that read a separate input file each to do whatever processing you need
If you can get the number of lines in your file, you should be able to get the require line-count like this:-
Code:
#!/bin/bash
threads=30 # How many threads you want to work with
all_lines=$(wc -l < metadata.csv) # Count all the lines in your full input file
req_lines=$(printf $all_lines / $threads +1 | bc # Get the lines required in each split file
# Rules of BIDMAS apply so the 1 is added after the divide
split -ld $req_lines metadata.csv metadata. # Note the trailing dot. This will generate $threads files
# of up to $req_lines each in the format metadata.nn
# so up to 100 threads if you choose
for split_file in metadata.??
do
( while IFS=',' read DIR1 DIR2
do
printf "Start at $(date)\n"
${COMPUSETBIN}/prg1.sh prg2.sh $DIR1 $DIR2
printf "Ending at $(date)\n"
printf "++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++\n"
done < $split_file
done ) &
wait # All threads must complete before this script will exit
It's untested, but does it get you started a bit better?
Probably there are better ways to do this in a single awk. What does your prg1.sh & prg2.sh actually do?
Hi
I have apeculiar problem with sockets.
I have a shared object for my client program.
when I send a request to the server, it is suppose to process and sends back the result string to the client.
For the first request, it is working fine i.e. client sends the req. and gets the... (1 Reply)
Hi,
I am trying to test the exit status of the cleartool lsvtree statement below, but it doesn't seem to be working due to the tail pipe, which it is testing instead. Is there a way around this without adding a tonne of new code?
cleartool lsvtree $testlocation/$exe_name | tail -15
... (10 Replies)
I have a question about how to get the exit code of the first command when it appears in a pipe-lined command.
For example, I have the following script:
grep abc dddd | tee -a log
if ]
then
echo "ERROR!"
fi
In the above script, ] is supposed to test the exit code of "grep abc... (3 Replies)
Hi all,
Does anybody know or guide me on how to remove the first N bytes and the last N bytes from a binary file? Is there any AWK or SED or any command that I can use to achieve this?
Your help is greatly appreciated!!
Best Regards,
Naveen. (1 Reply)
Hi,
If I want to copy a 1024 byte data stream in to the target location in 3-bytes chunk, I guess I can use the following script.
dd bs=1024 count=3 if=/src of=/dest
But, I would like to know, how to do it via a C program. I have tried this with memcpy(), that did not help. (3 Replies)
Guys, I have a problem :confused: and I need some help:
I've to process many huge zip files.
I'd code an application that receive the data from a pipe, so I can simple unzip the data and send it (via pipe) to my app.
Something like that:
gzip -dc <file> | app
The problem is: How can I... (7 Replies)
Hello guys. I really hope someone will help me with this one..
So, I have to write this script who:
- creates a file home/student/vmdisk of 10 mb
- formats that file to ext3
- mounts that partition to /mnt/partition
- creates a file /mnt/partition/data. In this file, there will... (1 Reply)
hello,
suppose, entered input is of 1-40 bytes, i need it to be converted to 40 bytes exactly.
example: if i have entered my name anywhere between 1-40 i want it to be stored with 40 bytes exactly.
enter your name:
donald duck (this is of 11 bytes)
expected is as below - display 11... (3 Replies)
Hi expert,
How do i exit to while read, below is the script.
I need to exit after execute echo or command.
or any scripts that can search two patterns and if they found any patterns execute the command and exit.
Thanks a lot..
tail -fn0 /tmp/test.log | \
while read line ; do
... (12 Replies)
I have created a fifo named pipe in solaris, which writes the content of a file, line by line, into pipe as below:
$ mkfifo namepipe
$ cat books.txt
"how to write unix code"
"how to write oracle code"
$ cat books.txt >> namepipe &
I have a readpipe.sh script which reads the named... (2 Replies)
Discussion started by: naveen mani
2 Replies
LEARN ABOUT OSX
set_color
set_color(1) fish set_color(1)NAME
set_color - set_color - set the terminal color
set_color - set the terminal color
Synopsis
set_color [-v --version] [-h --help] [-b --background COLOR] [COLOR]
Description
Change the foreground and/or background color of the terminal. COLOR is one of black, red, green, brown, yellow, blue, magenta, purple,
cyan, white and normal.
o -b, --background Set the background color
o -c, --print-colors Prints a list of all valid color names
o -h, --help Display help message and exit
o -o, --bold Set bold or extra bright mode
o -u, --underline Set underlined mode
o -v, --version Display version and exit
Calling set_color normal will set the terminal color to whatever is the default color of the terminal.
Some terminals use the --bold escape sequence to switch to a brighter color set. On such terminals, set_color white will result in a grey
font color, while set_color --bold white will result in a white font color.
Not all terminal emulators support all these features. This is not a bug in set_color but a missing feature in the terminal emulator.
set_color uses the terminfo database to look up how to change terminal colors on whatever terminal is in use. Some systems have old and
incomplete terminfo databases, and may lack color information for terminals that support it. Download and install the latest version of
ncurses and recompile fish against it in order to fix this issue.
Version 1.23.1 Sun Jan 8 2012 set_color(1)