12-18-2012
This works like a charm with the sample data, but with the actual data it is taking forever, ...40 mins and it hasn't written a single output row..i guess i will have to wait it out....thanks again...
if itsnt much trouble, is there a more efficient way?
---------- Post updated at 09:29 AM ---------- Previous update was at 02:38 AM ----------
Update : 6 hours in , still no output lines, the data code and the code are fine...
just that the data is too big , 22 gigs to be precise.
any suggestions on how to speed things up?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
Can any one help me how to create folders using shellscript.My requirement is:
FolderName: Main/Main1
:Main/Main2
:Main/Main3
underSubFolder : Main1/A
:Main1/B
:Main1/C
underSubfolder: A/A1
... (2 Replies)
Discussion started by: ram2s2001
2 Replies
2. Shell Programming and Scripting
I would like to know if there is a script out there that someone may have already written that I can use to analyze folders and sub folders on my AIX system.
It can be in perl or a basic korn script.
Thanks in advance. (7 Replies)
Discussion started by: seacros
7 Replies
3. UNIX for Advanced & Expert Users
HI,
I have the following command that shows me the total size of folders and subfolders :
du -hs *| sort -n
result:
1.0M sandeep
1.4G sandy
1.4M important
1.6M files
but I will need to know the size of folders and its subfolders( not size of individual files though)... (5 Replies)
Discussion started by: bsandeep_80
5 Replies
4. Windows & DOS: Issues & Discussions
Sir
From a unix machine some folders and their folders have to be copied to windows XP PC. Please help me with a batch file or a shell script. I am new to the the shell and batch files. Thanks in anticipation.
sastry (3 Replies)
Discussion started by: chssastry
3 Replies
5. Shell Programming and Scripting
Hi,
I need help in writing a script to search a particular text in multiple files present in folders and sub folders and replace it with another string which also has special characters like '&', '|', etc.. I know sed command will be used to replace the text but i'm not sure how to use it for... (5 Replies)
Discussion started by: Asheesh
5 Replies
6. Shell Programming and Scripting
Hi Unix Gurus,
I am able to copy only files that exist in the parent folder. My parent folder has sub folders and within sub folders there are lots files.
I need to copy folder, sub folders and files from Unix to the remote windows SFTP location.
The directory structure is something like... (1 Reply)
Discussion started by: shankar1dada
1 Replies
7. Ubuntu
Hi all, I'm a newbie in shell scripting and currently I'm trying to create a matrix using bash. The Output will look like this
AB CDE FG
1
2
3
4
5
6
7
I'm stuck on the ABCDEFG display.
printFlightSeats()
{
rows=7
columns=7
for ((i=0;i<=$rows;i++))
do (0 Replies)
Discussion started by: vinzping
0 Replies
8. Shell Programming and Scripting
Hi,
I need a script/command to list out all the files in current path and also the files in folder and subfolders.
Ex: My files are like below
$ ls -lrt
total 8
-rw-r--r-- 1 abc users 419 May 25 10:27 abcd.xml
drwxr-xr-x 3 abc users 4096 May 25 10:28 TEST
$
Under TEST, there are... (2 Replies)
Discussion started by: divya bandipotu
2 Replies
9. Shell Programming and Scripting
I am trying to move specific folders and subfolders within a directory using the below. I can see the folders to move and they are at the location, but I am getting an error. Thank you :).
mv -v /home/cmccabe/Desktop/NGS/API/6-10-2016{bam/{validation,coverage},bedtools /media/cmccabe/"My... (6 Replies)
Discussion started by: cmccabe
6 Replies
10. UNIX for Beginners Questions & Answers
Hi there!
I'm new to Unix and haven't done command line stuff since MS-Dos and Turbo Pascal (hah!),
I would love some help figuring out this basic command (what I assume is basic).
I'd like to add a User to the permissions of all files in a folder and all files in all subfolders, as well... (9 Replies)
Discussion started by: Janjbrt
9 Replies
LEARN ABOUT OPENDARWIN
od
OD(1) User Commands OD(1)
NAME
od - dump files in octal and other formats
SYNOPSIS
od [OPTION]... [FILE]...
od [-abcdfilosx]... [FILE] [[+]OFFSET[.][b]]
od --traditional [OPTION]... [FILE] [[+]OFFSET[.][b] [+][LABEL][.][b]]
DESCRIPTION
Write an unambiguous representation, octal bytes by default, of FILE to standard output. With more than one FILE argument, concatenate
them in the listed order to form the input.
With no FILE, or when FILE is -, read standard input.
If first and second call formats both apply, the second format is assumed if the last operand begins with + or (if there are 2 operands) a
digit. An OFFSET operand means -j OFFSET. LABEL is the pseudo-address at first byte printed, incremented when dump is progressing. For
OFFSET and LABEL, a 0x or 0X prefix indicates hexadecimal; suffixes may be . for octal and b for multiply by 512.
Mandatory arguments to long options are mandatory for short options too.
-A, --address-radix=RADIX
output format for file offsets; RADIX is one of [doxn], for Decimal, Octal, Hex or None
--endian={big|little}
swap input bytes according the specified order
-j, --skip-bytes=BYTES
skip BYTES input bytes first
-N, --read-bytes=BYTES
limit dump to BYTES input bytes
-S BYTES, --strings[=BYTES]
output strings of at least BYTES graphic chars; 3 is implied when BYTES is not specified
-t, --format=TYPE
select output format or formats
-v, --output-duplicates
do not use * to mark line suppression
-w[BYTES], --width[=BYTES]
output BYTES bytes per output line; 32 is implied when BYTES is not specified
--traditional
accept arguments in third form above
--help display this help and exit
--version
output version information and exit
Traditional format specifications may be intermixed; they accumulate:
-a same as -t a, select named characters, ignoring high-order bit
-b same as -t o1, select octal bytes
-c same as -t c, select printable characters or backslash escapes
-d same as -t u2, select unsigned decimal 2-byte units
-f same as -t fF, select floats
-i same as -t dI, select decimal ints
-l same as -t dL, select decimal longs
-o same as -t o2, select octal 2-byte units
-s same as -t d2, select decimal 2-byte units
-x same as -t x2, select hexadecimal 2-byte units
TYPE is made up of one or more of these specifications:
a named character, ignoring high-order bit
c printable character or backslash escape
d[SIZE]
signed decimal, SIZE bytes per integer
f[SIZE]
floating point, SIZE bytes per float
o[SIZE]
octal, SIZE bytes per integer
u[SIZE]
unsigned decimal, SIZE bytes per integer
x[SIZE]
hexadecimal, SIZE bytes per integer
SIZE is a number. For TYPE in [doux], SIZE may also be C for sizeof(char), S for sizeof(short), I for sizeof(int) or L for sizeof(long).
If TYPE is f, SIZE may also be F for sizeof(float), D for sizeof(double) or L for sizeof(long double).
Adding a z suffix to any type displays printable characters at the end of each output line.
BYTES is hex with 0x or 0X prefix, and may have a multiplier suffix:
b 512
KB 1000
K 1024
MB 1000*1000
M 1024*1024
and so on for G, T, P, E, Z, Y.
EXAMPLES
od -A x -t x1z -v
Display hexdump format output
od -A o -t oS -w16
The default output format used by od
AUTHOR
Written by Jim Meyering.
REPORTING BUGS
GNU coreutils online help: <http://www.gnu.org/software/coreutils/>
Report od translation bugs to <http://translationproject.org/team/>
COPYRIGHT
Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
SEE ALSO
Full documentation at: <http://www.gnu.org/software/coreutils/od>
or available locally via: info '(coreutils) od invocation'
GNU coreutils 8.28 January 2018 OD(1)