11-03-2013
Thanks! I'm checking for format issues in the input files!
---------- Post updated at 08:22 PM ---------- Previous update was at 04:18 PM ----------
Still can't get it working
With 40 lines things run smoothly but with 45000 lines - invain.
---------- Post updated at 08:27 PM ---------- Previous update was at 08:22 PM ----------
Could there be a size limit with AWK? (file1 1.5 MB, file2 10 MB)
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello!
I am writing a program to run through two large lists of data (~300,000 rows), find where rows in one file match another, and combine them based on matching fields. Due to the large file sizes, I'm guessing AWK will be the most efficient way to do this. Overall, the input and output I'm... (5 Replies)
Discussion started by: Michelangelo
5 Replies
2. Shell Programming and Scripting
Hello,
I am newbie in awk. I have just started learning it.
1) I have input file which looks like:
{4812 4009 1602 2756 306} {4814 4010 1603 2757 309} {8116 9362 10779 }
{10779 10121 9193 10963 10908} {1602 2756 306 957 1025} {1603 2757 307}
and so on.....
2) In output:
a)... (10 Replies)
Discussion started by: kajolo
10 Replies
3. Shell Programming and Scripting
Dear All,
I would like to add values of a field, if the lines match in a certain field. Then I would like to divide the sum though the number of lines that have a matched field. This is the Input:
Input:
Test1 5
Test1 10
Test2 2
Test2 5
Test2 13
Test3 4
Output:
Test1 7.5
Test1 7.5... (6 Replies)
Discussion started by: DerSeb
6 Replies
4. Shell Programming and Scripting
Hoping for some assistance.
my source file consists of:
os, ip, username
win7, 123.56.78, john
win7, 123.56.78, paul
win7, 10.1.1.1, john
win7, 10.2.2.3, joe
I've been trying to run a script that will only return ip and username where the IP address is the same and the username is... (3 Replies)
Discussion started by: tekvaio
3 Replies
5. Shell Programming and Scripting
Hello,
I'm trying to get the TOP and BASE numbers printed out
File looks like this:
2300 CAR # 2300 is the TOP
2310 CAR
2335 CAR
2455 CAR # 2455 is the BASE
1000 MOTOR # 2455 will become this TOP
2000 MOTOR
3000 MOTOR
4000 MOTOR # 4000 is the BASE
2345 BIKE # 4000... (8 Replies)
Discussion started by: charlieglen
8 Replies
6. UNIX for Advanced & Expert Users
grep -v will exclude matching lines, but I want something that will print all lines but exclude a matching field. The pattern that I want excluded is '/mnt/svn'
If there is a better solution than awk I am happy to hear about it, but I would like to see this done in awk as well. I know I can... (11 Replies)
Discussion started by: glev2005
11 Replies
7. UNIX for Beginners Questions & Answers
Hi,
I have 2 tab-delimited input files as follows.
file1.tab:
green A apple
red B apple
file2.tab:
apple - A;Z
Objective:
Return $1 of file1 if,
. $1 of file2 matches $3 of file1 and,
. any single element (separated by ";") in $3 of file2 is present in $2 of file1
In order to... (3 Replies)
Discussion started by: beca123456
3 Replies
8. Shell Programming and Scripting
Trying to use awk to match the contents of each line in file1 with $5 in file2. Both files are tab-delimited and there may be a space or special character in the name being matched in file2, for example in file1 the name is BRCA1 but in file2 the name is BRCA 1 or in file1 name is BCR but in file2... (6 Replies)
Discussion started by: cmccabe
6 Replies
9. UNIX for Beginners Questions & Answers
I apologize in advance, but I continue to have trouble searching for matches between two files and then printing portions of each to output in awk and would very much appreciate some help.
I have data as follows:
File1
PS012,002 PRQ 0 1 1 17 1 0 -1 3 2 1 2 -1 ... (7 Replies)
Discussion started by: jvoot
7 Replies
10. UNIX for Beginners Questions & Answers
Hello all, I am having trouble with what should be an easy task, but seem to be missing something fundamental. I have two files, with File 1 consisting of a single field of many thousands of records. I also have File 2 with two fields and many thousands of records.
My goal is that when $1 of... (2 Replies)
Discussion started by: jvoot
2 Replies
LEARN ABOUT DEBIAN
photon
PHOTON(1) PHOTON(1)
NAME
photon - generates photo albums
SYNOPSIS
photon [OPTIONS] [PATH]
DESCRIPTION
Photon generates clean, yet configurable, static HTML photo galleries. All of the work is done from the command line, and the resulting
output can easily be configured by changing the template files found in /usr/share/photon/templates.
To create a new template (skin), first create a new directory:
mkdir -p ${HOME}/.photon/templates/my_theme/
Then copy the contents of /usr/share/photon/templates/photonv1/ to this new directory. Photon only needs three files to build pages:
index.html
used to display the content of a folder
image.html
used to display the page for an image
movie.html
used to display the page for a movie
If a file is missing, then photon will throw an error and will not run.
HOW TO BUILD A GALLERY
Quick start
$ photon -o myoutputdir /photos
Use the gimp plugin
$ photon --resize-plugin=gimp -v -o myoutputdir /photos
Change the size for all images and the thumbnail and keep the original photo
$ photon --sizelist=0,1600x1200,800x600 --thumbsize=320x240 -o myoutputdir /photos
Create a gallery from your custom template (skin)
$ photon -k my_theme -o myoutputdir /photos
See photon help
$ photon --help
OPTIONS
-a | --awstats
Insert Javascript for Awstats
--awstats-url=URL
Change default value for Awstats script url
-c NAME | --comment
Name of the comment file (default .comments)
-d NUM | --display-columns=NUM
Number of columns in index (default 3)
-E | --no-exif
Don't include EXIF information in HTML file
-f | --force
Overwrite non-image generated files (html, javascript, etc) (default no)
-ff | --force --force
Overwrite image files (default no)
-h | --help
Print this help
-I | --no-index
Do not generate the high level index.html
-J | --no-javascript
Do not use javascript (no shortcuts, ... )
-k | --skin=THEME
Skin selector (default photonv1)
--print-skins
Print out available skins (templates)
-l NUM | --display-lines=NUM
Number of lines in index (default 5)
-m | --movie
Movie mode, include link to movie (*.mov)
-o NAME | --output-directory=NAME
Name of the output directory
-s LIST | --sizelist=LIST
Image sizes (default 0,1024x768,800x600,640x480). Zero, which is the default, uses the original resolution. W x H specifies the width
and height of the image in pixels.
-t SIZE | --thumbsize=SIZE
Size of thumbnails (default 160x120)
-v | --verbose
Verbosely print information
-V | --version
Print program version number
-z | --compress
Compress the original image if selected (default copy the image)
--exif-bordercolor=COLOR
Exif window border color (default #008000)
--exif-bgcolor=COLOR
Exif window background color (default #f0fff0)
--exif-fgcolor=COLOR
Exif window text color (default black)
--body-bgcolor=COLOR
Body background color (default #ccccff)
--img-bgcolor=COLOR
Image background color (default white)
--exclude=PATTERN
Exclude files matching PATTERN
--resize-plugin=PLUG
Where PLUG is the program used to create thumbnails internal: fastest method (default) gimp: use Gimp>1.x (better quality)
--resize-quality-low=NUM
Quality for small image. 0 (bad) and 100 (good)
--resize-quality-high=NUM
Quality for big image 0 (bad) and 100 (good)
--gimp-program=PROG
use PROG for gimp
SHORTCUTS WHILE VIEWING AN IMAGE
n/SPACE Go to the next image (with the same resolution)
p/BACKSPACE Go to the previous image (with the same resolution)
s Start/Stop the slideshow
+/- Increase/Decrease by one second the slideshow's period
h Show shortcut and help
i Show Exif information
z Change to the higher resolution [NOT YET IMPLEMENTED]
SEE ALSO
gimp(1)
AUTHOR
Written by Luc Saillard, <luc@saillard.org>
Main web site: http://www.saillard.org/programs_and_patches/photon/
This manual page was written by Kevin Coyner <kcoyner@debian.org> for the Debian project but may be used by others.
12/16/2006 PHOTON(1)