11-04-2013
Unlikely, 45000 lines is nothing. What is your OS and version? What isn't working? Do you get output like you described in post #3, or is it different ? Does it work when you download your own samples in post #3 and run Bartus11' suggestion on them?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello!
I am writing a program to run through two large lists of data (~300,000 rows), find where rows in one file match another, and combine them based on matching fields. Due to the large file sizes, I'm guessing AWK will be the most efficient way to do this. Overall, the input and output I'm... (5 Replies)
Discussion started by: Michelangelo
5 Replies
2. Shell Programming and Scripting
Hello,
I am newbie in awk. I have just started learning it.
1) I have input file which looks like:
{4812 4009 1602 2756 306} {4814 4010 1603 2757 309} {8116 9362 10779 }
{10779 10121 9193 10963 10908} {1602 2756 306 957 1025} {1603 2757 307}
and so on.....
2) In output:
a)... (10 Replies)
Discussion started by: kajolo
10 Replies
3. Shell Programming and Scripting
Dear All,
I would like to add values of a field, if the lines match in a certain field. Then I would like to divide the sum though the number of lines that have a matched field. This is the Input:
Input:
Test1 5
Test1 10
Test2 2
Test2 5
Test2 13
Test3 4
Output:
Test1 7.5
Test1 7.5... (6 Replies)
Discussion started by: DerSeb
6 Replies
4. Shell Programming and Scripting
Hoping for some assistance.
my source file consists of:
os, ip, username
win7, 123.56.78, john
win7, 123.56.78, paul
win7, 10.1.1.1, john
win7, 10.2.2.3, joe
I've been trying to run a script that will only return ip and username where the IP address is the same and the username is... (3 Replies)
Discussion started by: tekvaio
3 Replies
5. Shell Programming and Scripting
Hello,
I'm trying to get the TOP and BASE numbers printed out
File looks like this:
2300 CAR # 2300 is the TOP
2310 CAR
2335 CAR
2455 CAR # 2455 is the BASE
1000 MOTOR # 2455 will become this TOP
2000 MOTOR
3000 MOTOR
4000 MOTOR # 4000 is the BASE
2345 BIKE # 4000... (8 Replies)
Discussion started by: charlieglen
8 Replies
6. UNIX for Advanced & Expert Users
grep -v will exclude matching lines, but I want something that will print all lines but exclude a matching field. The pattern that I want excluded is '/mnt/svn'
If there is a better solution than awk I am happy to hear about it, but I would like to see this done in awk as well. I know I can... (11 Replies)
Discussion started by: glev2005
11 Replies
7. UNIX for Beginners Questions & Answers
Hi,
I have 2 tab-delimited input files as follows.
file1.tab:
green A apple
red B apple
file2.tab:
apple - A;Z
Objective:
Return $1 of file1 if,
. $1 of file2 matches $3 of file1 and,
. any single element (separated by ";") in $3 of file2 is present in $2 of file1
In order to... (3 Replies)
Discussion started by: beca123456
3 Replies
8. Shell Programming and Scripting
Trying to use awk to match the contents of each line in file1 with $5 in file2. Both files are tab-delimited and there may be a space or special character in the name being matched in file2, for example in file1 the name is BRCA1 but in file2 the name is BRCA 1 or in file1 name is BCR but in file2... (6 Replies)
Discussion started by: cmccabe
6 Replies
9. UNIX for Beginners Questions & Answers
I apologize in advance, but I continue to have trouble searching for matches between two files and then printing portions of each to output in awk and would very much appreciate some help.
I have data as follows:
File1
PS012,002 PRQ 0 1 1 17 1 0 -1 3 2 1 2 -1 ... (7 Replies)
Discussion started by: jvoot
7 Replies
10. UNIX for Beginners Questions & Answers
Hello all, I am having trouble with what should be an easy task, but seem to be missing something fundamental. I have two files, with File 1 consisting of a single field of many thousands of records. I also have File 2 with two fields and many thousands of records.
My goal is that when $1 of... (2 Replies)
Discussion started by: jvoot
2 Replies
LEARN ABOUT SUSE
slrnpull
slrnpull(1) User Manuals slrnpull(1)
NAME
slrnpull - Pull a small newsfeed for offline reading.
SYNOPSIS
slrnpull [-d spooldir] [-h server] [--debug file] [--expire] [--fetch-score n] [--help] [--kill-log file] [--kill-score n] [--logfile file]
[--marked-bodies] [--new-groups] [--no-post] [--post] [--post-only] [--rebuild] [--version]
DESCRIPTION
slrnpull pulls a small newsfeed from an NNTP server. It puts the articles into a spool directory from which slrn can later read them, even
if the server is unreachable at that time. Typically, this is useful if you do not have a permanent network connection.
OPTIONS
The following options can be used when calling slrnpull from the command line.
-d spooldir
Set slrnpull's root directory for this run to spooldir, overriding the $SLRNPULL_ROOT environment variable.
-h host[:port]
Connect to the NNTP server on host, overriding the $NNTPSERVER environment variable. If no port is given, the default NNTP port
(119) will be used.
--debug file
Write dialogue with the server and some additional debugging output to file.
--expire
Expire (remove) old messages from the spool, but do not fetch news.
--fetch-score n
Fetch article bodies with a score of at least n automatically (in true offline mode, the default is to fetch only bodies that were
explicitly marked by the user).
--help Show help for command line switches.
--kill-log file
Keep a log of all articles that were killed by the scorefile in file. By default, no such logfile is created.
--kill-score n
Kill all articles with a score below n. The default value for this is 0.
--logfile file
Log the messages and errors that slrnpull prints to the screen to file. By default, they get written to the file log in slrnpull's
root directory.
--marked-bodies
Only fetch bodies that were marked for download within slrn.
--new-groups
Check for new groups, appending them to the file new.groups in the data directory.
--no-post
Do not post any articles to the server.
--post Obsolete version of --post-only.
--post-only
Post outgoing articles, but do not fetch news.
--rebuild
Like --expire, but also rebuild the overview information. To be used when the overview information is damaged.
--version
Print the version number.
ENVIRONMENT
slrnpull reads the following environment variables. Note that they can be overridden by command line switches.
NNTPSERVER
You can use this variable to tell slrnpull which NNTP server to connect to. It can be overridden by the command line option -h.
SLRNPULL_ROOT
Defines the directory where slrnpull will look for its configuration files and spool the articles. An absolute filename is needed
here. This can be overriden by the option -d.
FILES
$SLRNPULL_ROOT/authinfo
If the server requires authentication, this file needs to contain the data (username in the first line, password in the second). Be
careful not to make this file world-readable!
$SLRNPULL_ROOT/log
The default file to log status and error messages to.
$SLRNPULL_ROOT/score
If you want slrnpull to apply scoring rules to decide which articles to download, put them into this file.
$SLRNPULL_ROOT/slrnpull.conf
The main configuration file. It tells slrnpull how many articles to get from which groups and when to expire them.
SEE ALSO
The documentation that comes with slrnpull, especially README and SETUP. The FAQ of slrn also answers some questions about slrnpull.
You might also want to look at slrn's official home page, http://slrn.sourceforge.net/ or post to news.software.readers if you have a ques-
tion not covered by existing documentation.
The latest version of slrnpull is part of the slrn package available from http://prdownloads.sourceforge.net/slrn/
AUTHOR
John E. Davis <davis@space.mit.edu>
Please send any bug reports to the current maintainer, Thomas Schultz <tststs@gmx.de>
Unix September 2004 slrnpull(1)