Sponsored Content
Top Forums Shell Programming and Scripting Deleting duplicated chunks in a file using awk/sed Post 302974142 by jypark22 on Thursday 26th of May 2016 01:30:46 AM
Old 05-26-2016
Thank you, Don.

Your code is perfect for me. I will be careful in the next time before I will post.

Jaeyoung
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

using sed to get rid of duplicated columns...

I can not figure out this one, so I turn to unix.com for help, I have a file, in which there are some lines containing continuously duplicate columns, like the following adb abc abc asd adfj 123 123 123 345 234 444 444 444 444 444 23 and the output I want is adb abc asd adfj 123 345... (5 Replies)
Discussion started by: fedora
5 Replies

2. Shell Programming and Scripting

Deleting Doubled Block with sed or awk

hi there, i have a text file like that one: I like to delete the second block with the Start and End Line! Does anyone have a idea? Thanks for your help, Roland (4 Replies)
Discussion started by: rolandh
4 Replies

3. Shell Programming and Scripting

Deleting a line from a file with sed and awk?

cat file.txt fvnuiehuewf ruevhxncvkjrh zxjvurhfuwe jkhvBEGINvfnvf ijrgioe Trying to delete a line that has the pattern "BEGIN" cat sedtest filename=file.txt pattern=BEGIN sed "/^$pattern/d" "$filename" (9 Replies)
Discussion started by: cola
9 Replies

4. Shell Programming and Scripting

Deleting the first column with sed,awk or perl

336 brtr 256 hello Output: brtr hello How can i do this with sed,awk or perl? (5 Replies)
Discussion started by: cola
5 Replies

5. Shell Programming and Scripting

Deleting characters with sed,perl,awk

Input: :: gstreamer :: xine-lib :: xine-lib-extras Output should be: gstreamer xine-lib xine-lib-extras How can it be done with sed or perl? (12 Replies)
Discussion started by: cola
12 Replies

6. Shell Programming and Scripting

Can I use a shell script for deleting chunks from a watch folder?

Hello I have a unique problem of needing to delete large files slowly off of an XSan. I was wondering if there is a script I could use to delete 100gb chunks of files and folders that get placed in to a watch folder, slowly so as not to disrupt the other users. I would like to use Automator in... (0 Replies)
Discussion started by: ajsoto
0 Replies

7. Shell Programming and Scripting

deleting lines between patterns using sed or awk

hi, Here is excerpt from my xml file <!-- The custom module to do the authentication for LDAP --> </login-module> <login-module code="com.nlayers.seneca.security.LdapLogin" flag="sufficient"> <module-option... (1 Reply)
Discussion started by: sunrexstar
1 Replies

8. UNIX for Dummies Questions & Answers

Awk: Print out overlapping chunks of file - rows 0-20,10-30,20-40 etc.

First time poster, but the forum has saved my bacon more times than... Lots. Anyway, I have a text file, and wanted to use Awk (or any other sensible program) to print out overlapping sections, or arbitrary length. To describe by example, for file 1 2 3 4 5 etc... I want the out put... (3 Replies)
Discussion started by: matfald
3 Replies

9. Shell Programming and Scripting

awk for splitting file in constant chunks

Hi gurus, I wanted to split main file in 20 files with 2500 lines in each file. My main file conatins total 2500*20 lines. Following awk I made, but it is breaking with error. awk '{ for (i = 1; i <= 20; i++) { starts=2500*$i-1; ends=2500*$i; NR>=starts && NR<=ends {f=My$i".txt"; print >> f;... (10 Replies)
Discussion started by: mukesh.lalwani
10 Replies

10. Shell Programming and Scripting

Deleting lines containing duplicated strings

Dear all, I always appreciate your help. I would like to delete lines containing duplicated strings in the second column. test.txt 658 invert_d2e_q_reg_0_/Qalu_ecl_zlow_e 0.825692 659 invert_d2e_q_reg_0_/Qalu_byp_rd_data_e 0.825692 660 invert_d2e_q_reg_0_/Qalu_byp_rd_data_e 0.825692... (1 Reply)
Discussion started by: jypark22
1 Replies
slrnpull(1)							   User Manuals 						       slrnpull(1)

NAME
slrnpull - Pull a small newsfeed for offline reading. SYNOPSIS
slrnpull [-d spooldir] [-h server] [--debug file] [--expire] [--fetch-score n] [--help] [--kill-log file] [--kill-score n] [--logfile file] [--marked-bodies] [--new-groups] [--no-post] [--post] [--post-only] [--rebuild] [--version] DESCRIPTION
slrnpull pulls a small newsfeed from an NNTP server. It puts the articles into a spool directory from which slrn can later read them, even if the server is unreachable at that time. Typically, this is useful if you do not have a permanent network connection. OPTIONS
The following options can be used when calling slrnpull from the command line. -d spooldir Set slrnpull's root directory for this run to spooldir, overriding the $SLRNPULL_ROOT environment variable. -h host[:port] Connect to the NNTP server on host, overriding the $NNTPSERVER environment variable. If no port is given, the default NNTP port (119) will be used. --debug file Write dialogue with the server and some additional debugging output to file. --expire Expire (remove) old messages from the spool, but do not fetch news. --fetch-score n Fetch article bodies with a score of at least n automatically (in true offline mode, the default is to fetch only bodies that were explicitly marked by the user). --help Show help for command line switches. --kill-log file Keep a log of all articles that were killed by the scorefile in file. By default, no such logfile is created. --kill-score n Kill all articles with a score below n. The default value for this is 0. --logfile file Log the messages and errors that slrnpull prints to the screen to file. By default, they get written to the file log in slrnpull's root directory. --marked-bodies Only fetch bodies that were marked for download within slrn. --new-groups Check for new groups, appending them to the file new.groups in the data directory. --no-post Do not post any articles to the server. --post Obsolete version of --post-only. --post-only Post outgoing articles, but do not fetch news. --rebuild Like --expire, but also rebuild the overview information. To be used when the overview information is damaged. --version Print the version number. ENVIRONMENT
slrnpull reads the following environment variables. Note that they can be overridden by command line switches. NNTPSERVER You can use this variable to tell slrnpull which NNTP server to connect to. It can be overridden by the command line option -h. SLRNPULL_ROOT Defines the directory where slrnpull will look for its configuration files and spool the articles. An absolute filename is needed here. This can be overriden by the option -d. FILES
$SLRNPULL_ROOT/authinfo If the server requires authentication, this file needs to contain the data (username in the first line, password in the second). Be careful not to make this file world-readable! $SLRNPULL_ROOT/log The default file to log status and error messages to. $SLRNPULL_ROOT/score If you want slrnpull to apply scoring rules to decide which articles to download, put them into this file. $SLRNPULL_ROOT/slrnpull.conf The main configuration file. It tells slrnpull how many articles to get from which groups and when to expire them. SEE ALSO
The documentation that comes with slrnpull, especially README and SETUP. The FAQ of slrn also answers some questions about slrnpull. You might also want to look at slrn's official home page, http://slrn.sourceforge.net/ or post to news.software.readers if you have a ques- tion not covered by existing documentation. The latest version of slrnpull is part of the slrn package available from http://prdownloads.sourceforge.net/slrn/ AUTHOR
John E. Davis <davis@space.mit.edu> Please send any bug reports to the current maintainer, Thomas Schultz <tststs@gmx.de> Unix September 2004 slrnpull(1)
All times are GMT -4. The time now is 05:17 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy