01-28-2009
hi franklin, care to explain what the awk statement means? thanks
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all,
I have got a problem while comparing 2 text files and the result should contains the unique values(Non repeatable).
For eg:
file1.txt
1
2
3
4
file2.txt
2
3
So after comaping the above 2 files I should get only 1 and 4 as the output. Pls help me out. (7 Replies)
Discussion started by: smarty86
7 Replies
2. Shell Programming and Scripting
Hi all,
I have a huge csv file with the following format of data,
Num SNPs, 549997
Total SNPs,555352
Num Samples, 157
SNP, SampleID, Allele1, Allele2
A001,AB1,A,A
A002,AB1,A,A
A003,AB1,A,A
...
...
...
I would like to write out a list of unique SNP (column 1). Could you... (3 Replies)
Discussion started by: phoeberunner
3 Replies
3. UNIX for Dummies Questions & Answers
Hi All,
Is there a way to get NON unique lines from 2 or more concatenated files?
Basically I have several files which are very similar with the exception of few lines and I want to find out which lines are different in each file. Very simple example is
file1 contains:
1
2
3
4
5file2... (122 Replies)
Discussion started by: pawannoel
122 Replies
4. UNIX for Advanced & Expert Users
Hi All,
I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space.
I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Discussion started by: krishnix
16 Replies
5. Shell Programming and Scripting
Hi,
I would like to compare 2 files, and have a return code write to a file.
regardless of the files contents are the same the code should be writing to a file (if both files contents are same then return code 0).
A simple example will be great :)
Thanks (3 Replies)
Discussion started by: khchong
3 Replies
6. UNIX for Dummies Questions & Answers
hi
i have used comm -13 <(sort 1.txt) <(sort 2.txt) option to get the unique lines that are present in file 2 but not in file 1. but some how i am getting the entire file 2. i would expect few but not all uncommon lines fro my dat. is there anything wrong with the way i used the command?
my... (1 Reply)
Discussion started by: anurupa777
1 Replies
7. Shell Programming and Scripting
hi
my problem is little complicated one. i have 2 files which appear like this
file 1
abbsss:aa:22:34:as akl abc 1234
mkilll:as:ss:23:qs asc abc 0987
mlopii:cd:wq:24:as asd abc 7866
file2
lkoaa:as:24:32:sa alk abc 3245
lkmo:as:34:43:qs qsa abc 0987
kloia:ds:45:56:sa acq abc 7805
i... (5 Replies)
Discussion started by: anurupa777
5 Replies
8. Shell Programming and Scripting
Hello I'm having a little difficulty in writing a shell script for a few simple tasks.
First I have two files "file1.txt" and "file2.txt" and I want to read and compare the last line of each file. The files look like this.
File1.txt
File2.txt
After comparing the two lines I would... (2 Replies)
Discussion started by: RustikGaming
2 Replies
9. Shell Programming and Scripting
Hello Everyone!
I have updated the first post so that my intentions are easier to understand, and also attached sample files (post #18).
I have over 500 text files in a directory. Over 1 GB of data. The data in those files is organised in lines:
My intention is to return one line per... (23 Replies)
Discussion started by: clippertm
23 Replies
10. Shell Programming and Scripting
Hi,
I am trying to script the below, but I am not very good at it :(
Your help would be greatly appreciated.
1. read all files in the directory in strings
strings *.*
2. in each file, for each line that contains "ABCD", store characters located at position 521 and 522 of this line... (9 Replies)
Discussion started by: clippertm
9 Replies
LEARN ABOUT DEBIAN
dphys-swapfile
DPHYS-SWAPFILE(8) System Manager's Manual DPHYS-SWAPFILE(8)
NAME
dphys-swapfile - set up, mount/unmount, and delete an swap file
SYNOPSIS
dphys-swapfile setup|swapon|swapoff|uninstall
DESCRIPTION
dphys-swapfile computes the size for an optimal swap file (and resizes an existing swap file if necessary), mounts an swap file, unmounts
it, and and delete it if not wanted any more.
OPTIONS
There is only one parameter, an command, which can be either of these:
setup Tells dphys-swapfile to compute the optimal swap file size and (re-)generate an fitting swap file. Default it 2 times RAM size. This
can be called at boot time, so the file allways stays the right size for current RAM, or run by hand whenever RAM size has changed.
swapon and swapoff These run the swapon and swapoff commands on the swapfile. Note that direct swapon/off from /etc/fstab is not possible,
as that is (at least on Debian) done in the same script that mounts /var (which is where the swap file most likely resides). And we
need to do our setup between those actions. So pass up /etc/fstab, and do our own swapon/off.
uninstall
Gets rid of an unwanted swap file, reclaiming the disk space.
CONFIG
The config file /etc/dphys-swapfile allows the user to set up the working environment for dphys-swapfile.
This config file is a sh script fragment full of assignments, which is sourced. Standard sh syntax rules apply. Assignments are:
CONF_SWAPFILE
Set where the swap file should be placed. Defaults to /var/swap. It is unlikely that you will need to change this, unless you have
very strange partitioning, and then you will most likely be using an swap partition anyway.
CONF_SWAPSIZE
Force file size to this. Default is 2*RAM size. This is unlikely to be needed, unless in strange diskspace situations. Note that
swap enabled and smaller than RAM causes kernal-internal VM trouble on random systems.
CONF_SWAPFACTOR
Set the relation between RAM and swap size. Must be an integer. Defaults to 2 which means swap size = 2 * RAM size
CONF_MAXSWAP
Set maximum size of the swap file in MBytes. Defaults to 2048 which was the former kernel limit for the swapfile size and is now a
limit to prevent unusual big swap files on systems with a lot of RAM.
FILES
/etc/dphys-swapfile
user config
$CONF_SWAPFILE
the swap file, target of the whole action (defaults to /var/swap)
EXAMPLES
dphys-swapfile is usually run at system startup and shutdown from an /etc/init.d (or /etc/rc.d) script, such as this (minimal) one:
#!/bin/sh
# /etc/init.d/dphys-swapfile - automatically set up an swapfile
# author franklin, last modification 2004.06.04
# This script is copyright ETH Zuerich Physics Departement,
# use under either modified/non-advertising BSD or GPL license
case "$1" in
start)
/sbin/dphys-swapfile setup
/sbin/dphys-swapfile swapon
;;
stop)
/sbin/dphys-swapfile swapoff
;;
esac
exit 0
If an sysadmin wants to have his swapfile in annother place, say /var/run/swap, he can use:
In /etc/dphys-swapfile:
CONF_SWAPFILE=/var/run/swap
AUTHOR
franklin@phys.ethz.ch, http://www.phys.ethz.ch/~franklin/
D-PHYS Swapfile Tools 2006.09.15 DPHYS-SWAPFILE(8)