06-21-2009
Extract specific lines for graphing
Hello,
I have a very large text file with about 2 million lines.
Each of the lines starts like..
SNP_12345678 A 1212, 121, 343, ...
SNP_12345678 B 4567, 567, 454, ...
and so on.
I want to extract specific SNPs and plot them by GNUplot or excel.
The file is too large to be opened by text editors in windows.
Since I would end up doing this for about 1000-2000 SNPs, I was wondering if this can be written up as a script etc..
I dont know much programming..infact almost no programming skills at all..
Any help or very much appreciated.
~GH~
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
hi,
how would i extract a range of lines in a file by using the line number? ex: file contains:
1 title
2 i want
3 this part
4 to be taken out
5 from this file
6 and sent to
7 another file
8 not needed
9 end of file
In this case, i want to copy line number 2 to 7 on a new... (2 Replies)
Discussion started by: apalex
2 Replies
2. Shell Programming and Scripting
Hi
I want to extract certain text between two line numbers like
23234234324 and
54446655567567
How do I do this with a simple sed or awk command?
Thank you.
---------- Post updated at 06:16 PM ---------- Previous update was at 05:55 PM ----------
found it:
sed -n '#1,#2p'... (1 Reply)
Discussion started by: return_user
1 Replies
3. Shell Programming and Scripting
I regularly extract lines of text from files based on the presence of a particular keyword; I place the extracted lines into another text file. This takes about 2 hours to complete using the "sort" command then Kate's find & highlight facility.
I've been reading the forum & googling and can find... (4 Replies)
Discussion started by: DionDeVille
4 Replies
4. UNIX for Dummies Questions & Answers
I would like to extract specific lines from a file and output them into another file.
Each line in the file has a unique ID, and I have a specific list of IDs (that are not consecutive) that I wish to extract.
for example:
1 aaaaaa bbbcb cccccc
2 aaaaaa bbbbb cccccd
3 aaaaaa bbbab... (6 Replies)
Discussion started by: mert2481
6 Replies
5. Shell Programming and Scripting
Hi,
I have a file which contains DDL statements- CREATE TABLE, CREATE INDEX, ALTER TABLE etc.
I have to only pick CREATE TABLE statements from the file-
Source :
----------------------------------------------
--DDL for table abc
--------------------------------------------
CREATE TABLE... (4 Replies)
Discussion started by: newb
4 Replies
6. UNIX for Dummies Questions & Answers
Dear all,
Greetings.
I would like to ask for your help to extract lines with specific words in addition 2 lines before and after these lines by using awk or sed.
For example, the input file is:
1 ak1 abc1.0
1 ak2 abc1.0
1 ak3 abc1.0
1 ak4 abc1.0
1 ak5 abc1.1
1 ak6 abc1.1
1 ak7... (7 Replies)
Discussion started by: Amanda Low
7 Replies
7. Shell Programming and Scripting
Hi,
I have a log file created from a load balancer showing connections to each member of a two member pool with the following format (where first field is source IP, second field is load balanced IP address and third field is destination member. I need to plot a graph by date/time and number of... (5 Replies)
Discussion started by: shog63
5 Replies
8. Shell Programming and Scripting
Hi there,
I need a help with extracting data from tab delimited file which look like this
#CHROM POS ID REF ALT Human Cow Dog Mouse Lizard
chr2 3033 . G C 0/0 0/0 0/0 1/1 0/0
chr3 35040 . G T 0/0 0/0 ./. 1/1 0/1
chr4 60584 . T G 1/1 1/1 0/1 1/1 0/0
chr10 7147815 . G A 0/0 1/1 0/0 0/0... (9 Replies)
Discussion started by: houkto
9 Replies
9. Shell Programming and Scripting
Data file example
I look for primary and * to isolate the interesting slot number.
slot=`sed '/^primary$/,/\*/!d' filename | tail -1 | sed s'/*//' | awk '{print $1" "$2}'`
Now I want to get the Touch line for only the associate slot number, in this case, because the asterisk... (2 Replies)
Discussion started by: popeye
2 Replies
10. Shell Programming and Scripting
I have a folder containing text files. I need to extract specific lines from the files of this folder based on another file input.txt. How can I do this with awk/sed?
file1
ARG 81.9 8 81.9 0
LEU 27.1 9 27.1 0
PHE .0 10 .0 0
ASP 59.8 11 59.8 0
ASN 27.6 12 27.6 0
ALA .0 13 .0 0... (5 Replies)
Discussion started by: alanmathew84
5 Replies
FMT(1) BSD General Commands Manual FMT(1)
NAME
fmt -- simple text formatter
SYNOPSIS
fmt [-Cr] [goal [maximum]] [name ...]
fmt [-Cr] [-g goal] [-m maximum] [name ...]
DESCRIPTION
fmt is a simple text formatter which reads the concatenation of input files (or standard input if none are given) and produces on standard
output a version of its input with lines as close to the goal length as possible without exceeding the maximum. The goal length defaults to
65 and the maximum to 75. The spacing at the beginning of the input lines is preserved in the output, as are blank lines and interword spac-
ing. In non raw mode, lines that look like mail headers or begin with a period are not formatted.
-C instructs fmt to center the text.
-g goal New way to set the goal length.
-m maximum New way to set the maximum length.
-r Raw mode; formats all lines and does not make exceptions for lines that start with a period or look like mail headers.
fmt is meant to format mail messages prior to sending, but may also be useful for other simple tasks. For instance, within visual mode of
the ex(1) editor (e.g., vi(1)) the command
!}fmt
will reformat a paragraph, evening the lines.
SEE ALSO
mail(1), nroff(1)
HISTORY
The fmt command appeared in 3BSD.
BUGS
The program was designed to be simple and fast - for more complex operations, the standard text processors are likely to be more appropriate.
BSD
May 29, 2007 BSD