Sponsored Content
Full Discussion: script to take row count
Top Forums Shell Programming and Scripting script to take row count Post 302250197 by er_zeeshan05 on Wednesday 22nd of October 2008 09:54:05 PM
Old 10-22-2008
script to take row count

hi

i am pretty new to unix .i am ETL guy
I need a unix script to take row count of a file and write it to another file
the problem with wc-l is it include filename also
wc -l abc.dat
will give me like 1000 abc.dat
i just want 1000 to be written
can u just take 2 min to write a simple script for me
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

row count of all files with more than 0 byte

Hi, Is there any way to get count number of lines in all files which have more than o bytes in current directory for example : in /user/sri/ there are 3 files abc 0 bytes def 5 bytes ghi 10 bytes i need to get wc -l for all files which have > 0 bytes at a time ..is... (6 Replies)
Discussion started by: sri2005
6 Replies

2. UNIX for Dummies Questions & Answers

row count but only number part

hi i am pretty new to unix .i am ETL guy I need a unix script to take row count of a file and write it to another file the problem with wc-l is it include filename also wc -l abc.dat will give me like 1000 abc.dat i just want 1000 to be written can u just take 2 min to write a simple... (1 Reply)
Discussion started by: er_zeeshan05
1 Replies

3. Shell Programming and Scripting

row count of 60 files in one file

hi all plz some unix guy help me in this i have 60 files which will have some records i want to find the total number of records in all the 60 files like file1 has 60 and file2 has 70 record i want to sum all these and find total row count in 60 files (5 Replies)
Discussion started by: er_zeeshan05
5 Replies

4. UNIX for Dummies Questions & Answers

Script to get Row Count of ZIP Files

Hi, I have some data files in a zipped format.(eg: aa.gz).I would like to know the number or rows in each zip file(May be populate the file name and line numbers into a text file).I know the commands wc -l and gunzip,.But how I will create a shell script for this to extract each files and get... (5 Replies)
Discussion started by: abhilash_menon
5 Replies

5. Shell Programming and Scripting

count identical strings print last row and count

I have a sorted file like: Apple 3 Apple 5 Apple 8 Banana 2 Banana 3 Grape 31 Orange 7 Orange 13 I'd like to search $1 and if $1 is not the same as $1 in the previous row print that row and print the number of times $1 was found. so the output would look like: Apple 8 3 Banana... (2 Replies)
Discussion started by: dcfargo
2 Replies

6. Shell Programming and Scripting

Count the delimeter from a file and delete the row if delimeter count doesnt match.

I have a file containing about 5 million rows, in the file there are some records which has extra delimiter at random position. (we dont know the positions), now we have to Count the delimeter from each row and if the count of delimeter is not matching then I want to delete those rows from the... (5 Replies)
Discussion started by: Akumar1
5 Replies

7. Shell Programming and Scripting

To count distinct fields in a row

I have . dat file which contains data in a specific format: 0 3 892 921 342 1 3 921 342 543 2 4 817 562 718 765 3 3 819 562 717 761 i need to compare each field in a row with another field of the same column but different row and cont the... (8 Replies)
Discussion started by: Abhik
8 Replies

8. Shell Programming and Scripting

Count the number or row with same value in a column

This is the source file, we called it errorlist.out 196 server_a server_unix_2 CD 196 server_b server_win_1 CD 196 server_c server_win_2 CD 196 server_bd server_unix_2 CD 196 server_d server_unix_2 CD 196 server_es server_win_1 CD 196 ... (14 Replies)
Discussion started by: sQew
14 Replies

9. UNIX for Advanced & Expert Users

row count

Hi, I want a row count of a file incliding header and trailer If I do cat Filename | wc -l then I am only getting the row count excluding the header and trailer Buit I want the row count including Header and trailer Please help Many thanks in advance, Pragyan (3 Replies)
Discussion started by: prarat
3 Replies

10. Shell Programming and Scripting

Row Count in .csv file

Hi, I have to find the count of rows starting with "E," in given a.csv file . Sample Data File. E,2333AED,A,MC3,25,31-MAY-18 E,2333AED,A,MC3,25,31-MAY-18 CYMC3 25AED 0000 E,2333CZK,A,MC3,25,31-MAY-18 CYMC3 25CZK 0000 E,2333EUR,A,MC3,25,31-MAY-18... (3 Replies)
Discussion started by: Prabhakar Y
3 Replies
mcxdeblast(1)							  USER COMMANDS 						     mcxdeblast(1)

  NAME
      mcxdeblast - parse BLAST files and stream output directly into mcl or write mcxassemble input.

  SYNOPSIS
      mcxdeblast file-name

      mcxdeblast  [--score=<b|e|r>  (bit  scores|e-values|normalize  bit score)] [--m9 (expect BLAST column format)] [--out <fname> (output file)]
      [--line-mode abc (write ID1 ID2 score format)] [--sort=<a|o> (alphabetic|occurrence sorting)] [--xi-dat=<suf> (strip <suf> from  file-name)]
      [--xo-dat=<suf>  (add  <suf>  to base name)] [--bcut=<val> (bit score cutoff)] [--ecut=<val> (E-value cutoff)] [--rcut=<val> (raw value cut-
      off)] [--tab=<fname> (tab file)] <file-name>

  DESCRIPTION
      mcxdeblast parses BLAST files.

      In stream mode mcxdeblast output can be directly streamed to mcl by using the mcxdeblast	--line-mode=abc  option  and  equipping  mcl  with
      either --abc or --expect-abc. This can be considered the easy, lightweight and fast track. This functionality was recently acquired by mcl.

      In the classic and slightly more heavy-handed assemble mode, mcxdeblast creates output files suitable for use by mcxassemble. The latter can
      in turn create input suitable for mcl. This is the mode in which mcxdeblast is employed by mclblastline.

  STREAM MODE
      Enter stream mode by specifiying --line-mode=abc.  Use --m9 if the input is in columnar output. Pipe the result to a  file  or  directly	to
      mcl. Example invocations can be found in the mcl manual.

  ASSEMBLE MODE
      If  the input file is named iput, mcxdeblast will by default create files iput.hdr, iput.raw, iput.tab, iput.map, and iput.err. The hdr file
      contains information about the number of nodes found. It will be read by mcxassemble. The raw file contains the co-occurrence scores between
      different  nodes (peptides), also to be read by mcxassemble. The co-occurrence scores are in terms of mcl indentiers, which are subjected to
      rearranging by mcxassemble in order to correctly align them with the tab file.  The tab  file  contains  bindings  between  mcl  identifiers
      (after rearranging as specified in the map file) and the BLAST labels (peptide identifiers). Refer to the manual of mcxassemble for the syn-
      tax of a tab file.  The err file contains a list of any errors encountered.

      If the --tab=fname option is used mcxdeblast changes its behaviour. It will read the file fname, and use the bindings found therein. It will
      no longer output any of the hdr, map, or tab files. The hdr file should be provided by the same application that generated the specified tab
      file, and the map file should no longer be necessary (it might be convenient though and perhaps the future will bring a new --map option).

      The --tab=fname option can be convenient e.g. if you split a BLAST job over multiple machines and want to apply mcxdeblast to  each  of  the
      subresults.  You	do  this by generating a single central tab file in advance.  Then provide each instance of mcxdeblast with this tab file.
      Each instance will generate a raw file. The respective raw files can simply be concatenated and fed to mcxassemble using	its  -raw  option.
      Additionally,  a hdr file has to be specified for mcxassemble using its -hdr option. The syntax of hdr files is described in the mcxassemble
      manual.  Currently there is usually only one variable in the hdr file, which is the number of bindings listed in the tab file. This  number,
      in turn, should equal the total number of different peptides encountered in the BLAST input.

  OPTIONS
      --tab=<fname> (tab file)
	Specify a tab file to use, rather than automatically generating one.

      --out <fname> (output file)
	Specify the name for the output file.

      --score=<b|e|r> (bit scores|e-values|norm bit score)
	Specify whether to use bit scores, E-values, or bit scores normalized by length of the HSP.

      --sort=<a|o> (alphabetic|occurrence sorting)
	Specify how to sort labels.

      --m9 (expect BLAST column format)
	Use this option to parse BLAST output formatted with the -m 9 option.

      --line-mode=abc (write ID1 ID2 SCORE format)
	Use this to stream output directly into mcl. Here abc is a literal; --line-mode may acquire other line output modes.

      --xi-dat=<suf> (strip <suf> from <file-name>)
	If  set, the suffix <suf> is stripped from file-name in order to obtain the base name for output. If <file-name> does not end with suffix,
	it is assumed to be the base name, and <suf> is added in order to obtain the (real) file-name.

      --xo-dat=<suf> (add <suf> to base name)
	Attaches the suffix to the base name. Use this to distinguish between different parses. One might for example use --score=b --bcut=5 --xo-
	dat=b.

      --bcut=<val> (bit score cutoff)
	Bit scores below the cutoff value are ignored. This triggers the output of bit scores and ignores all other values.

      --ecut=<val> (E-value cutoff)
	E-values below the cutoff value are ignored. This triggers the output of E-values and ignores all other values.

      --rcut=<val> (raw value cutoff)
	Raw values below the cutoff value are ignored. This triggers the output of raw values and ignores all other values.

  AUTHOR
      Stijn  van  Dongen.   Jason Stajich implemented the --m9 option.	Abel Ureta-Vidal and Dinakarpandian Deendayal contributed helpful comments
      and fixes.

  SEE ALSO
      mclblastline, mcxassemble, mcl, clmformat.

  mcxdeblast 12-068						      8 Mar 2012						       mcxdeblast(1)
All times are GMT -4. The time now is 11:12 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy