Sponsored Content
Top Forums Shell Programming and Scripting Extracting a portion of data from a very large tab delimited text file Post 302412059 by Lucky Ali on Sunday 11th of April 2010 11:29:16 AM
Old 04-11-2010
Extracting a portion of data from a very large tab delimited text file

Hi All

I wanted to know how to effectively delete some columns in a large tab delimited file.

I have a file that contains 5 columns and almost 100,000 rows

Code:
3456 f g t t
3456 g h
456   f  h
4567 f g h z
345   f g
567   h j k l

This is a very large data file and tab delimited.

I need to extract the rows that have values in all the 5 columns. At present, there are several rows that contain only 3 values.

please let me know the best way to extract the rows with all 5 values

Thanks.
LA
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Check whether a given file is in ASCII format and data is tab-delimited

Hi All, Please help me out with a script which checks whether a given file say abc.txt is in ASCII format and data is tab-delimited. If the condition doesn't satisfy then it should generate error code "100" for file not in ASCII format and "105" if it is not in tab-delimited format. If the... (9 Replies)
Discussion started by: Mandab
9 Replies

2. Shell Programming and Scripting

Removing blanks in a text tab delimited file

Hi Experts I am very new to perl and need to make a script using perl. I would like to remove blanks in a text tab delimited file in in a specfic column range ( colum 21 to column 43) sample input and output shown below : Input: 117 102 650 652 654 656 117 93 95... (3 Replies)
Discussion started by: Faisal Riaz
3 Replies

3. Shell Programming and Scripting

Delete first column in tab-delimited text-file

I have a large text-file with tab-delimited genetic data that looks like: KSC112 KSC234 0 0 1 1 A G C T I simply wan to delete the first column, but since the file has 600 000 columns, it is not possible with awk (seems to be limited at 32k columns). Does anyone have an idea how to do this? (2 Replies)
Discussion started by: andmal
2 Replies

4. Shell Programming and Scripting

Extracting a portion of a data file with identifier

Hi, I do have a TAB delimted text file with the following format. 1 (- identifier of each group. this text is not present in the file only number) 1 3 4 65 56 WERTF 2 3 4 56 56 GHTYHU 3 3 5 64 23 VMFKLG 2 1 3 4 65 56 DGTEYDH 2 3 4 56 56 FJJJCKC 3 3 5 64 23 FNNNCHD 3 1 3 4 65 56 JDHJDH... (9 Replies)
Discussion started by: Lucky Ali
9 Replies

5. UNIX for Dummies Questions & Answers

How to convert text to columns in tab delimited text file

Hello Gurus, I have a text file containing nearly 12,000 tab delimited characters with 4000 rows. If the file size is small, excel can convert the text into coloumns. However, the file that I have is very big. Can some body help me in solving this problem? The input file example, ... (6 Replies)
Discussion started by: Unilearn
6 Replies

6. UNIX for Dummies Questions & Answers

Deleting columns from a tab delimited text file?

I have a tab limited text file with 10000+ columns. I want to delete columns 6 through 23, how do I go about doing that? Thanks! (1 Reply)
Discussion started by: evelibertine
1 Replies

7. UNIX for Dummies Questions & Answers

Add a new column to a tab delimited text file

I want to add a new column to a tab delimited text file. It will be the first column and it will just be 1's. How do I go about doing that? Thanks! (1 Reply)
Discussion started by: evelibertine
1 Replies

8. UNIX for Dummies Questions & Answers

How to convert a text file into tab delimited format?

I have a text file that made using text editor in Ubuntu. However the text file is not being recognized as space or tab delimited, the formatting seems to be messed up. How can I convert the text file into tab delimited format? (3 Replies)
Discussion started by: evelibertine
3 Replies

9. Shell Programming and Scripting

How to read data from tab delimited file after a specific position?

Hi Experts, I have a tab deliminated file as below myfile.txt Local Group Memberships *Administrators *Guests I need data in below format starting from 4th position. myfile1.txt Administrators Guests the above one is just an example and there could... (15 Replies)
Discussion started by: Litu1988
15 Replies

10. UNIX for Dummies Questions & Answers

Need to convert a pipe delimited text file to tab delimited

Hi, I have a rquirement in unix as below . I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column. ex: Input Text file: 1|A|apple 2|B|bottle excel file to be generated as output as... (9 Replies)
Discussion started by: raja kakitapall
9 Replies
MPSMatrixDescriptor(3)					 MetalPerformanceShaders.framework				    MPSMatrixDescriptor(3)

NAME
MPSMatrixDescriptor SYNOPSIS
#import <MPSMatrixTypes.h> Inherits NSObject. Class Methods (__nonnull instancetype) + matrixDescriptorWithDimensions:columns:rowBytes:dataType: (__nonnull instancetype) + matrixDescriptorWithRows:columns:rowBytes:dataType: (__nonnull instancetype) + matrixDescriptorWithRows:columns:matrices:rowBytes:matrixBytes:dataType: (size_t) + rowBytesFromColumns:dataType: (size_t) + rowBytesForColumns:dataType: Properties NSUInteger rows NSUInteger columns NSUInteger matrices MPSDataType dataType NSUInteger rowBytes NSUInteger matrixBytes Detailed Description This depends on Metal.framework A MPSMatrixDescriptor describes the sizes, strides, and data type of a an array of 2-dimensional matrices. All storage is assumed to be in 'matrix-major'. See the description for MPSMatrix for further details. Method Documentation + (__nonnull instancetype) matrixDescriptorWithDimensions: (NSUInteger) rows(NSUInteger) columns(NSUInteger) rowBytes(MPSDataType) dataType Create a MPSMatrixDescriptor with the specified dimensions and data type. Parameters: rows The number of rows of the matrix. columns The number of columns of the matrix. rowBytes The number of bytes between starting elements of consecutive rows. Must be a multiple of the element size. dataType The type of the data to be stored in the matrix. For performance considerations the optimal row stride may not necessarily be equal to the number of columns in the matrix. The MPSMatrix class provides a method which may be used to determine this value, see the rowBytesForColumns API in the MPSMatrix class. The number of matrices described is initialized to 1. + (__nonnull instancetype) matrixDescriptorWithRows: (NSUInteger) rows(NSUInteger) columns(NSUInteger) matrices(NSUInteger) rowBytes(NSUInteger) matrixBytes(MPSDataType) dataType Create a MPSMatrixDescriptor with the specified dimensions and data type. Parameters: rows The number of rows of a single matrix. columns The number of columns of a single matrix. matrices The number of matrices in the MPSMatrix object. rowBytes The number of bytes between starting elements of consecutive rows. Must be a multiple of the element size. matrixBytes The number of bytes between starting elements of consecutive matrices. Must be a multiple of rowBytes. dataType The type of the data to be stored in the matrix. For performance considerations the optimal row stride may not necessarily be equal to the number of columns in the matrix. The MPSMatrix class provides a method which may be used to determine this value, see the rowBytesForColumns API in the MPSMatrix class. + (__nonnull instancetype) matrixDescriptorWithRows: (NSUInteger) rows(NSUInteger) columns(NSUInteger) rowBytes(MPSDataType) dataType + (size_t) rowBytesForColumns: (NSUInteger) columns(MPSDataType) dataType + (size_t) rowBytesFromColumns: (NSUInteger) columns(MPSDataType) dataType Return the recommended row stride, in bytes, for a given number of columns. Parameters: columns The number of columns in the matrix for which the recommended row stride, in bytes, is to be determined. dataType The type of matrix data values. To achieve best performance the optimal stride between rows of a matrix is not necessarily equivalent to the number of columns. This method returns the row stride, in bytes, which gives best performance for a given number of columns. Using this row stride to construct your array is recommended, but not required (provided that the stride used is still large enough to allocate a full row of data). Property Documentation - columns [read], [write], [nonatomic], [assign] The number of columns in a matrix. - dataType [read], [write], [nonatomic], [assign] The type of the data which makes up the values of the matrix. - matrices [read], [nonatomic], [assign] The number of matrices. - matrixBytes [read], [nonatomic], [assign] The stride, in bytes, between corresponding elements of consecutive matrices. Must be a multiple of rowBytes. - rowBytes [read], [write], [nonatomic], [assign] The stride, in bytes, between corresponding elements of consecutive rows. Must be a multiple of the element size. - rows [read], [write], [nonatomic], [assign] The number of rows in a matrix. Author Generated automatically by Doxygen for MetalPerformanceShaders.framework from the source code. Version MetalPerformanceShaders-100 Thu Feb 8 2018 MPSMatrixDescriptor(3)
All times are GMT -4. The time now is 03:29 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy