Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk based script to ignore all columns from a file which contains character strings
Top Forums Shell Programming and Scripting awk based script to ignore all columns from a file which contains character strings Post 302716187 by pamu on Tuesday 16th of October 2012 04:50:15 AM
Old 10-16-2012
try..


Code:
awk -F, '{ if(NR==1){a=split($0,P,",")};
for(i=1;i<=NF;i++){if($i !~ /[A-z]/ || NR==1){arr[NR,P[i]]=$i}else{K[++t]=i}}}
END{for(i in K){P[K[i]]=0}}
END{for(i=1;i<=NR;i++){
for(j=1;j<=NF;j++){if(arr[i,P[j]] != ""){s=s?s","arr[i,P[j]]:arr[i,P[j]]}}
print s;s=""}
}' file

 

10 More Discussions You Might Find Interesting

1. Linux

Linux script to remove a character in a file based on position.

Greetings, We have a requirement where we need to loop in a fixed width file in linux and remove a character based on a position for every record. It would highly appreciate if someone can help to automate this. Appreciate your time and help! Regards (3 Replies)
Discussion started by: mailme0205
3 Replies

2. Shell Programming and Scripting

Awk based script to find the median of all individual columns in a data file

Hi All, I have some data like below. Step1,Param1,Param2,Param3 1,2,3,4 2,3,4,5 2,4,5,6 3,0,1,2 3,0,0,0 3,2,1,3 ........ so on Where I need to find the median(arithmetic) of each column from Param1...to..Param3 for each set of Step1 values. (Sort each specific column, if the... (5 Replies)
Discussion started by: ks_reddy
5 Replies

3. Shell Programming and Scripting

awk based script to find the average of all the columns in a data file

Hi All, I need the modification for the below mentioned code (found in one more post https://www.unix.com/shell-programming-scripting/27161-script-generate-average-values.html) to find the average values for all the columns(but for a specific rows) and print the averages side by side. I have... (4 Replies)
Discussion started by: ks_reddy
4 Replies

4. Shell Programming and Scripting

Help with awk replacing identical columns based on another file

Hello, I am using Awk in UBUNTU 12.04. I have a file like following with three fields and 44706 rows. F1 A A F2 G G F3 A T I have another file like this: AL_1 F1 A A AL_2 F1 A T AL_3 F1 A A AL_1 F2 G G AL_2 F2 G A AL_3 F2 G G BO_1 F1 A A BO_2 F1 A T... (6 Replies)
Discussion started by: Homa
6 Replies

5. Shell Programming and Scripting

awk script to split file into multiple files based on many columns

So I have a space delimited file that I'd like to split into multiple files based on multiple column values. This is what my data looks like 1bc9A02 1 10 1000 FTDLNLVQALRQFLWSFRLPGEAQKIDRMMEAFAQRYCQCNNGVFQSTDTCYVLSFAIIMLNTSLHNPNVKDKPTVERFIAMNRGINDGGDLPEELLRNLYESIKNEPFKIPELEHHHHHH 1ku1A02 1 10... (9 Replies)
Discussion started by: viored
9 Replies

6. Shell Programming and Scripting

awk error - validating strings in columns

can someone please help me fix this command: somecommand.sh | awk -F"---" 'BEGIN{count=0} /P/ && /ERROR/ {if (($3 ~ /^P$/) && ($6 ~ /ERROR/)) {print; count++ }END { print count } ;}' basically, what i'm attempting to do here is print all the matching lines, then, at the end, print the total... (2 Replies)
Discussion started by: SkySmart
2 Replies

7. Shell Programming and Scripting

How to remove certain character strings with awk?

Hi all, I need to remove DBPATH= and /db from the string below using awk (or sed, as it also exists on the machine). Input: DBPATH=/some/path/database/db Desired output: /some/path/database Thank you! (8 Replies)
Discussion started by: ejianu
8 Replies

8. Shell Programming and Scripting

Delimit file based on character length using awk

Hi, I need help with one problem, I came across recently. I have one input file which I need to delimit based on character length. $ cat Input.txt 12345sda231453 asd760kjol62569 sdasw4g76gdf57 And, There is one comma separated file which mentions "start of the field" and "length... (6 Replies)
Discussion started by: Prathmesh
6 Replies

9. Shell Programming and Scripting

awk to ignore multiple rows based on a condition

All, I have a text file(Inputfile.csv) with millions of rows and 100 columns. Check the sample for 2 columns below. Key,Check A,1 A,2 A, A,4 B,0 B,1 B,2 B,3 B,4 .... million rows. My requirement is to delete all the rows corresponding to all the keys which ever has at least one... (4 Replies)
Discussion started by: ks_reddy
4 Replies

10. UNIX for Beginners Questions & Answers

How to ignore mutiple strings when using shell script?

Hi All, I am trying to use below syntax to find ignore multiple locations while searching for a file. find / -name "$serviceitem" ! -size 0 2>&1 |egrep -v "tmp|docker|WinSxS|Permission|HISTORY|alternatives|bearer11ssl|manifest" I tried to assign all the ignore strings to one variable... (2 Replies)
Discussion started by: sravani25
2 Replies

LEARN ABOUT PHP

db2_columns

DB2_COLUMNS(3)								 1							    DB2_COLUMNS(3)

db2_columns - Returns a result set listing the columns and associated metadata for a table

SYNOPSIS

       resource db2_columns (resource  $connection, [string  $qualifier], [string  $schema], [string  $table-name], [string  $column-name])

DESCRIPTION

	Returns a result set listing the columns and associated metadata for a table.

PARAMETERS

	      o $connection
		- A valid connection to an IBM DB2, Cloudscape, or Apache Derby database.

	      o $qualifier
		- A qualifier for DB2 databases running on OS/390 or z/OS servers. For other databases, pass NULL or an empty string.

	      o $schema
		- The schema which contains the tables. To match all schemas, pass '%'.

	      o $table-name
		- The name of the table or view. To match all tables in the database, pass NULL or an empty string.

	      o $column-name
		- The name of the column. To match all columns in the table, pass NULL or an empty string.

RETURN VALUES

	Returns a statement resource with a result set containing rows describing the columns matching the specified parameters. The rows are com-
       posed of the following columns:

       +------------------+---------------------------------------------------+
       |   Column name	  |						      |
       |		  |						      |
       |		  |		       Description		      |
       |		  |						      |
       +------------------+---------------------------------------------------+
       |    TABLE_CAT	  |						      |
       |		  |						      |
       |		  | Name of the catalog. The value is  NULL  if  this |
       |		  | table does not have catalogs.		      |
       |		  |						      |
       |   TABLE_SCHEM	  |						      |
       |		  |						      |
       |		  |		   Name of the schema.		      |
       |		  |						      |
       |   TABLE_NAME	  |						      |
       |		  |						      |
       |		  |	       Name of the table or view.	      |
       |		  |						      |
       |   COLUMN_NAME	  |						      |
       |		  |						      |
       |		  |		   Name of the column.		      |
       |		  |						      |
       |    DATA_TYPE	  |						      |
       |		  |						      |
       |		  | The  SQL  data type for the column represented as |
       |		  | an integer value.				      |
       |		  |						      |
       |    TYPE_NAME	  |						      |
       |		  |						      |
       |		  | A string representing the data type for the  col- |
       |		  | umn.					      |
       |		  |						      |
       |   COLUMN_SIZE	  |						      |
       |		  |						      |
       |		  | An	integer  value	representing  the size of the |
       |		  | column.					      |
       |		  |						      |
       |  BUFFER_LENGTH   |						      |
       |		  |						      |
       |		  |  Maximum number of bytes necessary to store  data |
       |		  | from this column.				      |
       |		  |						      |
       | DECIMAL_DIGITS   |						      |
       |		  |						      |
       |		  |  The  scale of the column, or NULL where scale is |
       |		  | not applicable.				      |
       |		  |						      |
       | NUM_PREC_RADIX   |						      |
       |		  |						      |
       |		  |  An integer value of either 10  (representing  an |
       |		  | exact  numeric  data  type),  2  (representing an |
       |		  | approximate numeric data type), or	NULL  (repre- |
       |		  | senting a data type for which radix is not appli- |
       |		  | cable).					      |
       |		  |						      |
       |    NULLABLE	  |						      |
       |		  |						      |
       |		  | An integer value representing whether the  column |
       |		  | is nullable or not. 			      |
       |		  |						      |
       |     REMARKS	  |						      |
       |		  |						      |
       |		  |	       Description of the column.	      |
       |		  |						      |
       |   COLUMN_DEF	  |						      |
       |		  |						      |
       |		  |	      Default value for the column.	      |
       |		  |						      |
       |  SQL_DATA_TYPE   |						      |
       |		  |						      |
       |		  | An	integer  value	representing  the size of the |
       |		  | column.					      |
       |		  |						      |
       |SQL_DATETIME_SUB  |						      |
       |		  |						      |
       |		  |  Returns an integer value representing a datetime |
       |		  | subtype code, or NULL for SQL data types to which |
       |		  | this does not apply.			      |
       |		  |						      |
       |CHAR_OCTET_LENGTH |						      |
       |		  |						      |
       |		  |  Maximum length in octets for  a  character  data |
       |		  | type  column,  which matches COLUMN_SIZE for sin- |
       |		  | gle-byte character set data,  or  NULL  for  non- |
       |		  | character data types.			      |
       |		  |						      |
       |ORDINAL_POSITION  |						      |
       |		  |						      |
       |		  | The  1-indexed  position of the column in the ta- |
       |		  | ble.					      |
       |		  |						      |
       |   IS_NULLABLE	  |						      |
       |		  |						      |
       |		  |  A string value where 'YES' means that the column |
       |		  | is nullable and 'NO' means that the column is not |
       |		  | nullable.					      |
       |		  |						      |
       +------------------+---------------------------------------------------+
SEE ALSO

       db2_column_privileges(3), db2_foreign_keys(3), db2_primary_keys(3),  db2_procedure_columns(3),  db2_procedures(3),  db2_special_columns(3),
       db2_statistics(3), db2_table_privileges(3), db2_tables(3).

PHP Documentation Group 													    DB2_COLUMNS(3)
All times are GMT -4. The time now is 08:33 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy