Sponsored Content
Full Discussion: How to subset data?
Top Forums UNIX for Dummies Questions & Answers How to subset data? Post 302790073 by kadm on Thursday 4th of April 2013 03:11:54 PM
Old 04-04-2013
I'm getting the following error when I try the awk command suggested:

-bash-4.1$ awk 'NR==FNR {a[$1}++;next} $1 in a' missing.txt local.txt > missing_subset.txt

Error Code:
awk: NR==FNR {A[$1}++ ; next} $1 in A
awk: ^ syntax error
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to extract a subset from a huge dataset

Hi, All I have a huge file which has 450G. Its tab-delimited format is as below x1 A 50020 1 x1 B 50021 8 x1 C 50022 9 x1 A 50023 10 x2 D 50024 5 x2 C 50025 7 x2 F 50026 8 x2 N 50027 1 : : Now, I want to extract a subset from this file. In this subset, column 1 is x10, column 2 is... (3 Replies)
Discussion started by: cliffyiu
3 Replies

2. UNIX for Dummies Questions & Answers

Help with subset and if-then statements

Hello everyone. I'm new to the boards, I hope I can get and possibly give some help through these forums. I need some help. I have two CSV files, let's call them File A and File B. This is the structure for File A: ID, VAR1, VAR2, VAR3 - VAR50 (where the VAR 1-VAR50 are either 0 or 1) ... (1 Reply)
Discussion started by: JWill
1 Replies

3. Shell Programming and Scripting

How to remove a subset of data from a large dataset based on values on one line

Hello. I was wondering if anyone could help. I have a file containing a large table in the format: marker1 marker2 marker3 marker4 position1 position2 position3 position4 genotype1 genotype2 genotype3 genotype4 with marker being a name, position a numeric... (2 Replies)
Discussion started by: davegen
2 Replies

4. UNIX for Dummies Questions & Answers

how to get a subset of such a file

Dear all, I have a file lik below: n of row=420, n of letters in each row=100000 like below: there is no space between the letters. what I want is: the 75000th letter to the 85000th letter in each row. how to do that? thanks a lot! ... (2 Replies)
Discussion started by: forevertl
2 Replies

5. Shell Programming and Scripting

Creating subset of compilation errors

I am compiling a fortran program using gfortran and the result looks as below I want to write a bash or awk script that will scan the information and output only problems within a range of line numbers Example: If I specify the file createmodl.f08, start line 1000 and end line 1100, I will... (8 Replies)
Discussion started by: kristinu
8 Replies

6. Shell Programming and Scripting

Detecting subset of a word

Each line of the file has some words exactly same letters as of the first one. But has zero or more "_+" inserted. I am interested in those words and remove the other cases. Example: abcde abcd_+e abcd_+de fghig fghigi fghi_+g klmn klmn I want to get this: abcde abcd_+e fghig fghi_+g ... (7 Replies)
Discussion started by: Viernes
7 Replies

7. Shell Programming and Scripting

Parsing a subset of data from a large matrix

I do have a large matrix of the following format and it is tab delimited ch-ab1-20 ch-bb2-23 ch-ab1-34 ch-ab1-24 er-cc1-45 bv-cc1-78 ch-ab1-20 0 2 3 4 5 6 ch-bb2-23 3 0 5 ... (6 Replies)
Discussion started by: Kanja
6 Replies

8. Shell Programming and Scripting

How-to check if file1 a subset of file2 ?

I need to know if file1 is a subset of file2 i.e all the contents of file1 are present in file2 or not. Here is how i would do it. Read line by line file1 and grep every line in file2 in a for loop. any failing grep would means that it is not a subset. Is there a quicker or easier way... (3 Replies)
Discussion started by: mohtashims
3 Replies

9. Shell Programming and Scripting

How to check if file2 is a subset of file1?

In-order to check and print if file2 is a subset of file one i do the below. var1=$(cat //tmp/file1 | sort -u | wc) var2=$(cat /tmp/file2 /tmp/file1 | sort -u | wc) if ; then echo "file2 is a subset of file1 becoz var1 and var2 have the same values." fi However, i get the following error ... (1 Reply)
Discussion started by: mohtashims
1 Replies

10. UNIX for Beginners Questions & Answers

Cannot subset ranges from another range set

Ca21chr2_C_albicans_SC5314 2159343 2228327 Ca21chr2_C_albicans_SC5314 636587 638608 Ca21chr2_C_albicans_SC5314 5286 50509 Ca21chr2_C_albicans_SC5314 634021 636276 Ca21chr2_C_albicans_SC5314 1886545 1900975 Ca21chr2_C_albicans_SC5314 610758 613544... (9 Replies)
Discussion started by: cryptodice
9 Replies
DB2_SPECIAL_COLUMNS(3)							 1						    DB2_SPECIAL_COLUMNS(3)

db2_special_columns - Returns a result set listing the unique row identifier columns for a table

SYNOPSIS
resource db2_special_columns (resource $connection, string $qualifier, string $schema, string $table_name, int $scope) DESCRIPTION
Returns a result set listing the unique row identifier columns for a table. PARAMETERS
o $connection - A valid connection to an IBM DB2, Cloudscape, or Apache Derby database. o $qualifier - A qualifier for DB2 databases running on OS/390 or z/OS servers. For other databases, pass NULL or an empty string. o $schema - The schema which contains the tables. o $table_name - The name of the table. o $scope - Integer value representing the minimum duration for which the unique row identifier is valid. This can be one of the following values: +--------------+--------------------------------------+---+ |Integer value | | | | | | | | | SQL constant | | | | | | | | Description | | | | | | +--------------+--------------------------------------+---+ | 0 | | | | | | | | | SQL_SCOPE_CURROW | | | | | | | | Row identifier is valid only while | | | | the cursor is positioned on the row. | | | | | | | 1 | | | | | | | | | SQL_SCOPE_TRANSACTION | | | | | | | | Row identifier is valid for the | | | | duration of the transaction. | | | | | | | 2 | | | | | | | | | SQL_SCOPE_SESSION | | | | | | | | Row identifier is valid for the | | | | duration of the connection. | | | | | | +--------------+--------------------------------------+---+ RETURN VALUES
Returns a statement resource with a result set containing rows with unique row identifier information for a table. The rows are composed of the following columns: +------------+---------------------------------------------------+ |Column name | | | | | | | Description | | | | +------------+---------------------------------------------------+ | SCOPE | | | | | | | | | | | | | box, tab (|); c | c | c | . T{ Integer | | | value | | | | | | SQL constant | | | | | | Description | | | | +------------+---------------------------------------------------+ | 0 | | | | | | | SQL_SCOPE_CURROW | | | | | | Row identifier is valid only while the cursor is | | | positioned on the row. | | | | | 1 | | | | | | | SQL_SCOPE_TRANSACTION | | | | | | Row identifier is valid for the duration of the | | | transaction. | | | | | 2 | | | | | | | SQL_SCOPE_SESSION | | | | | | Row identifier is valid for the duration of the | | | connection. | | | | +------------+---------------------------------------------------+ T} T{ COLUMN_NAME T} |T{ Name of the unique column. T} T{ DATA_TYPE T} |T{ SQL data type for the column. T} T{ TYPE_NAME T} |T{ Character string representation of the SQL data type for the column. T} T{ COLUMN_SIZE T} |T{ An integer value representing the size of the column. T} T{ BUFFER_LENGTH T} |T{ Maximum number of bytes necessary to store data from this column. T} T{ DECIMAL_DIGITS T} |T{ The scale of the column, or NULL where scale is not applicable. T} T{ NUM_PREC_RADIX T} |T{ An integer value of either 10 (representing an exact numeric data type), 2 (representing an approximate numeric data type), or NULL (rep- resenting a data type for which radix is not applicable). T} T{ PSEUDO_COLUMN T} |T{ Always returns 1. T} SEE ALSO
db2_column_privileges(3), db2_columns(3), db2_foreign_keys(3), db2_primary_keys(3), db2_procedure_columns(3), db2_procedures(3), db2_sta- tistics(3), db2_table_privileges(3), db2_tables(3). PHP Documentation Group DB2_SPECIAL_COLUMNS(3)
All times are GMT -4. The time now is 10:09 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy