Sponsored Content
Top Forums Shell Programming and Scripting Awk: adding fields after matching $1 Post 302870419 by bartus11 on Sunday 3rd of November 2013 01:43:22 PM
Old 11-03-2013
Try:
Code:
awk -F";" 'NR==FNR{a[$1]=$2;next}{$4=a[$1]}1' OFS=";" 2.txt 1.txt

This User Gave Thanks to bartus11 For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

AWK Matching Fields and Combining Files

Hello! I am writing a program to run through two large lists of data (~300,000 rows), find where rows in one file match another, and combine them based on matching fields. Due to the large file sizes, I'm guessing AWK will be the most efficient way to do this. Overall, the input and output I'm... (5 Replies)
Discussion started by: Michelangelo
5 Replies

2. Shell Programming and Scripting

AWK- delimiting the strings and matching the fields

Hello, I am newbie in awk. I have just started learning it. 1) I have input file which looks like: {4812 4009 1602 2756 306} {4814 4010 1603 2757 309} {8116 9362 10779 } {10779 10121 9193 10963 10908} {1602 2756 306 957 1025} {1603 2757 307} and so on..... 2) In output: a)... (10 Replies)
Discussion started by: kajolo
10 Replies

3. Shell Programming and Scripting

AWK : Add Fields of lines with matching field

Dear All, I would like to add values of a field, if the lines match in a certain field. Then I would like to divide the sum though the number of lines that have a matched field. This is the Input: Input: Test1 5 Test1 10 Test2 2 Test2 5 Test2 13 Test3 4 Output: Test1 7.5 Test1 7.5... (6 Replies)
Discussion started by: DerSeb
6 Replies

4. Shell Programming and Scripting

Awk - Script assistance on identifying non matching fields

Hoping for some assistance. my source file consists of: os, ip, username win7, 123.56.78, john win7, 123.56.78, paul win7, 10.1.1.1, john win7, 10.2.2.3, joe I've been trying to run a script that will only return ip and username where the IP address is the same and the username is... (3 Replies)
Discussion started by: tekvaio
3 Replies

5. Shell Programming and Scripting

awk question ? set 2 variables by matching fields

Hello, I'm trying to get the TOP and BASE numbers printed out File looks like this: 2300 CAR # 2300 is the TOP 2310 CAR 2335 CAR 2455 CAR # 2455 is the BASE 1000 MOTOR # 2455 will become this TOP 2000 MOTOR 3000 MOTOR 4000 MOTOR # 4000 is the BASE 2345 BIKE # 4000... (8 Replies)
Discussion started by: charlieglen
8 Replies

6. UNIX for Advanced & Expert Users

awk print all fields except matching regex

grep -v will exclude matching lines, but I want something that will print all lines but exclude a matching field. The pattern that I want excluded is '/mnt/svn' If there is a better solution than awk I am happy to hear about it, but I would like to see this done in awk as well. I know I can... (11 Replies)
Discussion started by: glev2005
11 Replies

7. UNIX for Beginners Questions & Answers

Awk: matching multiple fields between 2 files

Hi, I have 2 tab-delimited input files as follows. file1.tab: green A apple red B apple file2.tab: apple - A;Z Objective: Return $1 of file1 if, . $1 of file2 matches $3 of file1 and, . any single element (separated by ";") in $3 of file2 is present in $2 of file1 In order to... (3 Replies)
Discussion started by: beca123456
3 Replies

8. Shell Programming and Scripting

awk to print fields that match using conditions and a default value for non-matching in two files

Trying to use awk to match the contents of each line in file1 with $5 in file2. Both files are tab-delimited and there may be a space or special character in the name being matched in file2, for example in file1 the name is BRCA1 but in file2 the name is BRCA 1 or in file1 name is BCR but in file2... (6 Replies)
Discussion started by: cmccabe
6 Replies

9. UNIX for Beginners Questions & Answers

Continued trouble matching fields in different files and selective field printing ([g]awk)

I apologize in advance, but I continue to have trouble searching for matches between two files and then printing portions of each to output in awk and would very much appreciate some help. I have data as follows: File1 PS012,002 PRQ 0 1 1 17 1 0 -1 3 2 1 2 -1 ... (7 Replies)
Discussion started by: jvoot
7 Replies

10. UNIX for Beginners Questions & Answers

awk for matching fields between files with repeated records

Hello all, I am having trouble with what should be an easy task, but seem to be missing something fundamental. I have two files, with File 1 consisting of a single field of many thousands of records. I also have File 2 with two fields and many thousands of records. My goal is that when $1 of... (2 Replies)
Discussion started by: jvoot
2 Replies
regexp(3erl)						     Erlang Module Definition						      regexp(3erl)

NAME
regexp - Regular Expression Functions for Strings DESCRIPTION
Note: This module has been obsoleted by the re module and will be removed in a future release. This module contains functions for regular expression matching and substitution. EXPORTS
match(String, RegExp) -> MatchRes Types String = RegExp = string() MatchRes = {match,Start,Length} | nomatch | {error,errordesc()} Start = Length = integer() Finds the first, longest match of the regular expression RegExp in String . This function searches for the longest possible match and returns the first one found if there are several expressions of the same length. It returns as follows: {match,Start,Length} : if the match succeeded. Start is the starting position of the match, and Length is the length of the matching string. nomatch : if there were no matching characters. {error,Error} : if there was an error in RegExp . first_match(String, RegExp) -> MatchRes Types String = RegExp = string() MatchRes = {match,Start,Length} | nomatch | {error,errordesc()} Start = Length = integer() Finds the first match of the regular expression RegExp in String . This call is usually faster than match and it is also a useful way to ascertain that a match exists. It returns as follows: {match,Start,Length} : if the match succeeded. Start is the starting position of the match and Length is the length of the matching string. nomatch : if there were no matching characters. {error,Error} : if there was an error in RegExp . matches(String, RegExp) -> MatchRes Types String = RegExp = string() MatchRes = {match, Matches} | {error, errordesc()} Matches = list() Finds all non-overlapping matches of the expression RegExp in String . It returns as follows: {match, Matches} : if the regular expression was correct. The list will be empty if there was no match. Each element in the list looks like {Start, Length} , where Start is the starting position of the match, and Length is the length of the matching string. {error,Error} : if there was an error in RegExp . sub(String, RegExp, New) -> SubRes Types String = RegExp = New = string() SubRes = {ok,NewString,RepCount} | {error,errordesc()} RepCount = integer() Substitutes the first occurrence of a substring matching RegExp in String with the string New . A & in the string New is replaced by the matched substring of String . & puts a literal & into the replacement string. It returns as follows: {ok,NewString,RepCount} : if RegExp is correct. RepCount is the number of replacements which have been made (this will be either 0 or 1). {error, Error} : if there is an error in RegExp . gsub(String, RegExp, New) -> SubRes Types String = RegExp = New = string() SubRes = {ok,NewString,RepCount} | {error,errordesc()} RepCount = integer() The same as sub , except that all non-overlapping occurrences of a substring matching RegExp in String are replaced by the string New . It returns: {ok,NewString,RepCount} : if RegExp is correct. RepCount is the number of replacements which have been made. {error, Error} : if there is an error in RegExp . split(String, RegExp) -> SplitRes Types String = RegExp = string() SubRes = {ok,FieldList} | {error,errordesc()} Fieldlist = [string()] String is split into fields (sub-strings) by the regular expression RegExp . If the separator expression is " " (a single space), then the fields are separated by blanks and/or tabs and leading and trailing blanks and tabs are discarded. For all other values of the separator, leading and trailing blanks and tabs are not discarded. It returns: {ok, FieldList} : to indicate that the string has been split up into the fields of FieldList . {error, Error} : if there is an error in RegExp . sh_to_awk(ShRegExp) -> AwkRegExp Types ShRegExp AwkRegExp = string() SubRes = {ok,NewString,RepCount} | {error,errordesc()} RepCount = integer() Converts the sh type regular expression ShRegExp into a full AWK regular expression. Returns the converted regular expression string. sh expressions are used in the shell for matching file names and have the following special characters: * : matches any string including the null string. ? : matches any single character. [...] : matches any of the enclosed characters. Character ranges are specified by a pair of characters separated by a - . If the first character after [ is a ! , then any character not enclosed is matched. It may sometimes be more practical to use sh type expansions as they are simpler and easier to use, even though they are not as pow- erful. parse(RegExp) -> ParseRes Types RegExp = string() ParseRes = {ok,RE} | {error,errordesc()} Parses the regular expression RegExp and builds the internal representation used in the other regular expression functions. Such representations can be used in all of the other functions instead of a regular expression string. This is more efficient when the same regular expression is used in many strings. It returns: {ok, RE} if RegExp is correct and RE is the internal representation. : {error, Error} if there is an error in RegExpString . : format_error(ErrorDescriptor) -> Chars Types ErrorDescriptor = errordesc() Chars = [char() | Chars] Returns a string which describes the error ErrorDescriptor returned when there is an error in a regular expression. REGULAR EXPRESSIONS
The regular expressions allowed here is a subset of the set found in egrep and in the AWK programming language, as defined in the book, The AWK Programming Language, by A. V. Aho, B. W. Kernighan, P. J. Weinberger . They are composed of the following characters: c : matches the non-metacharacter c . c : matches the escape sequence or literal character c . . : matches any character. ^ : matches the beginning of a string. $ : matches the end of a string. [abc...] : character class, which matches any of the characters abc... Character ranges are specified by a pair of characters separated by a - . [^abc...] : negated character class, which matches any character except abc... . r1 | r2 : alternation. It matches either r1 or r2 . r1r2 : concatenation. It matches r1 and then r2 . r+ : matches one or more r s. r* : matches zero or more r s. r? : matches zero or one r s. (r) : grouping. It matches r . The escape sequences allowed are the same as for Erlang strings:  : backspace f : form feed : newline (line feed) : carriage return : tab e : escape v : vertical tab s : space d : delete ddd : the octal value ddd xhh : The hexadecimal value hh . x{h...} : The hexadecimal value h... . c : any other character literally, for example \ for backslash, " for ") To make these functions easier to use, in combination with the function io:get_line which terminates the input line with a new line, the $ characters also matches a string ending with "... " . The following examples define Erlang data types: Atoms [a-z][0-9a-zA-Z_]* Variables [A-Z_][0-9a-zA-Z_]* Floats (+|-)?[0-9]+.[0-9]+((E|e)(+|-)?[0-9]+)? Regular expressions are written as Erlang strings when used with the functions in this module. This means that any or " characters in a regular expression string must be written with as they are also escape characters for the string. For example, the regular expression string for Erlang floats is: "(\+|-)?[0-9]+\.[0-9]+((E|e)(\+|-)?[0-9]+)?" . It is not really necessary to have the escape sequences as part of the regular expression syntax as they can always be generated directly in the string. They are included for completeness and can they can also be useful when generating regular expressions, or when they are entered other than with Erlang strings. Ericsson AB stdlib 1.17.3 regexp(3erl)
All times are GMT -4. The time now is 02:44 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy