Parsing a file based on positional constraints Post: 302928426

Sponsored Content

Top Forums Shell Programming and Scripting Parsing a file based on positional constraints Post 302928426 by junior-helper on Thursday 11th of December 2014 01:47:56 PM

12-11-2014

Registered User

Quote:

If the position of "dog" occurs every time (whenever it occurs) as a first or last position then it will go to a new file called file_external. If not then it will go to new file file_internal.

Quote:

cat comes in middle, end and first positions, so will append to file_internal.

To me, this is not clear... dog occurs as a first and/or last position and goes to file_ext, if not, he goes to file_int. Question: Why does the cat go to file_int no matter of the position?

Anyhow, you might want to try this code:

Code:

awk 'NR==FNR{ A[$0]++; next }
    { for (i=1;i<=NF;i++)
        {
            if ($i in A) if (i == 1 || i == NF) { E[$i]++ } else { I[$i]++ }
        }
}
END { for (e in E) print e; print "----------------"; for (i in I) print i }
' file1 file2

Demo:

Code:

$ awk 'NR==FNR{ A[$0]++; next }
>     { for (i=1;i<=NF;i++)
>         {
>             if ($i in A) if (i == 1 || i == NF) { E[$i]++ } else { I[$i]++ }
>         }
> }
> END { for (e in E) print e; print "----------------"; for (i in I) print i }
> ' file1 file2
fish
dog
duck
cow
cat
----------------
dog
crow
cat
fox
$

If the output is correct, in the awk END section you can simply change print e to print e >> "file.ext" and print i to print i >> "file.int" to redirect the output to appropriate files.

Hope I didn't miss the point Smilie

junior-helper

View Public Profile for junior-helper

Find all posts by junior-helper

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parsing of file for Report Generation (String parsing and splitting)

Hey guys, I have this file generated by me... i want to create some HTML output from it. The problem is that i am really confused about how do I go about reading the file. The file is in the following format: TID1 Name1 ATime=xx AResult=yyy AExpected=yyy BTime=xx BResult=yyy...

2. Shell Programming and Scripting

Get the positional value from first line of the file

Hi, I have one flat file with delimited field as pipe(|) symbol. The file contains header,detail lines. Header is the first line in the file. I want to read the value for the position from 15 to 18 in first line of the file. Pls help me to get the value from position 15 to 18 in...

3. Shell Programming and Scripting

Split positional flat file.

Hi, I need to split positional flat file, based on value at position 43-45.( in red "410") Example: 12345678907886421689 200920184820410200920020092002007 12345678907886421689 200920184820411200920020092002007 12345678907886421689 200920184820411200920020092002007...

4. Shell Programming and Scripting

Parsing Log File Based on Date & Error

I'm still up trying to figure this out and it is driving me nuts. I have a log file which has a basic format of this... 2010-10-10 22:25:42 Init block 'UA Deployment Date': Dynamic refresh of repository scope variables has failed. The ODBC function has returned an error. The database...

5. Shell Programming and Scripting

parsing file based on characters/bytes

I have a datafile that is formatted as fixed. I know that each line should contain 880 characters. I want to separate the file into 2 files, one that has lines with 880 characters and the other file with everything else. Is this possible ?

6. UNIX for Dummies Questions & Answers

Remove lines in a positional file based on string value

Gurus, I am relatively new to Unix scripting and am struck with a problem in my script. I have positional input file which has a FLAG indicator in at position 11 in every record of the file. If the Flag has value =Y, then the record from the input needs to be written to a new file.However if...

7. Shell Programming and Scripting

Positional Update of XML File

Hello, I have a XML file and need to update the data for a specific XML Attribute in the file. I need a Perl or Awk command to look for <INTERCHANGE_CONTROL_NO>000000601</INTERCHANGE_CONTROL_NO> in the XML file and change the first two 0 of the value to 9. For instance ...

8. Shell Programming and Scripting

Parsing a file based on next line

I have a file1 like ID E2AK1_HUMAN Reviewed; 630 AA. CC -!- SUBCELLULAR LOCATION: Host nucleus {ECO:0000305}. ID E1A_ADEM1 Reviewed; 200 AA. ID E1A_ADES7 Reviewed; 266 AA. CC -!- SUBCELLULAR LOCATION: Host nucleus...

9. Shell Programming and Scripting

File Parsing based on a character in a specific field

Hi All, I'm having a hard time finding a starting point for my issue. I have a 30k line file (fspsec.txt) that I would like to parse into smaller files based on any character existing in field 1. ACCOUNTANT LEVEL 1 (ACCT.ACCOUNTANT) OPERATORS: DOEJO (418) TOOLS: Branch Maintenance ...

LEARN ABOUT OPENSOLARIS

gvfs-cat

gvfs-cat(1)							   User Commands						       gvfs-cat(1)

NAME

       gvfs-cat - print a file to standard output using the VFS system

SYNOPSIS

       gvfs-cat URI

DESCRIPTION

       gvfs-cat prints a file to standard output using the virtual file system to access the file via a URI.

OPERANDS

       The following operands are supported:

       URI	Specifies the file location in standard URI format.

EXAMPLES

       Example 1: Cat a File From a Web Server

       example% gvfs-cat http://www.sun.com

       Example 2: Cat a Local File

       example% gvfs-cat file:///home/user/README.txt

ENVIRONMENT VARIABLES

       See environ(5) for descriptions of the following environment variables: NLSPATH.

EXIT STATUS

       The exit value 0 is returned regardless of success or failure.

FILES

       The following files are used by this application:

       /usr/bin/gvfs-cat       Executable to print a file to standard output using the VFS system

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWgnome-gvfs		   |
       +-----------------------------+-----------------------------+
       |Interface stability	     |Volatile			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       gvfs-copy(1), gvfs-info(1), gvfs-less(1), gvfs-ls(1), gvfs-mkdir(1) gvfs-monitor-dir(1), gvfs-monitor-file(1), gvfs-mount(1), gvfs-move(1),
       gvfs-rename(1), gvfs-open(1), gvfs-rm(1), gvfs-save(1), gvfs-trash(1), gvfs-tree(1), attributes(5), environ(5)

NOTES

       Written by Alvaro Lopez Ortega, Sun Microsystems Inc., 2008.

SunOS 5.11							    25 Mar 2008 						       gvfs-cat(1)