Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

Data file manipulation

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Data file manipulation
# 8  
Old 03-24-2011
Yeah.
Generally, instead of
Code:
command < ( sort -k2,2 $FILE1 )

I write

Code:
 
sort -k2,2 $FILE1 > somefile
command somefile

So, basically, I would have written your code with 3 lines. So, I can dissect and understand most of it. Right now, I am just trying to figure out the exact nature/usage of "join".

The best part about shell internal commands that I like compared to awk or sed is that they are super-freaking -fast.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Data manipulation, Please help..

Hello, I have a huge set of data that needs to be reformatted. Here is a simple example to explain the process. I have number n=5 and a input with many numbers separated with comma: ... (11 Replies)
Discussion started by: liuzhencc
11 Replies

2. UNIX for Dummies Questions & Answers

Data Manipulation

Dear Sir, I have file input RGR001|108.28|-2.86489|100-120|RANGGAR RGR002|108.071|-2.69028|80-100|RANNGAR RGR003|108.168|-2.97053|50-80|RANNGAR RGR007|108.192722222|-2.766138889|0-50|RANGGARI want to create files by joining each rows with each rows below Output as below ... (4 Replies)
Discussion started by: radius
4 Replies

3. UNIX for Dummies Questions & Answers

Data manipulation

Hallo Team, I need to manipulate existing data file. Have a look at current data and expected data: Current Data: 27873517141 27873540000 27873515109 27873517140 27873540001 27873540000 27873501343 27873540000 27873517140 27873511292 27873645989 27873540000 27873540000... (7 Replies)
Discussion started by: kekanap
7 Replies

4. Shell Programming and Scripting

Data Manipulation on a .csv file

Hallo Friends, I need you help. My file has 5000 or so lines and currently looks like below(sample). Service Type,Origin,Destination,Rate Per Minute,Minimum Charge,Time Based Rate,Time Based From Day,Time Based To Day,Time Based From Time,Time Based To Time,Destination Prefix List,, VoIS... (3 Replies)
Discussion started by: kekanap
3 Replies

5. Shell Programming and Scripting

Manipulation of file data with UNIX

Hello , How all doing today.. I have a little doubt in Unix (6 Replies)
Discussion started by: adisky123
6 Replies

6. Shell Programming and Scripting

Populating File data with custom manipulation on file names

Hi, I am confused how to proceed firther please find the problem below: Input Files: DCIA_GEOG_DATA_OCEAN.TXT DCIA_GEOG_DATA_MCRO.TXT DCIA_GEOG_DATA_CVAS.TXT DCIA_GEOG_DATA_MCR.TXT Output File Name: MMA_RFC_GEOG_NAM_DIM_LOD.txt Sample Record(DCIA_GEOG_DATA_OCEAN.TXT):(Layout same for... (4 Replies)
Discussion started by: Arun Mishra
4 Replies

7. Shell Programming and Scripting

Data manipulation from a file

i have a file in follwing format 0110 1020 1011 1032 1020 2005 2003 1050 i want the output in such a way that all non zero numbers will be converted into 1 like this 0110 1010 1011 1011 1010 1001 1001 1010 (3 Replies)
Discussion started by: vaibhavkorde
3 Replies

8. Shell Programming and Scripting

Data manipulation from one file

HI all i have a file consisting of following numbers 0000 0000 0000 0000 0000 1010 0000 0100 0000 0000 0000 1111 0000 1010 0000 0100 (3 Replies)
Discussion started by: vaibhavkorde
3 Replies

9. UNIX for Dummies Questions & Answers

Data Manipulation

Hello I am currently having problems in mapulating a certain file which contains vaious data. Belos is a sample content Event=<3190> Client IP=<151.111.11.143> DNS=<abc.sbc.com> TransCount=<139> Client IP=<150.222.133.163> DNS=<xyz.yuu.com> TransCount=<3734> Event=<3120> Client... (11 Replies)
Discussion started by: khestoi
11 Replies

10. UNIX for Dummies Questions & Answers

UNIX - File/Table/Data manipulation

Hi, I have a table (e.g.): a 1 e 4 5 6 b 2 r 4 4 2 c 5 r 3 7 1 d 9 t 4 4 9 . . What I need to do is to set the values of some values in column 2 to negative values. For example, the values 2 and 9 should become -2 and -9 in the modified file. How should I go about... (2 Replies)
Discussion started by: pc2001
2 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

combine

COMBINE(1)																COMBINE(1)

NAME

       combine - combine sets of lines from two files using boolean operations

SYNOPSIS

       combine file1 and file2

       combine file1 not file2

       combine file1 or file2

       combine file1 xor file2

       _ file1 and file2 _

       _ file1 not file2 _

       _ file1 or file2 _

       _ file1 xor file2 _

DESCRIPTION

       combine combines the lines in two files. Depending on the boolean operation specified, the contents will be combined in different ways:

       and Outputs lines that are in file1 if they are also present in file2.

       not Outputs lines that are in file1 but not in file2.

       or  Outputs lines that are in file1 or file2.

       xor Outputs lines that are in either file1 or file2, but not in both files.

       "-" can be specified for either file to read stdin for that file.

       The input files need not be sorted, and the lines are output in the order they occur in file1 (followed by the order they occur in file2
       for the two "or" operations). Bear in mind that this means that the operations are not commutative; "a and b" will not necessarily be the
       same as "b and a". To obtain commutative behavior sort and uniq the result.

       Note that this program can be installed as "_" to allow for the syntactic sugar shown in the latter half of the synopsis (similar to the
       test/[ command). It is not currently installed as "_" by default, but you can alias it to that if you like.

SEE ALSO

       join(1)

AUTHOR

       Copyright 2006 by Joey Hess <joey@kitenet.net>

       Licensed under the GNU GPL.

moreutils							    2012-04-09								COMBINE(1)