Visit Our UNIX and Linux User Community


sort and split file by 2 cols (1 col after the other)


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting sort and split file by 2 cols (1 col after the other)
# 15  
Old 07-28-2009
"cut" command maybe an alternative to awk way to split any file with fixed or variable lenghth fields and definable field separator.

Last edited by gch; 07-28-2009 at 06:28 PM..
# 16  
Old 07-28-2009
Quote:
Originally Posted by Ghetz
If I enter values for the 4th and 5th columns on the command line, how can I extract the corresponding files? Example if I enter the following:
Code:
4th column = 0.000000 , 55.000000, 100.000000
5th column = 1

Code:
sort -nk4 file | awk '$4 ~ "^[0|55|100]" && $5==1{ file=$4"_"$5".txt"; print file }'



Quote:
Originally Posted by Ghetz
How do I extract /select the corresponding
Code:
0.000000 1.txt, 55.000000 1.txt, 100.000000 1.txt

files
Is this a "catch 22" ? Base on your data sample will be only one file Smilie
# 17  
Old 07-29-2009
gch
Thanks for you "cut" suggestion.

danmero
Quote:
Is this a "catch 22" ? Base on your data sample will be only one file
Seems like, but not.

The sample file contains "layers" for a visualization program.

For example:

0.000000 1.txt
66576.867188 4232.454102 2.944000 0.000000 1
76576.867188 6232.454102 1.944000 0.000000 1
86576.867188 5232.454102 3.944000 0.000000 1

55.000000 2.txt
66576.867188 4232.454102 0.855956 55.000000 2
76576.867188 6232.454102 0.792961 55.000000 2
86576.867188 5232.454102 0.705243 55.000000 2

represent layer 1 @ 0.000000 and layer 2 @ 55.000000.

I want to select "layer" files for visualization by entering their 4th and 5th column values on the command line.

Hope this outlines what I am trying to do.

Thanks for all the help so far, really appreciated.
# 18  
Old 07-30-2009
I think the below code snippet may help you.
the sample_log contains the sample input.

Code:
cat sample_log | while read LINE
do
#$echo $i
fl_name=`echo $LINE | awk '{ print $5 }'`
#echo $fl_name
fl_nm=$fl_name.txt
#echo $fl_nm
var1=`echo $LINE | awk '{print $4 }'`
echo $var1 " " $fl_name >$fl_nm
echo $LINE >>$fl_nm
echo "............................. $var1 $fl_name">>$fl_nm
done

# 19  
Old 07-30-2009
Quote:
Originally Posted by Ghetz
I want to select "layer" files for visualization by entering their 4th and 5th column values on the command line.
Something like that ?
Code:
# fourth="0.000000|55.000000|100.000000"
# fifth=1
# sort -nk4 file | awk '$4 ~ x && $5==y{ file=$4"_"$5".txt"; print > file }' x=$fourth y=$fifth

# 20  
Old 07-30-2009
siba
Thanks, your code works just like danmero's earlier solution.

danmero
Much appreciation, you have answered my last question.

Previous Thread | Next Thread
Test Your Knowledge in Computers #150
Difficulty: Easy
Oracle discontinued OpenSolaris after their acquisition of Sun Microsystems.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Sort files to the split second

I need a similar sort, I need to sort the directory by time, but time needs to be to the second or smaller. Using ls -lt but that is only to the minute. (3 Replies)
Discussion started by: mwlaursen
3 Replies

2. Shell Programming and Scripting

Sort and Split file with header and custom name

Hi, I am using SUN SOLARIS (SunOS sun4v sparc SUNW, T5240). I have a huge data file with header and trailer. This file gets used into an ETL process. ETL skips the header record (which is the first record of the file) and loads the rest of the record. The file can be delimited (comma,... (5 Replies)
Discussion started by: Saanvi1
5 Replies

3. Shell Programming and Scripting

Modifying col values based on another col

Hi, Please help with this. I have several excel files (with and .xlsx format) with 10-15 columns each. They all have the same type of data but the columns are not ordered in the same way. Here is a 3 column example. What I want to do add the alphabet from column 2 to column 3, provided... (9 Replies)
Discussion started by: newbie83
9 Replies

4. Shell Programming and Scripting

Printing from col x to end of line, except last col

Hello, I have some tab delimited data and I need to move the last col. I could hard code it, awk '{ print $1,$NF,$2,$3,$4,etc }' infile > outfile but it would be nice to know the syntax to print a range cols. I know in cut you can do, cut -f 1,4-8,11- to print fields 1,... (8 Replies)
Discussion started by: LMHmedchem
8 Replies

5. Shell Programming and Scripting

how to Insert values in multiple lines(records) within a pipe delimited text file in specific cols

this is Korn shell unix. The scenario is I have a pipe delimited text file which needs to be customized. say for example,I have a pipe delimited text file with 15 columns(| delimited) and 200 rows. currently the 11th and 12th column has null values for all the records(there are other null columns... (4 Replies)
Discussion started by: vasan2815
4 Replies

6. UNIX for Advanced & Expert Users

Print line based on highest value of col (B) and repetion of values in col (A)

Hello everyone, I am writing a script to process data from the ATP world tour. I have a file which contains: t=540 y=2011 r=1 p=N409 t=540 y=2011 r=2 p=N409 t=540 y=2011 r=3 p=N409 t=540 y=2011 r=4 p=N409 t=520 y=2011 r=1 p=N409 t=520 y=2011 r=2 p=N409 t=520 y=2011 r=3 p=N409 The... (4 Replies)
Discussion started by: imahmoud
4 Replies

7. Ubuntu

Match col 1 of File 1 with col 1 File 2 and create a 3rd file

Hello, I have a 1.6 GB file that I would like to modify by matching some ids in col1 with the ids in col 1 of file2.txt and save the results into a 3rd file. For example: File 1 has 1411 rows, I ignore how many columns it has (thousands) File 2 has 311 rows, 1 column Would like to... (7 Replies)
Discussion started by: sogi
7 Replies

8. Shell Programming and Scripting

How to find number of Cols in a file ?

Hi I have a requirement wherein the file is comma separated. Each records seems to have different number of columns, how I can detect like a row index wise, how many columns are present ? Thanks in advance. (2 Replies)
Discussion started by: videsh77
2 Replies

9. Shell Programming and Scripting

Sort & Split records in a file

Hi, I am new to scripting. I need a script to sort and the records in a file and then split them into different files. For example, the file is: H1...................... H2...................... D2.................... D2.................... H1........................... (15 Replies)
Discussion started by: Sunitha_edi82
15 Replies

10. Shell Programming and Scripting

join cols from multi files into one file

Hi Fields in Files 1,2,3,4 are pipe"|" separated. Say I want to grep col1 from File1 col3 from File2 col4 from File3 and print to File4 in the following order: col3|col1|col4 what is the best way of doing this? Thanks (2 Replies)
Discussion started by: vbshuru
2 Replies

Featured Tech Videos