How to split a fixed width text file into several ones based on a column value?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to split a fixed width text file into several ones based on a column value?
# 1  
Old 12-21-2010
Question How to split a fixed width text file into several ones based on a column value?

Hi,

I have a fixed width text file without any header row. One of the columns contains a date in YYYYMMDD format.

If the original file contains 3 dates, I want my shell script to split the file into 3 small files with data for each date.

I am a newbie and need help doing this.
# 2  
Old 12-21-2010
please post sample input and expected output.

Regards
Ravi
This User Gave Thanks to panyam For This Post:
# 3  
Old 12-21-2010
Sample file attached

Ok... here is a sample.

The first field is Date in YYYYMMDD.

As you can see, there are 3 dates viz. 20100313, 20100306 and 20100227.

The length of the Date field is 8 bytes.

I want my shell script to read this file and create 3 files, each with data for each of the 3 dates.

Thanks in advance. Smilie

Code:
20100313  25     2899780446536301 0   1    9.99
20100313  22     9819780446541930 0   1    6.99
20100313  15     1539780446194068 0   1    7.99
20100313  25      459780316044936 0   1   11.24
20100313  20     1279780446570978 0   1   11.24
20100306  26     9959780446570961 0   1    5.99
20100306  24      659780316036221 0   1   16.79
20100227  16      189780446539746 0   2   14.98
20100227  25      279780446570978 0   2   20.98
20100227  19      149780446561334 0   2   22.48
20100227   8      499780446194068 0   2   11.98
20100227  22     8379780446539746 0   3   22.47


Last edited by Scott; 12-21-2010 at 10:56 AM.. Reason: No need for an attachment for such a small amount of data
# 4  
Old 12-21-2010
Code:
awk '{ print > $1".txt" }'  input_file.txt

This User Gave Thanks to panyam For This Post:
# 5  
Old 12-21-2010
Shorter Smilie:
Code:
awk '{print > $1 ".txt"}' file

@panyam was faster Smilie
This User Gave Thanks to Franklin52 For This Post:
# 6  
Old 12-21-2010
what about cut command?

Code:
cut -c1-8 <s1.txt >s2.txt

pulling the first 8 columns of file s1.txt into s2.txt
# 7  
Old 12-21-2010
Quote:
Originally Posted by joeyg
Code:
cut -c1-8 <s1.txt >s2.txt

pulling the first 8 columns of file s1.txt into s2.txt
I don't think this will serve the purpose !!!

Since OP want the output to be stored on different files based on column1 which is date.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Search and replace value based on certain conditions in a fixed width file

Hi Forum. I tried searching for a solution using the internet search but I haven't been able to find any solution for what I'm trying to accomplish. I have a fixed width column file where I need to search for any occurrences of "D0" in col pos.#1-2, 10-11, 20-21 and replaced it with "XD". ... (2 Replies)
Discussion started by: pchang
2 Replies

2. Shell Programming and Scripting

UNIX command -Filter rows in fixed width file based on column values

Hi All, I am trying to select the rows in a fixed width file based on values in the columns. I want to select only the rows if column position 3-4 has the value AB I am using cut command to get the column values. Is it possible to check if cut -c3-4 = AB is true then select only that... (2 Replies)
Discussion started by: ashok.k
2 Replies

3. Shell Programming and Scripting

Print column details from fixed width file using awk command

hi, i have a fixed width file with multiple columns and need to print data using awk command. i use: awk -F "|" '($5 == BH) {print $1,$2,$3}' <non_AIM target>.txt for a delimiter file. but now i have a fixed width file like below: 7518 8269511BH 20141224951050N8262 11148 8269511BH... (5 Replies)
Discussion started by: kcdg859
5 Replies

4. Shell Programming and Scripting

To replace the value of the column in a fixed width file

I have a fixed with file with header & trailer length having the same length of the detail record file. The details record length of this file is 24, for Header and Trailer the records will be padded with spaces to match the record length of the file Currently I am adding 3 spaces in header... (14 Replies)
Discussion started by: ginrkf
14 Replies

5. Shell Programming and Scripting

Fixed width file search based on position value

Hi, I am unable to find the right option to extract the data in the fixed width file. sample data abcd1234xgyhsyshijfkfk hujk9876 io xgla loki8787eljuwoejroiweo dkfj9098 dja Search based on position 8-9="xg" and print the entire row output ... (4 Replies)
Discussion started by: onesuri
4 Replies

6. UNIX for Dummies Questions & Answers

Remove duplicates based on a column in fixed width file

Hi, How to output the duplicate record to another file. We say the record is duplicate based on a column whose position is from 2 and its length is 11 characters. The file is a fixed width file. ex of Record: DTYU12333567opert tjhi kkklTRG9012 The data in bold is the key on which... (1 Reply)
Discussion started by: Qwerty123
1 Replies

7. Shell Programming and Scripting

Changing one column of delimited file column to fixed width column

Hi, Iam new to unix. I have one input file . Input file : ID1~Name1~Place1 ID2~Name2~Place2 ID3~Name3~Place3 I need output such that only first column should change to fixed width column of 15 characters of length. Output File: ID1<<12 spaces>>Name1~Place1 ID2<<12... (5 Replies)
Discussion started by: manneni prakash
5 Replies

8. Shell Programming and Scripting

edit entire column from a fixed-width file using awk or sed

Col1 Col2 Col3 Col4 12 Completed 08 0830 12 In Progress 09 0829 11 For F U 07 0828 Considering the file above, how could i replace the third column the most efficient way? The actual file size is almost 1G. I am... (10 Replies)
Discussion started by: tamahomekarasu
10 Replies

9. Shell Programming and Scripting

Comparing column of variable length anf fixed width file

Hi, I have two input files. File1: ID Name Place 1-234~name1~Newyork 1-34~name2~Boston 1-2345~name3~Hungary File1 is a variable length file where each column is seperated by delimitter "~". File2: ID Country 1-34<<11 SPACES>>USA<<7 spaces>> 1-234<<10 SPACES>>UK<<8... (5 Replies)
Discussion started by: manneni prakash
5 Replies
Login or Register to Ask a Question