Sponsored Content
Full Discussion: File handling issue
Top Forums UNIX for Dummies Questions & Answers File handling issue Post 302842067 by Gurkamal83 on Thursday 8th of August 2013 11:35:12 AM
Old 08-08-2013
Hi Just Ice,

I think I got the way to code this solution.

But I need one help

e.g.
Code:
202XXXXXXXXXXXXXX-Header
1101XXXXXXXXXXXXXXX
202XXXXXXXXXXXXXX-Trailer
202XXXXXXXXXXXXXX-Header
1101XXXXXXXXXXXXXXX
1101XXXXXXXXXXXXXXX
1101XXXXXXXXXXXXXXX
1101XXXXXXXXXXXXXXX
202XXXXXXXXXXXXXX-Trailer

grep -n ^202 filename > test
1:202XXXXXXXXXXXXXX-Header
3:202XXXXXXXXXXXXXX-Trailer
4:202XXXXXXXXXXXXXX-Header
9:202XXXXXXXXXXXXXX-Trailer

 cut -d ':' -f1,1 test >test1
 test1 will have
 1
 3
 4
 9

Say I want to have maximum 5 records in first file
So, what I will do is add to first header + 5 = 6

And find a number in test1 less than 6
which is 4. Check if it is header or trailer

Since this is header will cut 1thru 3 and 4 thru 9 and generate 2 split files.

All I need is, Is there a way to find a number less than 6 in my test1 file without reading each record line by line.

Reason I want to do that is my file is very very big. It has trillions of records.

Reading header trailer number line by line will make my processing too slow.

Last edited by Scott; 08-08-2013 at 01:26 PM.. Reason: Added code tags [8th time]
 

10 More Discussions You Might Find Interesting

1. Programming

File Handling in C

Hi all, I have a problem in handling files through C. here is the problem im having: i will query the database (for instance consider employees table ) for empno,ename,job,salary fields.The query returns me some 100 of rows. now i need to place them in a file in row wise pattern as they... (3 Replies)
Discussion started by: trinath
3 Replies

2. UNIX for Advanced & Expert Users

please help me in file handling

sir i have to get first line from a file for example >cat file1 abc zxc asd adsf from that file1 i need only first line expected result >abc please help me ! (1 Reply)
Discussion started by: ponmuthu
1 Replies

3. Shell Programming and Scripting

UNIX File handling -Issue in reading a file

I have been doing automation of daily check activity for a server, i have been using sqls to retrive the data and while loop for reading the data from the file for several activities. BUT i got a show stopper the below one.. where the data is getting store in $temp_file, but not being read by while... (1 Reply)
Discussion started by: KuldeepSinghTCS
1 Replies

4. Shell Programming and Scripting

Issue with Error handling,not able to continue the script further

Hi, I am trying to write a script to cleanup files in a log directory .. cd log find Datk** -mtime +7 -exec rm -f {} \; 2> /dev/null Have used the above to clean up files in log directory more then 7 days older. The file can be something like ( auto-generate by some processes and... (2 Replies)
Discussion started by: nss280
2 Replies

5. Shell Programming and Scripting

UNIX file handling issue

I have a huge file semicolon( ; ) separated records are Pipe(|) delimited. e.g abc;def;ghi|jkl;mno;pqr|123;456;789 I need to replace the 50th field(semicolon separated) of each record with 9006. The 50th field can have no value e.g. ;; Can someone help me with the appropriate command. (3 Replies)
Discussion started by: Gurkamal83
3 Replies

6. UNIX for Dummies Questions & Answers

Large file data handling issue

I have a single record large file, semicolon ';' and pipe '|' separated. I am doing a vi on the file. It is throwing an error "File to long" I need to actually remove the last | symbol from this file. sed -e 's/\|*$//' filename is working fine for small files. But not working on this big... (13 Replies)
Discussion started by: Gurkamal83
13 Replies

7. UNIX for Dummies Questions & Answers

File Handling

Hi Team, I am trying to cut a large file into multiple files. It has Header 50,050 records Trailer ------------------------------------------- I need to cut the files into multiple files of 1000 records and should have the same header and trailer as the original files. ... (4 Replies)
Discussion started by: Gurkamal83
4 Replies

8. Shell Programming and Scripting

ISSUE in handling multiple same name files :-(

Dear all, My work is completely stuck cos of the following issue. Please find it here and kindly help me. Task is following: I have set of files with such pattern 1t-rw-rw-r-- 1 emily emily 119 Jun 11 10:45 vgtree_5_1_pfs.root 3t-rw-rw-r-- 1 emily emily 145 Jun 11 10:46 vgtree_5_3_pfs.root... (4 Replies)
Discussion started by: emily
4 Replies

9. Shell Programming and Scripting

Issue handling single quoted argument in shell script.

Below is my script that works fine and prints the desired output: #!/bin/ksh echo "$1" | while IFS= read -r dirpath do echo "DIRR_PATH:$dirpath" install_dir=$install_dir" "$dirpath done echo "Desired Output:$install_dir" Output: ./loopissue.sh... (10 Replies)
Discussion started by: mohtashims
10 Replies

10. Shell Programming and Scripting

File handling

Hi All, I need to extract the data from the text file. The data of the text file is shown below #L 0.000017 4.329939 0.000017 4.716267 r7.9 P 1 1;Net=IN32 The extracted data should be IN32. Could anyone help to script in c shell.? (4 Replies)
Discussion started by: gopishrine
4 Replies
uuencode(5)							File Formats Manual						       uuencode(5)

Name
       uuencode - format of an encoded uuencode file

Description
       Files  output by consist of a header line, followed by a number of body lines, and a trailer line.  The command ignores any lines preceding
       the header or following the trailer.  Lines preceding a header must not, of course, look like a header.

       The header line is distinguished by having the first six characters by the word ``begin'', followed by a space.	The next item on the  line
       is a mode (in octal) and a string which names the remote file.  A space separates the three items in the header line.

       The  body  consists  of	a  number of lines, each at most 62 characters long including the trailing new line.  These consist of a character
       count, followed by encoded characters, followed by a new line.  The character count is a single printing character and represents an  inte-
       ger, the number of bytes the rest of the line represents.  Such integers are always in the range from 0 to 63 and can be determined by sub-
       tracting the character space (octal 40) from the character.

       Groups of 3 bytes are stored in 4 characters, with 6 bits per character.  All are offset by a space to make the characters print.  The last
       line may be shorter than the normal 45 bytes.  If the size is not a multiple of 3, this fact can be determined by the value of the count on
       the last line.  Extra dummy characters are included to make the character count a multiple of 4.  The body is terminated by a line  with  a
       count of zero.  This line consists of one ASCII space.

       The trailer line consists of "end" on a line by itself.

See Also
       mail(1), uucp(1c), uudecode(1c), uuencode(1c), uusend(1c)

																       uuencode(5)
All times are GMT -4. The time now is 09:43 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy