Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to cut a flat file according to a certain number of characters?
Operating Systems AIX How to cut a flat file according to a certain number of characters? Post 302392505 by Corona688 on Thursday 4th of February 2010 03:06:11 PM
Old 02-04-2010
Quote:
Originally Posted by fastlane3000
hello and thx for answering me so fast

sorry i was wrong, actually it's a text file of 200 MegaBytes !
Still doable. As long as you're not doing a sort on it or any other sort of thing that requires chunking it all into memory at once, the only difference is it'll take longer.
Quote:
i googled for "split"
... Try reading its man page. No googling, it just comes up. 'man split'. The version I have works with bytes OR lines, which makes it pretty clear to me that 1 byte = 1 char. But you want it in one file, not separate files, so that suggestion of mine was wrong...
Quote:
i've heard about awk and i keep looking, if there's something that works i'll tell you
I don't think awk, or any other line-based tool, can operate on a line 200 megabytes long. I'll try and find something in bash...

[edit] bash took minutes and minutes to process a 5 meg file. dd works better but you have to read the man page... the 'unblock' mode converts trailing spaces to newlines, so, for the data you gave:

Code:
dd cbs=9 ibs=9 obs=9 if=longline of=longfile conv=unblock

converted a 10 meg file in 5 seconds.
Last edited by Corona688; 02-04-2010 at 04:22 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help Replacing Characters in Flat File

I was wondering if somebody could help me with something on UNIX. I have a file that looks like this - "nelson,bill","bill","123 Main St","Mpls","MN",55444,8877,william I want to replace all comma with pipes (|), except if the comma is within double quotes. (The first field is an example of... (8 Replies)
Discussion started by: nelson553011
8 Replies

2. UNIX for Advanced & Expert Users

foreign characters in flat file

Hey, Is there anyway I anks, Pocha (12 Replies)
Discussion started by: pochaman
12 Replies

3. Shell Programming and Scripting

Merge lines in Flat file based on first 5 characters

Hi I have the fixed width flat file having the following data 12345aaaaaaaaaabbbbbbbbbb 12365sssssssssscccccccccc 12365sssss 12367ddddddddddvvvvvvvvvv 12367 vvvvv Here the first column is length 5 second is length 10 third is length 10 if the second or third column exceeds... (3 Replies)
Discussion started by: Brado
3 Replies

4. Shell Programming and Scripting

cut between characters of a file

Hi All, Need to convert file names to upper case using tr command in Unix. In a folder -> /apps/dd01/misc there are two files like: pi-abcd567sd.pdf pi-efgh1.pdf The output of should be like: pi-ABCD567SD.pdf pi-EFGH1.pdf I have used the command to work as below: for f... (3 Replies)
Discussion started by: a1_win
3 Replies

5. Shell Programming and Scripting

Need to cut first 21 and 32-25 characters from file

Guys, can you help me in doing cut first 21 and 32-35 characters from file. I tried with cut -c to cut first 21 characters ,It is succeeded. But i need both first 21 and 32-35. (1 Reply)
Discussion started by: mohan_xunil
1 Replies

6. Shell Programming and Scripting

Read flat file upto certain number of columns

Hello Guys Please help me with the below issue I want to read a flat file source upto certain number of columns Say my flat file has 30 columns but I want to read upto 25 columns only How come the above issue can be addressed? Thanks a lot!!!! (1 Reply)
Discussion started by: Pratik4891
1 Replies

7. UNIX for Dummies Questions & Answers

Inserting a sequential number into a field on a flat file

I have a csv flatfile with a few million rows. I need to replace a field (field number is 85) in the file with a sequential number. As an example, let's assume there are only 4 fields in the file: A,A,,32 A,A,,27 A,B,,43 C,C,,354 If I wanted to amend the 3rd field in this way my... (2 Replies)
Discussion started by: BristolSmithy
2 Replies

8. UNIX for Dummies Questions & Answers

How to remove numeric characters in the flat file

HI, can any one help me please .. i have flat file like qwer123rt ass3242ccf jjk654 kjh838ppp nhdg453ok hdkk34 i want remove numeric characters in the flat file i want output like this qwerrt assccf jjk kjhppp nhdgok hdkk help me... (4 Replies)
Discussion started by: rafimd1985
4 Replies

9. Shell Programming and Scripting

Get line number in flat file

Hi, Is there a way to find out the line number from where the data starts? like if the data contains column header, irrespective of the text in the column header we should get the line number from which contains the column header. I am sorry if I haven't explained the problem clearly. ... (8 Replies)
Discussion started by: kedar_laveti
8 Replies

10. Shell Programming and Scripting

Finding distinct characters from flat file

Hi....I need one help.... I'm having a files which is having the data as follows... a b c c d d d e f Now I need to find out distinct characters from this file and the output should be as follows - a b c d e f Can you please help me on this? I'm using KSH script. (18 Replies)
Discussion started by: Krishanu Saha
18 Replies

LEARN ABOUT DEBIAN

jlessecho

LESSECHO(1)						      General Commands Manual						       LESSECHO(1)

NAME

       lessecho - expand metacharacters

SYNOPSIS

       lessecho [-ox] [-cx] [-pn] [-dn] [-mx] [-nn] [-ex] [-a] file ...

DESCRIPTION

       lessecho is a program that simply echos its arguments on standard output.  But any argument containing spaces is enclosed in quotes.

OPTIONS

       A summary of options is included below.

       -ox    Specifies "x" to be the open quote character.

       -cx    Specifies "x" to be the close quote character.

       -pn    Specifies "n" to be the open quote character, as an integer.

       -dn    Specifies "n" to be the close quote character, as an integer.

       -mx    Specifies "x" to be a metachar.

       -nn    Specifies "n" to be a metachar, as an integer.

       -ex    Specifies "x" to be the escape char for metachars.

       -fn    Specifies "n" to be the escape char for metachars, as an integer.

       -a     Specifies that all arguments are to be quoted.  The default is that only arguments containing spaces are quoted.

SEE ALSO

       less(1)

AUTHOR

       This manual page was written by Thomas Schoepf <schoepf@debian.org>, for the Debian GNU/Linux system (but may be used by others).

       Send bug reports or comments to bug-less@gnu.org.

							     Version 394: 03 Dec 2005						       LESSECHO(1)
All times are GMT -4. The time now is 01:41 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy