Need help in editing a file

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need help in editing a file
# 1  
Old 03-06-2012
Need help in editing a file

I have a file which has 10 million records in it. When am trying to edit the file with vi, the following error occurs:

"file1" Value too large for defined data type

Is there any way that I can edit this file without using vi? Any help would be really appreciated.

# 2  
Old 03-06-2012
If your native OS is windows, scp it to local and open it in a text editor or gvim.
# 3  
Old 03-06-2012
Originally Posted by balajesuri
If your native OS is windows, scp it to local and open it in a text editor or gvim.
Does this helps:
$ uname -a
SunOS 5.10 Generic_147440-07 sun4u sparc SUNW,Sun-Fire-V890

What does scp mean?
# 4  
Old 03-06-2012
secure copy. He's just suggesting you copy the file over the network to somewhere it can be edited.
# 5  
Old 03-06-2012
Is this similar to vour previous large file?
Similar questions to before:

Is it a properly formatted unix text file?
How do you normally edit similar (but smaller) files?
How big is the file?
What editing do you need to do?
What software created the file?
# 6  
Old 03-06-2012
Yes, it was a similar kind of file that has been posted before.

Its a txt file.
I normally edit with vi, but this file being so gigantic, I cannot edit the file and encountered with an error.
The file which am trying to edit has about 10 million records in it.

Editing required:
1. I need to cut the very first few lines and copy them into a seperate file.
2. Need to replace the data with some data for the 9th million record.

Any help would be really appreciated.
# 7  
Old 03-06-2012
What separator does this text file use? If it's just spaces, awk can handle that without trouble. Otherwise, you'll need to specify it with awk' -F option as well as
-v OFS="|"

For example, for a separator of |, you'd do
nawk -F"|" -v OFS="|" ...

nawk '# Lines <= 1000 copy into file2
(NR<=1000) { print > "file2" }
# Replace column 3 with slartibartfast in line 9,000,000
NR==9000000 { $3 = "slartibartfast" }

# print all lines
1' < inputfile > outputfile

The file 'outputfile' will have the changes in it. The file 'file2' will have lines <= 1000.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Convert vi editing to text editing

Dear Guru's I'm using Putty and want to edit a file. I know we generally use vi editor to do it. As I'm not good in using vi editor, I want to convert the vi into something like text pad. Is there any option in Putty to do the same ? Thanks for your response. Srini (6 Replies)
Discussion started by: thummi9090
6 Replies

2. Shell Programming and Scripting

File Editing

Never mind!. Thanks (1 Reply)
Discussion started by: smarones
1 Replies

3. UNIX for Dummies Questions & Answers

File editing

Hi All, I've to edit the below file in the Current File: XXX Rows found with null for one or more non-nullable columns in the source table SELECT COUNT(*) FROM ( SELECT 1 as one FROM datum WHERE:wall: datum.ID IS NULL ) a (1 Reply)
Discussion started by: udayakumar
1 Replies

4. Shell Programming and Scripting

editing line in text file adding number to value in file

I have a text file that has data like: Data "12345#22" Fred ID 12345 Age 45 Wilma Dino Data "123#22" Tarzan ID 123 Age 33 Jane I need to figure out a way of adding 1,000,000 to the specific lines (always same format) in the file, so it becomes: Data "1012345#22" Fred ID... (16 Replies)
Discussion started by: say170
16 Replies

5. Shell Programming and Scripting

Help with file editing while keeping file format intact

Hi, I am having a file which is fix length and comma seperated. And I want to replace values for one column. I am reading file line by line in variable $LINE and then replacing the string. Problem is after changing value and writing new file temp5.txt, formating of original file is getting... (8 Replies)
Discussion started by: Mruda
8 Replies

6. Shell Programming and Scripting

file editing

how to remove duplicate word in a file ? (2 Replies)
Discussion started by: mail2sant
2 Replies

7. Shell Programming and Scripting

Editing a File

Hi all, I have a file with following contents # rad124 # radkus # raddebug # radtrace I could like to remove the # and space present before the key word "rad". Any ways to do this using "subsitution method(:%s/old/new/g)" will be hepful. (1 Reply)
Discussion started by: ramkriz
1 Replies

8. Linux

file editing

I have created a file with vi -x (file name) this is encrypted file when i again open this file it ask me to enter a password before editing it.Can i remove this password but i don't want to delete a file how to do this. Thanks (0 Replies)
Discussion started by: ambavaram
0 Replies

9. Shell Programming and Scripting

Editing file

Hi, I am in a situation wherein am getting file file certailn values suppose 1u56979hhghhklklkkkjkjkjk 0 0 0 The file will have values like above only. I need to add another field of NULL value(of length 9) at the end of first column i.e. It should like this after editing:... (4 Replies)
Discussion started by: rahul303
4 Replies

10. UNIX for Advanced & Expert Users

Editing the end of the file without loading the entire file

hi! I am a newbee. I would really appreciate if you can answer the following question: I have a huge data file, 214MB with several coloumns. I need to delete the very last line of the file. Everything I know takes a lot of time to do it ( because I have to open the file in an editor or run a... (3 Replies)
Discussion started by: Garuda
3 Replies
Login or Register to Ask a Question

Featured Tech Videos