10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
Hi,
I have received a file which is 20 GB. We would like to split the file into 4 equal parts and process it to avoid memory issues.
If the record delimiter is unix new line, I could use split command either with option l or b.
The problem is that the line terminator is |##|
How to use... (5 Replies)
Discussion started by: Ravi.K
5 Replies
2. Shell Programming and Scripting
Hello All,
I have a large file, more than 50,000 lines, and I want to split it in even 5000 records. Which I can do using
sed '1d;$d;' <filename> | awk 'NR%5000==1{x="F"++i;}{print > x}'Now I need to add one more condition that is not to break the file at 5000th record if the 5000th record... (20 Replies)
Discussion started by: ibmtech
20 Replies
3. Shell Programming and Scripting
Sample file record :
"20130617003","2013-06-18T07:00:03","OUTWARD","01001011","TEST PLC","","HFX834346364364","20130617","10","DUM87534758","","1.28","826","020201","65879278","","","","","","010101","56789","DUMMY... (3 Replies)
Discussion started by: bigbuk
3 Replies
4. Shell Programming and Scripting
Hi All,
I have a very large single record file.
abc;date||bcd;efg|......... pqr;stu||record_count;date
when i do wc -l on this file it gives me "0" records, coz of missing line feed.
my problem is there is an extra pipe that is coming at the end of this record
like... (6 Replies)
Discussion started by: Gurkamal83
6 Replies
5. Shell Programming and Scripting
Hi guys,
I have been given a small task to do and I am stuck already.
I have to format a file with people's emails address in it ready for pasting into the BCC section of an email.
The file looks like this:-
bob@ibm.com SMTP BOB SMITH text text text
sue@icl.org SMTP Susy Smith text text... (8 Replies)
Discussion started by: joe_evans
8 Replies
6. Shell Programming and Scripting
hi All,
need help...!!
I want to delete header record from all the files in current directory.
using sed command i can delete first record from a file but i want to delete first record from all the files so can anybosy help me how can i do this?
I will appreciate your help. (3 Replies)
Discussion started by: NirajThakar
3 Replies
7. Shell Programming and Scripting
Hello
i have a big file with a specific format and delimiter is "§" :
§field1§$field2§$field3§$field4§$field5§$field6§$field§
in this file we have a field which are very long (more than 20000 chars !!!!)
so through vi i cant manipulate them.
despite this i managed to suppress lines that... (11 Replies)
Discussion started by: ade05fr
11 Replies
8. UNIX for Advanced & Expert Users
How does one delete a large file say file.txt of size 4331456 blocks (2217697280 bytes) in a directory in sco openserver 6 ...
Upon executing the command
# rm file.txt
the error message is as below ...
rm: file.txt non-existent: Value too large for defined data type (error 79)
any help... (1 Reply)
Discussion started by: jksah
1 Replies
9. UNIX for Dummies Questions & Answers
Hello all,
Is there a function for deleting a single record from a file?
Thanks in advance... (4 Replies)
Discussion started by: klafte
4 Replies
10. UNIX for Dummies Questions & Answers
Hi
Guys
I have downloaded a table from oracle database in .csv format. it has many fields as Title, First Name, Last Name etc. I have to download distinct titles from database and now i have to check all those titles from data of First Name one by one. and then i have to delete matched record.... (1 Reply)
Discussion started by: Rajeev Agrawal
1 Replies