Sponsored Content
Top Forums Shell Programming and Scripting Reading ALL BUT the first and last line of a huge file Post 302970019 by cjcox on Thursday 31st of March 2016 10:50:50 AM
Old 03-31-2016
sed solution is fastest, doubt you'll be able to beat it by much (virutally immeasurable).

Maybe if we understood what you're wanting to do with the middle data?
This User Gave Thanks to cjcox For This Post:
 

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Insert a line as the first line into a very huge file

Hello, I need to insert a line (like a header) as the first line of a very huge file (about 3 ml rows). I am able to do it with sed, but redirecting the output and creating a new file takes quite some time. I was wondering if there was a more efficient way of doing it? Any help would be... (3 Replies)
Discussion started by: shriek
3 Replies

2. UNIX for Dummies Questions & Answers

How to remove FIRST Line of huge text file on Solaris

i need help..!!!! i have one big text file estimate data file size 50 - 100GB with 70 Mega Rows. on OS SUN Solaris version 8 How i can remove first line of the text file. Please suggest me for solutions. Thank you very much in advance:) (5 Replies)
Discussion started by: madoatz
5 Replies

3. Shell Programming and Scripting

[Solved] Problem in reading a file line by line till it reaches a white line

So, I want to read line-by-line a text file with unknown number of files.... So: a=1 b=1 while ; do b=`sed -n '$ap' test` a=`expr $a + 1` $here do something with b etc done the problem is that sed does not seem to recognise the $a, even when trying sed -n ' $a p' So, I cannot read... (3 Replies)
Discussion started by: hakermania
3 Replies

4. Shell Programming and Scripting

Implement in one line sed or awk having no delimiter and file size is huge

I have file which contains around 5000 lines. The lines are fixed legth but having no delimiter.Each line line contains nearly 3000 characters. I want to delete the lines a> if it starts with 1 and if 576th postion is a digit i,e 0-9 or b> if it starts with 0 or 9(i,e header and footer) ... (4 Replies)
Discussion started by: millan
4 Replies

5. Shell Programming and Scripting

Optimised way for search & replace a value on one line in a very huge file (File Size is 24 GB).

Hi Experts, I had to edit (a particular value) in header line of a very huge file so for that i wanted to search & replace a particular value on a file which was of 24 GB in Size. I managed to do it but it took long time to complete. Can anyone please tell me how can we do it in a optimised... (7 Replies)
Discussion started by: manishkomar007
7 Replies

6. Shell Programming and Scripting

splitting a huge line of file into multiple lines with fixed number of columns

Hi, I have a huge file with a single line. But I want to break that line into lines of with each line having five columns. My file is like this: code: "hi","there","how","are","you?","It","was","great","working","with","you.","hope","to","work","you." I want it like this: code:... (1 Reply)
Discussion started by: rajsharma
1 Replies

7. Shell Programming and Scripting

Edit a Huge one line file

We have a huge file which has just one really large line; about 500 MB. I want to 1. Count all the occurrences of a phrase 2. Replace the phrase with another. Trying to open it using vi has not helped as it complains that it is too large. Can any script help? Please advise. Thank you, (12 Replies)
Discussion started by: kaushikadya
12 Replies

8. Shell Programming and Scripting

Reading line by line from live log file using while loop and considering only those lines start from

Hi, I want to read a live log file line by line and considering those line which start from time stamp; Below code I am using, which read line but throws an exception when comparing line that does not contain error code tail -F /logs/COMMON-ERROR.log | while read myline; do... (2 Replies)
Discussion started by: ketanraut
2 Replies

9. UNIX for Dummies Questions & Answers

Need to replace new line characters in a huge file

Hi , I would like to replace new line characters(\n) in a huge file of about 2 million records . I tried this one (:%s/\n//g) but it's hanging there and no result. Does this command do not work if the file is big. Please let me know if you have any other options Regards Raj (1 Reply)
Discussion started by: rajeevm
1 Replies
MP3FS(1)							   User Commands							  MP3FS(1)

NAME
mp3fs - mounts and transcodes FLACs to MP3s on the fly SYNOPSIS
mp3fs [OPTION]... FLACDIR MP3DIR DESCRIPTION
The mp3fs(1) command will mount the directory FLACDIR on MP3DIR. Thereafter, accessing MP3DIR will show the contents of FLACDIR, with all FLAC files transparently renamed and transcoded to MP3 format upon access. OPTIONS
-b, -obitrate=RATE Set the bitrate to use for encoding. Acceptable values for RATE are any which are allowed by the MP3 format. According to the manual for LAME, this means: For sampling frequencies of 32, 44.1, and 48 kHz, RATE can be among 32, 40, 48, 56, 64, 80, 96, 112, 128, 160, 192, 224, 256, and 320. For sampling frequencies of 16, 22.05, and 24 kHz, RATE can be among 8, 16, 24, 32, 40, 48, 56, 64, 80, 96, 112, 128, 144, and 160. When in doubt, it is recommended to choose a bitrate among 96, 112, 128, 160, 192, 224, 256, and 320. If not specified, RATE defaults to 128. -d, -odebug Enable debug output. This will result in a large quantity of diagnostic information being printed to stderr as the program runs. This option will normally not be used. It implies -f. --gainmode, -ogainmode=MODE Set mode to use for interpreting ReplayGain tags. The allowed values for MODE are: 0 - Ignore all ReplayGain tags. 1 - Prefer album gain tag, but fall back to track gain if album gain is not present. 2 - Use track gain if present. --gainref, -ogainref=REF Set the reference loudness in decibels to adjust ReplayGain tags. ReplayGain software usually defaults to a loudness of 89 dB, but if this is too quiet, a higher value can be set here, causing adjustment of ReplayGain values in tags. -f Run in foreground instead of detaching from the terminal. -h, --help Print usage information. --quality, -oquality=QUALITY Set quality for encoding, as understood by LAME. The slowest and best quality is 0, while 9 is the fastest and worst quality. The default value is 5, although according to the LAME manual, 2 is recommended. -s Force single-threaded operation. -V, --version Output version information. COPYRIGHT
Copyright (C) 2006-2008 David Collett and 2008-2011 Kristofer Henriksson. This is free software: you are free to change and redistribute it under the terms of the GNU General Public License (GPL) version 3 or later. This manual is copyright (C) 2010-2011 Kristofer Henriksson and may be distributed under the same terms. mp3fs 0.31 June 2012 MP3FS(1)
All times are GMT -4. The time now is 06:26 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy