Sponsored Content
Full Discussion: Large Text Files
Top Forums Shell Programming and Scripting Large Text Files Post 302079687 by caddyjoe77 on Wednesday 12th of July 2006 10:27:07 AM
Old 07-12-2006
Yes, thanks.

trying that now.
 

9 More Discussions You Might Find Interesting

1. Programming

fopen() + reading in large text files

For reading in large text files (say files over 1kB in size) are there any issues with fopen() that I should be aware of ? cheers (2 Replies)
Discussion started by: JamesGoh
2 Replies

2. Shell Programming and Scripting

Need to extract 7 characters immediately after text '19' from a large file.

Hi All!! I have a large file containing millions of record. My purpose is to extract 7 characters immediately after text '19' from this file (including text '19') and save the result in new file. So, my OUTPUT would be as under : 191234561 194567894 192789005 198839408 and so on..... ... (7 Replies)
Discussion started by: parshant_bvcoe
7 Replies

3. Shell Programming and Scripting

Sed or awk script to remove text / or perform calculations from large CSV files

I have a large CSV files (e.g. 2 million records) and am hoping to do one of two things. I have been trying to use awk and sed but am a newbie and can't figure out how to get it to work. Any help you could offer would be greatly appreciated - I'm stuck trying to remove the colon and wildcards in... (6 Replies)
Discussion started by: metronomadic
6 Replies

4. Shell Programming and Scripting

Help with splitting a large text file into smaller ones

Hi Everyone, I am using a centos 5.2 server as an sflow log collector on my network. Currently I am using inmons free sflowtool to collect the packets sent by my switches. I have a bash script running on an infinate loop to stop and start the log collection at set intervals - currently one... (2 Replies)
Discussion started by: lord_butler
2 Replies

5. Shell Programming and Scripting

extract unique pattern from large text file

Hi All, I am trying to extract data from a large text file , I want to extract lines which contains a five digit number followed by a hyphen , like 12345- , i tried with egrep ,eg : egrep "+" text.txt but which returns all the lines which contains any number of digits followed by hyhen ,... (19 Replies)
Discussion started by: shijujoe
19 Replies

6. Shell Programming and Scripting

Need help combining large number of text files

Hi, i have more than 1000 data files(.txt) like this first file format: 178.83 554.545 179.21 80.392 second file: 178.83 990.909 179.21 90.196 etc. I want to combine them to the following format: 178.83,554.545,990.909,... 179.21,80.392,90.196,... (7 Replies)
Discussion started by: mr_monocyte
7 Replies

7. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

8. Shell Programming and Scripting

splitting a large text file into paragraphs

Hello all, newbie here. I've searched the forum and found many "how to split a text file" topics but none that are what I'm looking for. I have a large text file (~15 MB) in size. It contains a variable number of "paragraphs" (for lack of a better word) that are each of variable length. A... (3 Replies)
Discussion started by: lupin..the..3rd
3 Replies

9. Programming

Fast string removal from large text collection

Hi All, I don't want any codes for this problem. Just suggestions: I have a huge collection of text files (around 300,000) which look like this: 1.fil orange apple dskjdsk computer skjks The entire text collection (referenced above) has about 1 billion words. I have created... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies
NYSHELL(1)						      General Commands Manual							NYSHELL(1)

NAME
nyshell - tool to generate shell scripts to build nypatchy output SYNOPSIS
nyshell logfile options cradle [ print ] [ .go ] DESCRIPTION
nyshell is a tool in the Nypatchy suite of programs for working with Patchy Master Files (PAM files); see nypatchy(1). Specifically, given the log file of a nypatchy run, it can create a shell script to compile all the source code files output by nypatchy. This program is sim- ilar to fcasplit except that it takes the log file as input instead of a source file, and it remembers which source code files have already been compiled in previous runs. USAGE
logfile is the name of the log file coming from nypatchy, with a default extension of ".log". A cradle file cradle may be given to add additional setup options such as desired compilers or compiler flags to use. (See the reference manual for more details.) print is the file to which informational output should be written (the default is standard output if omitted), and options is a sequence of single-char- acter flags. This program generates a shell script file named name.shfca (with name being the part of logfile sans extension) that can be run to build all object files. The file name.xqtlog "remembers" the current state. The command should be ended with ".go" unless one wants to enter the Nypatchy interactive shell. OPTIONS
Note that options should be given as a single string of characters with no space separation and no use of the - character (except that it can be used in place of the options field if no options are desired). Alphabetic options are not case-sensitive. A Force recompilation of all routines. B Bypass tests based on the .xqtlog file. E Bypass tests based on the .xqtlog file if it is empty. H Print help information only. Q "quick" - Do not print the setup. S Print the setup only (only together with H). U "up to date" - Check that all .o files are ready to go into a library. V "verbose" - Print the complete setup. SEE ALSO
fcasplit(1), nycheck(1), nydiff(1), nyindex(1), nylist(1), nypatchy(1), nymerge(1), nysynopt(1), nytidy(1), yexpand(1) The reference manual for the Nypatchy suite of programs is available in compressed PostScript format at the following URL: http://wwwasdoc.web.cern.ch/wwwasdoc/psdir/p5refman.ps.gz Running the command "nyshell help .no" also gives some brief help on usage. Running the command "nyshell - hs .no" prints the default set- up (compiler names and options) to be used in the generated shell scripts. AUTHOR
This manual page was written by Kevin McCarty <kmccarty@debian.org> for the Debian GNU/Linux system (but may be used by others). It is licensed under the GNU General Public License, version 2 or later (at your choice). COPYRIGHT
Copyright (C) Kevin B. McCarty, 2008. Mar 12, 2008 NYSHELL(1)
All times are GMT -4. The time now is 04:45 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy