Sponsored Content
Full Discussion: Large Text Files
Top Forums Shell Programming and Scripting Large Text Files Post 302079597 by caddyjoe77 on Tuesday 11th of July 2006 05:52:37 PM
Old 07-11-2006
Quote:
Originally Posted by Hitori
Replace commands like

s/"Report Type"<TAB>"This Report"//g

with

/"Report Type"<TAB>"This Report"/ d

Then you'll remove entire line (with '\n')
What do you mean by with \n Do you mean that i have to put \n in at the end of each line?

I tried using the /d also but it kept telling me that SED was missing an argument.

So the way i am understanding it, it should be like this?

s/"Report Set:"//g
s/"All Files ERM"//g
s/"All Files"//g
s/"Object Name:"//g
s/"06\/29\/2006 11:18:12"//g
s/"Selection:"//g
s/ All Files//g
s/"Description: This Report *"//g

/^$/d

There appears to be some unicode there also,尀 <--characters how do i get SED to see those when running the script? I put the following in:

s/尀//g

and returned an error on line 1 "Unknown Command".

thanks!!
 

9 More Discussions You Might Find Interesting

1. Programming

fopen() + reading in large text files

For reading in large text files (say files over 1kB in size) are there any issues with fopen() that I should be aware of ? cheers (2 Replies)
Discussion started by: JamesGoh
2 Replies

2. Shell Programming and Scripting

Need to extract 7 characters immediately after text '19' from a large file.

Hi All!! I have a large file containing millions of record. My purpose is to extract 7 characters immediately after text '19' from this file (including text '19') and save the result in new file. So, my OUTPUT would be as under : 191234561 194567894 192789005 198839408 and so on..... ... (7 Replies)
Discussion started by: parshant_bvcoe
7 Replies

3. Shell Programming and Scripting

Sed or awk script to remove text / or perform calculations from large CSV files

I have a large CSV files (e.g. 2 million records) and am hoping to do one of two things. I have been trying to use awk and sed but am a newbie and can't figure out how to get it to work. Any help you could offer would be greatly appreciated - I'm stuck trying to remove the colon and wildcards in... (6 Replies)
Discussion started by: metronomadic
6 Replies

4. Shell Programming and Scripting

Help with splitting a large text file into smaller ones

Hi Everyone, I am using a centos 5.2 server as an sflow log collector on my network. Currently I am using inmons free sflowtool to collect the packets sent by my switches. I have a bash script running on an infinate loop to stop and start the log collection at set intervals - currently one... (2 Replies)
Discussion started by: lord_butler
2 Replies

5. Shell Programming and Scripting

extract unique pattern from large text file

Hi All, I am trying to extract data from a large text file , I want to extract lines which contains a five digit number followed by a hyphen , like 12345- , i tried with egrep ,eg : egrep "+" text.txt but which returns all the lines which contains any number of digits followed by hyhen ,... (19 Replies)
Discussion started by: shijujoe
19 Replies

6. Shell Programming and Scripting

Need help combining large number of text files

Hi, i have more than 1000 data files(.txt) like this first file format: 178.83 554.545 179.21 80.392 second file: 178.83 990.909 179.21 90.196 etc. I want to combine them to the following format: 178.83,554.545,990.909,... 179.21,80.392,90.196,... (7 Replies)
Discussion started by: mr_monocyte
7 Replies

7. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

8. Shell Programming and Scripting

splitting a large text file into paragraphs

Hello all, newbie here. I've searched the forum and found many "how to split a text file" topics but none that are what I'm looking for. I have a large text file (~15 MB) in size. It contains a variable number of "paragraphs" (for lack of a better word) that are each of variable length. A... (3 Replies)
Discussion started by: lupin..the..3rd
3 Replies

9. Programming

Fast string removal from large text collection

Hi All, I don't want any codes for this problem. Just suggestions: I have a huge collection of text files (around 300,000) which look like this: 1.fil orange apple dskjdsk computer skjks The entire text collection (referenced above) has about 1 billion words. I have created... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies
MicroMason::ApacheHandler(3pm)				User Contributed Perl Documentation			    MicroMason::ApacheHandler(3pm)

NAME
Text::MicroMason::ApacheHandler - Use MicroMason from mod_perl SYNOPSIS
In your httpd.conf or equivalent Apache configuration file: PerlModule Text::MicroMason::ApacheHandler <Files *.mm> SetHandler perl-script PerlHandler Text::MicroMason::ApacheHandler </Files> In your document root or other web-accessible directory: <% my $visitor = $r->connection->remote_host(); %> <html> Hello there <%= $visitor %>! The time is now <%= localtime() %>. </html> DESCRIPTION
Caution: This module is new, experimental, and incomplete. Not intended for production use. Interface subject to change. If you're interested in this capability, your feedback would be appreciated. Configuration The following configuration parameters are supported: MicroMasonSyntax PerlSetVar MicroMasonSyntax HTMLMason Name of the syntax class that will compile the templates. Defaults to HTMLMason. MicroMasonMixins PerlAddVar MicroMasonMixins Safe PerlAddVar MicroMasonMixins CatchErrors List of additional mixin classes to be enabled. MicroMasonAttribs PerlAddVar MicroMasonAttribs "-AllowGlobals, allow_globals => '$r'" Allows for any set of attributes to be defined. Mixin names prefaced with a dash can also be included. SEE ALSO
For an overview of this templating framework, see Text::MicroMason. This is a mixin class intended for use with Text::MicroMason::Base. For distribution, installation, support, copyright and license information, see Text::MicroMason::Docs::ReadMe. perl v5.10.1 2007-01-29 MicroMason::ApacheHandler(3pm)
All times are GMT -4. The time now is 10:18 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy