Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Getting Rid of Having to Write to Flat Files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Getting Rid of Having to Write to Flat Files
# 8  
Old 07-28-2009
there are several different ways to do this.

1: If it is discrete pieces of data like names, addresses or whatever, you can use a "sqlite" database. No engine needed, just the libraries and one database file. You'll need to know SQL of course.

2: If you're worried about leaving a mess, keep a variable with a list of the file names in it, like $TMPFILES, then at the end, just rm $TMPFILES. Another thing you can do is use $$ to create them. e.g. TMP1=/tmp/$$.tmp

You can use variables if you're not dealing with tons and tons of data.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Converting Multiline Files to Flat Files?

How to convert this: F1-R1 F1-R2 F1-R3 into a flat file for bash?? Each record F2-R1 F2-R2 F2-R3 F3-R1 F3-R2 F3-R3 F4-R1 F4-R2 F4-R3is on one line with all fields for that record, put into an output file. The output file should look like this when converted: F1-R1,F2-R1,F3-R1,F4-R1... (6 Replies)
Discussion started by: bud1738
6 Replies

2. UNIX for Dummies Questions & Answers

Normalize Data and write to a flat file

All, Can anyone please help me with the below scenario. I have a Flat file of the below format. ID|Name|Level|Type|Zip|MAD|Risk|Band|Salesl|Dealer|CID|AType|CValue|LV|HV|DCode|TR|DU|NStartDate|UserRole|WFlag|EOption|PName|NActivationDate|Os|Orig|Cus|OType|ORequired|DType 03|... (10 Replies)
Discussion started by: sp999
10 Replies

3. UNIX for Dummies Questions & Answers

how to get rid of last _ in the files name?

ex: I have list of files in a folder. abc_def_geh_.txt abc_.txt abc_def_geh_12345_.txt ab134c_d345345ef_444geh_12345_.txt i need to rename all files to get rid of the _ before .txt result should look like this: abc_def_geh.txt abc.txt abc_def_geh_12345.txt... (2 Replies)
Discussion started by: lv99
2 Replies

4. Shell Programming and Scripting

Compare 2 flat files

Hi Frnds, I have a flat file with millions of records. . Now I on this. (I prefer for AWK as its gives good performance.) Old_file.txt ------------------ 1 gopi ase .... 2 arun pl ... 3 jack sutha .. 4 peter pm .. ... New_file.txt --------------- 4 peter pm .. .. ... (12 Replies)
Discussion started by: Gopal_Engg
12 Replies

5. UNIX for Dummies Questions & Answers

Getting rid of files with no ownership

I am in the process of learning how to do system administration (just on my own Linux machine) and have been working with the find command. One of the things I tried was find / -nouser -o -nogroup I redirected the output of my find query into a text file, and when I did a wc -l on it, it... (1 Reply)
Discussion started by: kermit
1 Replies

6. UNIX for Advanced & Expert Users

How to write Flat Files by shell script using Oracle Database

Hello There.. I came to a situation where I need to write flat files using shell scripts, I need to pull the records from the oracle database and create the flat file, This process should be automated. Can any shell script expert out here to help me.. please.. Will be really glad to... (3 Replies)
Discussion started by: coolbuddy
3 Replies

7. Shell Programming and Scripting

getting rid of duplicate files

i have a bad problem with multiple occurances of the same file in different directories.. how this happened i am not sure! but I know that i can use awk to scan multiple directory trees to find an occurance of the same file... some of these files differ somwhat but that does not matter! the... (4 Replies)
Discussion started by: moxxx68
4 Replies

8. UNIX for Dummies Questions & Answers

Renaming multiple files, to get rid of extension

I have a good script to rename multiple files, but what's the best way I can remove some text from multiple filenames? Say I have a directory with 35 files with a .XLS at the end, how can I rename them to remove the .XLS but keep everything the same, without having to mv manually. Thanks. (6 Replies)
Discussion started by: nj78
6 Replies

9. Shell Programming and Scripting

Flat Files

I have a flat file like this 0001 THER ULT HEAD & NECK VES 0002 THER ULTRASOUND OF HEART 0003 THER ULT PERIPHERAL VES 0009 OTHER THERAPEUTIC ULTSND 0010 IMPLANT CHEMOTHERA AGENT 0011 INFUS DROTRECOGIN ALFA 0012 ADM INHAL NITRIC OXIDE I need to conver this to a comma delimited flat file... (2 Replies)
Discussion started by: thumsup9
2 Replies

10. Shell Programming and Scripting

how to get rid of blank line in a flat text file

Hi, I have a flat text file which contains blank line between each text line. Is there any command to get rid of it? Thanks for your help (11 Replies)
Discussion started by: xfang
11 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

bp_bioflat_index

BP_BIOFLAT_INDEX(1p)					User Contributed Perl Documentation				      BP_BIOFLAT_INDEX(1p)

NAME

       bioflat_index.pl - index sequence files using Bio::DB::Flat

DESCRIPTION

	Create or update a biological sequence database indexed with the
	Bio::DB::Flat indexing scheme.	The arguments are a list of flat files
	containing the sequence information to be indexed.

USAGE

	bioflat_index.pl <options> file1 file2 file3...

	Options:

	    --create		  Create or reinitialize the index.  If not specified,
				  the index must already exist.

	    --format   <format>   The format of the sequence files.  Must be one
				  of "genbank", "swissprot", "embl" or "fasta".

	    --location <path>	  Path to the directory in which the index files
				  are stored.

	    --dbname <name>	  The symbolic name of the database to be created.

	    --indextype <type>	  Type of index to create.  Either "bdb" or "flat".
				  "binarysearch" is the same as "flat".

       Options can be abbreviated.  For example, use -i for --indextype.

       The following environment variables will be used as defaults if the corresponding options are not provided:

	    OBDA_FORMAT      format of sequence file
	    OBDA_LOCATION    path to directory in which index files are stored
	    OBDA_DBNAME      name of database
	    OBDA_INDEX	     type of index to create

perl v5.14.2							    2012-03-02						      BP_BIOFLAT_INDEX(1p)