Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Getting Rid of Having to Write to Flat Files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Getting Rid of Having to Write to Flat Files
# 8  
Old 07-28-2009
there are several different ways to do this.

1: If it is discrete pieces of data like names, addresses or whatever, you can use a "sqlite" database. No engine needed, just the libraries and one database file. You'll need to know SQL of course.

2: If you're worried about leaving a mess, keep a variable with a list of the file names in it, like $TMPFILES, then at the end, just rm $TMPFILES. Another thing you can do is use $$ to create them. e.g. TMP1=/tmp/$$.tmp

You can use variables if you're not dealing with tons and tons of data.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Converting Multiline Files to Flat Files?

How to convert this: F1-R1 F1-R2 F1-R3 into a flat file for bash?? Each record F2-R1 F2-R2 F2-R3 F3-R1 F3-R2 F3-R3 F4-R1 F4-R2 F4-R3is on one line with all fields for that record, put into an output file. The output file should look like this when converted: F1-R1,F2-R1,F3-R1,F4-R1... (6 Replies)
Discussion started by: bud1738
6 Replies

2. UNIX for Dummies Questions & Answers

Normalize Data and write to a flat file

All, Can anyone please help me with the below scenario. I have a Flat file of the below format. ID|Name|Level|Type|Zip|MAD|Risk|Band|Salesl|Dealer|CID|AType|CValue|LV|HV|DCode|TR|DU|NStartDate|UserRole|WFlag|EOption|PName|NActivationDate|Os|Orig|Cus|OType|ORequired|DType 03|... (10 Replies)
Discussion started by: sp999
10 Replies

3. UNIX for Dummies Questions & Answers

how to get rid of last _ in the files name?

ex: I have list of files in a folder. abc_def_geh_.txt abc_.txt abc_def_geh_12345_.txt ab134c_d345345ef_444geh_12345_.txt i need to rename all files to get rid of the _ before .txt result should look like this: abc_def_geh.txt abc.txt abc_def_geh_12345.txt... (2 Replies)
Discussion started by: lv99
2 Replies

4. Shell Programming and Scripting

Compare 2 flat files

Hi Frnds, I have a flat file with millions of records. . Now I on this. (I prefer for AWK as its gives good performance.) Old_file.txt ------------------ 1 gopi ase .... 2 arun pl ... 3 jack sutha .. 4 peter pm .. ... New_file.txt --------------- 4 peter pm .. .. ... (12 Replies)
Discussion started by: Gopal_Engg
12 Replies

5. UNIX for Dummies Questions & Answers

Getting rid of files with no ownership

I am in the process of learning how to do system administration (just on my own Linux machine) and have been working with the find command. One of the things I tried was find / -nouser -o -nogroup I redirected the output of my find query into a text file, and when I did a wc -l on it, it... (1 Reply)
Discussion started by: kermit
1 Replies

6. UNIX for Advanced & Expert Users

How to write Flat Files by shell script using Oracle Database

Hello There.. I came to a situation where I need to write flat files using shell scripts, I need to pull the records from the oracle database and create the flat file, This process should be automated. Can any shell script expert out here to help me.. please.. Will be really glad to... (3 Replies)
Discussion started by: coolbuddy
3 Replies

7. Shell Programming and Scripting

getting rid of duplicate files

i have a bad problem with multiple occurances of the same file in different directories.. how this happened i am not sure! but I know that i can use awk to scan multiple directory trees to find an occurance of the same file... some of these files differ somwhat but that does not matter! the... (4 Replies)
Discussion started by: moxxx68
4 Replies

8. UNIX for Dummies Questions & Answers

Renaming multiple files, to get rid of extension

I have a good script to rename multiple files, but what's the best way I can remove some text from multiple filenames? Say I have a directory with 35 files with a .XLS at the end, how can I rename them to remove the .XLS but keep everything the same, without having to mv manually. Thanks. (6 Replies)
Discussion started by: nj78
6 Replies

9. Shell Programming and Scripting

Flat Files

I have a flat file like this 0001 THER ULT HEAD & NECK VES 0002 THER ULTRASOUND OF HEART 0003 THER ULT PERIPHERAL VES 0009 OTHER THERAPEUTIC ULTSND 0010 IMPLANT CHEMOTHERA AGENT 0011 INFUS DROTRECOGIN ALFA 0012 ADM INHAL NITRIC OXIDE I need to conver this to a comma delimited flat file... (2 Replies)
Discussion started by: thumsup9
2 Replies

10. Shell Programming and Scripting

how to get rid of blank line in a flat text file

Hi, I have a flat text file which contains blank line between each text line. Is there any command to get rid of it? Thanks for your help (11 Replies)
Discussion started by: xfang
11 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

obdgpslogger

obdgpslogger(1) 					      General Commands Manual						   obdgpslogger(1)

NAME

       obdgpslogger - Log OBD and GPS data to sqlite

SYNOPSIS

       obdgpslogger [ options ]

DESCRIPTION

       This is a tool to log OBDII and GPS data to an sqlite database

OPTIONS

       -s|--serial <serialport>
	      Open this serial port device to connect to the elm327 device.

       -c|--count <count>
	      Take this many samples at most. Leaving this option out defaults to incessant sampling.

       -u|--output-log <filename>
	      Redirect stdout and stderr to this file

       -l|--serial-log <filename>
	      Log all serial comms into this file.

       -a|--samplerate <samples-per-second>
	      Sample  at  most	this many times a second. The software will sleep temporarily at the end of each loop if appropriate. Keep in mind
	      there is an upper limit to samplerate, typically capped by I/O on your serial port. Set this to zero to sample as fast as  possible.
	      BE WARNED. Values greater than ten here are forbidden for cars predating April 2002. If you think your car postdates early 2002, and
	      you'd like to sample as fast as possible, the -o option may help

       -o|--enable-optimisations
	      Enable certain elm327 optimisations. This will [usually] make sampling faster [not a noticeable amount if you're only sampling  once
	      a second], but makes it much easier to accidentally disobey the standard if you're sampling as fast as possible.

       -p|--capabilities
	      Dump the commands your OBD device claims to support to stdout, then exit.

       -m|--daemonise
	      Convert the program to a background daemon after successfully initialising.

       -B|--modifybaud [rate]
	      Attempt to upgrade baudrate to rate. If rate isn't specified, we'll just take a few guesses and go with what works.

       -b|--baud <rate>
	      Attempt  to  set	serial port baudrate to this after launching. Passing zero tells it to try and guess, or -1 to not try changing at
	      all.

       -d|--db <database>
	      Open this database to log data to. The software will create the database if it does not exist, and create the tables it needs.

       -i|--log-columns <column names>
	      Comma-separated list of column names. These are the short names listed when you use "-p" to get your car's capabilities

       -v|--version
	      Print out version number and exit.

       -h|--help
	      Print out help and exit.

NOT OPTIONS

       These options are not intended to be used by end users using the command line, they are support options for the GUI component. Use or  rely
       on them at your own peril.

       -t|--spam-stdout
	      Write all readings to stdout. The format is unlikely to change in practice, but if you choose to try to parse this yourself, I don't
	      want to hear about it when it does change.

SEE ALSO

       obd2kml(1), obd2csv(1), obd2gpx(1), obdsim(1), obdgui(1), obdlogrepair(1), obdftdipty(1), dot-obdgpslogger(5)

AUTHORS

       Gary "Chunky Ks" Briggs <chunky@icculus.org>

																   obdgpslogger(1)