02-27-2008
Remove unregconized space from a string
Hi,
I need to unload some data from Informix database into text file.
But what happen is when i open the text file, some record split into 2 line, become uncomplete.
I had checked is due to some unregconized space in particular fields, i used many way to detect this unregconized space, but failed, because it is not null, not blank, not space, trim() also cannot help.
here is sample of the record in text file:
1337851|^M\
KAMPUNG SUNGAI SAMAK|
10000|NO 3 PRSN KLEDANG 12|
the 2nd column contain some funny character ^M, then direct goto 2nd line.
Need your guys help urgently.
Thanks
Regards
Eelyn
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hello
I have a file with data something like this in it :
texttexttext "text .lst" TEXT=" text "
texttexttext "moretext .lst" TEXT=" text "
Question is how do I get rid of space so that the files looks like this :
texttexttext "text.lst" TEXT="text"
texttexttext... (8 Replies)
Discussion started by: davebw
8 Replies
2. Shell Programming and Scripting
DATE=6/Jul/2010
6/Jul/2010
var="sed -n '/\
---------- Post updated at 11:49 AM ---------- Previous update was at 11:36 AM ----------
#!/bin/bash
DATE=`./get_date.pl 3`
DATE1=`./get_date.pl 2`
var1=$( echo "$DATE" | sed "s/ //g" )
var2=$( echo "$DATE1" | sed "s/ //g" )
var="sed -n... (1 Reply)
Discussion started by: sandy1028
1 Replies
3. Shell Programming and Scripting
I have a customer file now and would like to separate the names into two cells in a spreadsheet. Here is my data as an example:
SHAWN R KEEGAN
shawn r scroggin
Shawn Regan
Shawn Reilly
The first two have the middle initial so I'd like to include them in the "first name" field and the last... (11 Replies)
Discussion started by: Grassy
11 Replies
4. Shell Programming and Scripting
Hello Folks..
I need your help ..
here the example of my problem..i know its easy..i don't all the commands in unix to do this especiallly sed...here my string..
dwc2_dfg_ajja_dfhhj_vw_dec2_dfgh_dwq
desired output is..
dwc2_dfg_ajja_dfhhj
it's a simple task with tail... (5 Replies)
Discussion started by: victor369
5 Replies
5. Shell Programming and Scripting
Hi guys,
I am new to shell scripting and I have a small problem...If someone can solve this..that would be great
I am trying to form a XML by reading a flat file using shell scripting
This is my shell script
LINE_FILE1=`cat FLEX_FILE1.TXT | head -1 | tail -1`
echo... (1 Reply)
Discussion started by: gowrishankar05
1 Replies
6. Shell Programming and Scripting
File A.txt
A005 -119.5 -119.5 -100.5
A006 -120.5 -119.5 -119.3
A008 0 0 0
Output
A005 -119.5 -119.5 -100.5
A006 -120.5 ... (1 Reply)
Discussion started by: asavaliya
1 Replies
7. UNIX for Advanced & Expert Users
I created a awk state to calculate the number of success however when the query runs it has a leading zero. Any ideas on how to remove the leading zero from the calculation?
Here is my query:
cat myfile.log | grep | awk '{print $2,$3,$7,$11,$15,$19,$23,$27,$31,$35($19/$15*100)}'
02:00:00... (1 Reply)
Discussion started by: bizomb
1 Replies
8. Shell Programming and Scripting
Hi Perl users,
I have another problem with text processing in Perl. I have a file below:
Linux Unix Linux Windows SUN
MACOS SUN SUN HP-AUX
I want the result below:
Unix Windows SUN
MACOS HP-AUX
so the duplicate string will be removed and also the keyword of the string on... (2 Replies)
Discussion started by: askari
2 Replies
9. Shell Programming and Scripting
I want to delete all matches in a text following this pattern:
Each match starts with linux-
Each match ends with a space
(Remove linux-* until immediate next space)
EXAMPLE:
From this text:
ibudev1 libudev1 libweather-ion7 libxatracker2 linux-generic linux-headers-generic... (4 Replies)
Discussion started by: Tribe
4 Replies
10. UNIX for Beginners Questions & Answers
Hello Folks ,
myfile contains 1000000 records as follows:
logver=56 idseq=63256 itime=1111 devid=TG-40 devname=PUI-C2 vd=USER date=2019_01_10 time=18:39:49 logid="000013" type="traffic" subtype="forward" level="notice" eventtime=134 srcip=1.1.1.1 srcport=1 srcintf="XYX-CORE.01"... (3 Replies)
Discussion started by: arm
3 Replies
LEARN ABOUT DEBIAN
dbview
DBVIEW(1) Database Management DBVIEW(1)
NAME
dbview - View dBase III files
SYNOPSIS
dbview [-b|--browse] [-d delim| --delimiter delim] [-D|--deleted] [-e|--description] [-h|--help] [-i|--info] [-o|--omit] [-v|--version]
[-r|--reserve] [-t|--trim] dbfile
DESCRIPTION
Dbview is a little tool that will display dBase III files. You can also use it to convert your old .dbf files for further use with Unix.
It should also work with dBase IV files, but this is mostly untested.
By default dbview displays the contents of a dBase III or IV database file. This is be done by displaying both the name of the field
itself and its value. At the end of every record a newline is appended.
OPTIONS
If no option given dbview only displays the database in its most friendly way.
--browse, -b
switches into browse mode. Using this mode no fieldnames will be displayed, instead every record will displayed in one line using a
delimiter to separate fields.
--delimiter, -d delimiter
The default delimiter in browse mode is the colon sign ``:''. This parameter overrides it. This can be useful especially if you
plan to examine the output with scripts.
--deleted, -D
displays deleted records as well as the delete state in each record in the database.
--description, -e
displays the field description of the database.
--help, -h
displays a complete (or short) help screen.
--info, -i
displays some (partially technical) information about the database like number of records and length of each record.
--omit, -o
omits displaying the whole database. Using this parameter can be useful if you're only interested in the structure.
--reserve, -r
Normally fieldnames are converted into a more friendly format. They are stored in capital letters, but that looks like shouting.
This parameter supresses the conversion.
--trim, -t
When this option is specified, leading and trailing spaces are omitted. This might be useful when in browse mode.
--version, -v
displays version and exits.
NOTES
As dBase is DOS, umlauts are stored using a different code table (namely ASCII) than most modern unices (namely ANSI). If you encounter
such a file, I would recommend piping the output through recode(1) with ibmpc:latin1 as it's argument.
If you want to examine the output generated by the browse mode, just take cut(1) and set its delimiter to the used delimiter or take awk(1)
and continue.
COPYRIGHT
Dbview is free software. It is based on routines from unknown source that I found on nic.funet.fi in /pub/msdos/languages/c as dbase.c.
The file contained the following notice:
These functions are provided by Valour Software as a gift.
I have modified and included this file and wrote a skeleton around it. All together provides a powerful tool for dBase III and IV database
manipulation under Unix.
I mainly have written this program, because I've got several dbase files containing important information for me. As I won't go running
DOS everytime I need some of the stored information, I had to find a viewer that runs unter Unix, resp. Linux, but unfortunately didn't
find one. So it was my turn.
This package as a whole is published under the GNU Public License, which is a great invention.
It wasn't the intention to write a freaking viewer and reinvent the wheel again. Instead dbview is intend to be used in conjunction with
your favourite unix text utilities like cut, recode and more.
Martin Schulze
Infodrom Oldenburg
joey@infodrom.north.de
SEE ALSO
recode(1), more(1), awk(1), cut(1).
Unix November 20th, 2006 DBVIEW(1)