Sponsored Content
Top Forums Shell Programming and Scripting change the format of a giving file ( a bit challenge) Thank you Post 302148989 by netbanker on Tuesday 4th of December 2007 01:49:36 PM
Old 12-04-2007
Bug

Quote:
Originally Posted by rikxik
Well, I appreciate the urge to "just do it" in ksh - so here goes:

Input:


Script:


Result:


Obviously this is quite brittle but for the kind of input provided, this should do.

Note: done using default ksh on SunOS db012a 5.8 Generic_117350-35 sun4us sparc FJSV,GPUZC-M

HTH

it works for most of creteria so I would say it is good enough, I will add some more features to it as well Smilie

Thank you all for the help!

Last edited by netbanker; 12-04-2007 at 02:55 PM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Change format to file II

hi all... i have a big problem, and i hope someone can help me... i have a flat file, and its columns are separated by comma (CSV), something like this: 78 , 204R180 , 90/100 , 200001 , 12 ,200002 ,13 ..... 78 , 204R180 , 90/100 , 200001 , 29 ,200002 ,30 ..... 78 , 204R180 , 90/100 ,... (0 Replies)
Discussion started by: DebianJ
0 Replies

2. HP-UX

Change 32 bit to 64 bit Kernel

Hi, I'm using HPUX 11.11 on Vizualize B180L our productive machines have 64 bit kernel # file vmunix vmunix: ELF-64 executable object file - PA-RISC 2.0 (LP64) I got one test system, which should have the same HW (i was told it is the same HW) hpuxtest:/stand-->file... (3 Replies)
Discussion started by: funksen
3 Replies

3. Shell Programming and Scripting

Change file format

Hi I have a file in the following format I have to convert this into four files , in the format as below. Data under Process SFA SUccess Section gets into file Named SFA_SUCCESS inthe following format ctr1,120 ctr2,1785 Data under Process SFA FAil gets into file Named SFA_Fail inthe... (2 Replies)
Discussion started by: sapics
2 Replies

4. Shell Programming and Scripting

Giving format to a file

hi all, i have a big problem and i don't know what to do. This is the thing: i have a flat file with 26 fields, which are separated by ';' by example, i have this: Peter;Smith;2005;200508; ......... if the lengths of the fields are: field 1: Alphanumeric - field 2: Alphanumeric - field... (4 Replies)
Discussion started by: DebianJ
4 Replies

5. Shell Programming and Scripting

To Change the file format Pls Help!!!

Hi All, I have a file like john::208:johnson john::208:mery john::208:test admin:*:1:johnson admin:*:1:test and wanna convert this as john::208:johnson,mery,test admin:*:1:johnson,test please help me to create a script for this thanks in advance John (4 Replies)
Discussion started by: johnsonpk
4 Replies

6. Shell Programming and Scripting

switch format between 64 bit double and 64 bit integer

In order to perform some arithmetical operations on 64 bit double I need to transform of the binary representation of a 64 bit double to a 64 bit integer do the operations and then transform back to 64 bit double. I understand bash and bc doesn't allow to do that. I think my only tool left is... (2 Replies)
Discussion started by: Zephyr
2 Replies

7. Shell Programming and Scripting

How to change date format in file

Hello! I have a textfile that look like this: "83d1:46:2b";"20091008190000";"Rögle BK - Skellefteå";"Swedish" "d4c:46:21";"20091008190000";"Södertälje - Brynäs";"Swedish" "d4b:46:2";"20091008190000";"HV 71 - Färjestad";"Swedish" "838:46:b";"20091010160000";"Skellefteå - HV 71";"Swedish"... (2 Replies)
Discussion started by: condmaster
2 Replies

8. Shell Programming and Scripting

howto change format of file?

Hi I have a file with this inside: How can I change it to: thanks a lot regards Israel. (3 Replies)
Discussion started by: iga3725
3 Replies

9. Shell Programming and Scripting

Challenge to change file names

Hi, How can I change following file name in a bash script? From file names: myfile-module-1.0-3.0.el6.x86_64.package To file names: myfile-module1_0-1.0-3.0.el6.x86_64.package ^ ^ ^ ^ ^ ^ ^ ^ Basically, the digit 1.0 is a version number, the digit 3.0 is... (11 Replies)
Discussion started by: hce
11 Replies

10. Shell Programming and Scripting

Change the file format

gpio_rw = gpiochip162 audio_aplay = HDMI_0 audio_aplay = HDMI_1 audio_aplay = HDMI_2 graphic_xrandr_show = USB1 graphic_xrandr_show = USB2 graphic_xrandr_show = USB3 graphic_change_resolution = eDP1 gpio_rw = "gpiochip162" audio_aplay = "HDMI_0 HDMI_1 HDMI_2" graphic_xrandr_show =... (3 Replies)
Discussion started by: yanglei_fage
3 Replies
XBase::FAQ(3)						User Contributed Perl Documentation					     XBase::FAQ(3)

NAME
XBase::FAQ - Frequently asked questions about the XBase.pm/DBD::XBase modules DESCRIPTION
This is a list of questions people asked since the module has been announced in fall 1997, and my answers to them. AUTHOR
Jan Pazdziora, adelton@fi.muni.cz Questions and answers What Perl version do I need? What other modules? You need perl at least 5.004. I test each new distribution agains 5.005* and 5.004_04 version of perl. You need DBI module version 1.00 or higher, if you want to use the DBD driver (which you should). Can I use XBase.pm under Windows 95/NT? Yes. It's a standard Perl module so there is no reason it shouldn't. Or, actually, there are a lot of reasons why standard thing do not work on systems that are broken, but I'm trying hard to workaround these bugs. If you find a problem on these platform, send me a description and I'll try to find yet another workaround. Is there a choice of the format of the date? The only possible format in which you can get the date and that the module expect for inserts and updates is a 8 char string 'YYYYMMDD'. It is not possible to change this format. I prefer to do the formating myself since you have more control over it. The "get_record" also returns deleted records. Why? Because. You get the _DELETED flag as the first value of the array. This gives you a possibility to decide what to do -- undelete, ignore... It's a feature -- you say you want a record of given number, you get it and get additional information, if the record is or isn't marked deleted. But with DBD::XBase, I do not see the deleted records. That's correct: DBD::XBase only gives you records that are positively in the file and not deleted. Which shows that XBase.pm is a lower level tool because you can touch records that are marked deleted, while DBD::XBase is higher level -- it gives you SQL interface and let's you work with the file more naturaly (what is deleted should stay deleted). XBase.pm cannot read files created with [your favorite tool]. Describe exactly, what you expect and what you get. Send me the file (I understand attachments, uuencode, tar, gzip and zip) so that I can check what it going on and make XBase.pm undestand your file. A small sample (three rows, or so) are generally enough but you can send the whole file if it doesn't have megabytes. Please understand How to install the module when I do not have make? On Win* platform and with ActiveState port, use ppm to install DBD::XBase from ActiveState's site. You can also just copy the files from the lib directory of the distribution to where perl can find them. Also check whether your make doesn't hide under different names (nmake, gmake). See "README". I have make but I cannot install into default directory. Ask your sysadmin to do it for your. If he refuses, fire the sysadmin. See "README" for how to install into and use nonstandard place for the module. Can I access one dbf file both from Perl and (say) Clipper? For reading -- yes. For writing -- XBase.pm has a locksh and lockex method to lock the file. The question is to what extend Clipper (or Fox* or whatever) uses the same system calls, documentation of native XBase applications doesn't tell this. So the answer is that for multiple updates you should probably consider real RDBMS system (PostgreSQL, MySQL, Oracle, to name a few). XBase.pm/DBD::XBase breaks my accented characters. No, it doesn't. The character data is returned exactly as it appears in the dbf/dbt file. You probably brought the file from different system that uses differend character encodings. So some bytes in the strings have different meaning on that system. You also probably have fonts in different encoding on that system. In the Czech language, we have about 6 different encoding that affect possition at which accented characters appear. So what you really want to do is to use some external utility to convert the strings to encoding you need -- for example, when I bring the dbf from Win*, it often is in the Windows-1250 or PC-Latin-2 encoding, while the standard is ISO-8859-2. I use my utility Cz::Cstocs to do the conversion, you maight also try GNU program recode or use Text::Iconv Perl module. How do I access the fields in the memo file? Just read the memo field, it will fetch the data from the memo file for you transparently. Matching with "field = '%str%'" doesn't work. If you want to match wildcards with DBD::XBase, you have to use "like": select * from table where field like '%str%' Can I sue you if XBase.pm/DBD::XBase corrupts my data? No. At least, I hope no. The software is provided without any warranty, in a hope you might find is usefull. Which is by the way the same as with most other software, even if you pay for that. What is different with XBase.pm/DBD::XBase is the fact that if you find out that the results are different from those expected, you are welcome to contact me, describe the problem and send me the files that give troubles to the module, and I'll try to find fix the module. What dbf/other files standard does the module support? I try to support any file that looks reasonably as dbf/dbt/fpt/smt/ndx/ntx/mdx/idx/cdx. There are many clones of XBase-like software, each adding its own extension. The module tries to accept all different variations. To do that, I need your cooperation however -- usually good description of the problem, file sample and expected results lead to rather fast patch. What SQL standard does the DBD::XBase support? If supports a reasonable subset of the SQL syntax, IMHO. So you can do select, delete, insert and update, create and drop table. If there is something that should be added, let me know and I will consider it. Having said that, I do not expect to ever support joins, for example. This module is more a parser to read files from your legacy applications that a RDBMS -- you can find plenty of them around -- use them. I downloaded you module I do not know how to install it. Did you follow the steps in the "README" and "INSTALL" files? Where did it fail? This module uses a standard way modules in Perl are installed. If you've never installed a module on your system and your system is so non-standard that the general instruction do not help, you should contact your system administrator or the support for your system. "select max(field) from table" does not work. Aggregate functions are not supported. It would probably be very slow, since the DBD doesn't make use of indexes at the moment. I do not have plans to add this support in some near future. "DBI->connect" says that the directory doesn't exist ... ... but it's there. Is DBD::XBase mad or what? The third part of the first parameter to the connect is the directory where DBD::XBase will look for the dbf files. During connect, the module checks "if -d $directory". So if it says it's not there, it's not there and the only thing DBD::XBase can do about it is to report it to you. It might be that the directory is not mounted, you do not have permissions to it, the script is running under different UID than when you try it from command line, or you use relative patch and run the script from a different directory (pwd) than you expect. Anyway, add die "Error reading $dir: $! " unless -d $dir; to your script and you will see that it's not DBD::XBase problem. The XBase.pm/dbfdump stops after reading n records ... ... why doesn't it read all 10 x n records? Check if the file isn't truncated. "dbfdump -i file.dbf" will tell you the expected number of records and length of one record, like Filename: file.dbf Version: 0x03 (ver. 3) Num of records: 65 Header length: 1313 Record length: 1117 Last change: 1998/12/18 Num fields: 40 So the expected length of the file is at least 1313 + 65 * 1117. If it's shorter, you've got damaged file and XBase.pm/dbfdump only reads as much rows as it can find in the dbf. How is this DBD::XBase related to DBD::ODBC? DBD::XBase reads the dbf files directly, using the (included) XBase.pm module. So it will run on any platform with reasonable new perl. With DBD::ODBC, you need an ODBC server, or some program, that DBD::ODBC could talk to. Many proprietary software can serve as ODBC source for dbf files, it just doesn't seem to run on Un*x systems. And is also much more resource intensive, if you just need to read the file record by record and convert it to HTML page or do similary simple operation with it. How do I pack the dbf file, after the records were deleted? XBase.pm doesn't support this directly. You'd probably want to create new table, copy the data and rename back. Patches are always welcome. Foxpro doesn't see all fields in dbf created with XBase.pm. Put 'version' => 3 options in to the create call -- that way we say that the dbf file is dBaseIII style. perl v5.12.1 2002-08-16 XBase::FAQ(3)
All times are GMT -4. The time now is 07:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy