Sponsored Content
Full Discussion: Converting XML to CSV
Top Forums Shell Programming and Scripting Converting XML to CSV Post 303038896 by SDohmen on Monday 16th of September 2019 03:33:40 PM
Old 09-16-2019
Quote:
Originally Posted by stomp
Hi SDohmen,

nice to hear that you worked your way through and thanks for giving feedback.

Some comments:



That's why I pointed out XPath for you twice and presented you links for a good and short tutorial. Read the great manuals out there! Read it and you will be lesser dependant on others.



I would suggest to avoid that. With this step, the complexity of the task had risen for no good reason. I understand why you did it(just to get the task done - did that myself in the past), but I recommend to better invest the time to get the data out of the original format. That's most likely possible with jq - even if it needs the work to get familiar with jq. Otherwise you carry the increased complexity, increased error possibility, increased resource footprint with that task from now on.

An alternative to jq may be a small php script, that generates the csv.

If you like, show the original json...

(and sometimes a quick and dirty hack is just fine too)

That's the thing with jq:

Code:
jq -r <data.json ' .searchresults.data[] |
 . as $parent |
 .products[]  |
 ( $parent.idpurchaseorder+";"+.idproduct)'

It's more like the approach that didn't work with xml. ;-)



I did find those links you gave me but they where still a bit confusing and i would say limited in what i needed. Too be honest i did not have that much time either as i spend already almost a week on this with xmlstarlet alone.


As you mention this was a cheat but transforming the json to xml but this was also because i am severly limited in time and knowledge of jq. I actually did try a couple days and then i gave up because of the time constraints. Seeing your code however makes it look quite easy and even less fault sensitive. When i have some time i will actually try it out and let you know here about the (hopefully) success of the jq way.




I just tested jq but something seems not to work. I edited your piece of code to work with the json string:
Code:
jq -r <purchaseorders.json ' .data[] | 
 . as $parent |
 .products[]  |
 ( $parent.idpurchaseorder+";"+.idproduct)'


but this gave me an error:
Code:
jq: error (at <stdin>:0): number (376648) and string (";") cannot be added


Last edited by SDohmen; 09-17-2019 at 05:15 AM.. Reason: Tested jq
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Converting csv to xls

Hi, Can anyone tell the option to change the file type in unix. i.e. if a file is in csv(Comma Separating Values) format, it should be changed to xls(ordinary MS-Excel) format. But renaming command is not changing to correct file format. Thanks in advance, Milton. (1 Reply)
Discussion started by: miltony
1 Replies

2. Shell Programming and Scripting

converting text to csv format

I am trying to check each line and based on first two digits, the comma needs to be place. I checked in the earlier post where the text is converted to csv with a tab delimited. Here is the test file that needs to be changed to csv 11 051701 22 051701 330123405170105170112345... (13 Replies)
Discussion started by: gthokala
13 Replies

3. UNIX for Dummies Questions & Answers

Converting HTML to CSV

Hi, I need to convert a relatively large html file (1.5megs) into CSV under Unix. How would I be able to do this? Much thanks. (3 Replies)
Discussion started by: Jexel
3 Replies

4. UNIX for Dummies Questions & Answers

Converting spaces to csv

I'm new to shell scripting and I have a file with positional columns. The rows look like this: 222 3333 44444 55 55 55 55 5555 59999 222 3333 44444 55 55 55 55 5555 59999 Not every row has the same number of spaces between the seven columns. They can range anywhere... (11 Replies)
Discussion started by: jkandel
11 Replies

5. Shell Programming and Scripting

Converting a flat file in XML

Hello Friends, I am new to UNIX shell scripting. Using bash....Could you please help me in converting a flat file into an XML style output file. Flat file: (Input File entries looks like this) John Miller: 617-569-7996:15 Bunting lane, staten Island, NY: 10/21/79: 60600 The... (4 Replies)
Discussion started by: humkhn
4 Replies

6. Shell Programming and Scripting

converting specific XML file to CSV

Hi, i would convert the following XML file : <?xml version="1.0" encoding="UTF-8" ?> <files xmlns="http://www.lotus.com/dxl/console"> <filedata notesversion="6" odsversion="43" logged="yes" backup="no" id="C12577E6:004B0DA3" iid="C12577E6:004B0DA8" link="1" dboptions="0,524288,0,0"> ... (24 Replies)
Discussion started by: Nicol
24 Replies

7. Shell Programming and Scripting

Converting CSV to ascii format

Hej All, I have a file like this which is a comma dilimited: input: 6000318,-263.011520678,-59.05869872409,587.67924868792 6000319,-265.6996842902,-50.24902479999,590.65693082607 6000320,-238.1333898366,-288.801232595,633.75332173496... (5 Replies)
Discussion started by: Johanni
5 Replies

8. Shell Programming and Scripting

Help with converting XML to Flat file

Hi Friends, I want to convert a XML file to flat file. Sample I/p: <?xml version='1.0' encoding='UTF-8' ?> <DataFile xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' contactCount='4999' date='2012-04-14' time='22:00:14' xsi:noNamespaceSchemaLocation='gen .xsd'> <Contact... (3 Replies)
Discussion started by: karumudi7
3 Replies

9. UNIX for Dummies Questions & Answers

Need help converting txt to XML

I have a table as following Archive id Line Author Time Text 1fjj34 3 75jk5l 03:20 this is an evidence regarding ... 1fjj34 4 gjhhtrd 03:21 we have seen those documents before 1fjj34 10 645jmdvvb 04:00 Will you consider such an offer?... (0 Replies)
Discussion started by: A-V
0 Replies

10. Shell Programming and Scripting

Using awk for converting xml to txt

Hi, I have a xml script, I converted it to .txt with values comma seperated using awk function. But I want the output values should be inside double quotes My xml script (Workorders.xml) is shown like below: <?xml version="1.0" encoding="utf-8" ?> <scbm-extract version="3.3">... (8 Replies)
Discussion started by: Viswanatheee55
8 Replies
REG_RM(3PVM)							  PVM Version 3.4						      REG_RM(3PVM)

NAME
pvm_reg_rm - Register task as PVM resource manager. SYNOPSIS
C #include <pvmsdpro.h> int cc = pvm_reg_rm( struct pvmhostinfo **hip ) struct pvmhostinfo { int hi_tid; char *hi_name; char *hi_arch; int hi_speed; }; Fortran Not Available PARAMETERS
hostp Returns pointer to a pvmhostinfo structure which contains information about the master host. DESCRIPTION
Registers the calling task as a PVM task and slave host manager. This means it intercepts certain libpvm calls from other tasks in order to have a say in scheduling policy. The resource manager will asynchronously receive messages from tasks containing requests for service, as well as messages from pvmds notifying it of system failures. Before you start using this function, be warned that it's not a trivial thing, i.e. you can't just call it to turn off the default round- robin task assignment. Rather, it allows you to write your own resource manager and hook it to PVM. To understand what the following messages mean, you should refer to the PVM source code and/or user guide section on implementation; There's just too much to say about them. When one of the following libpvm functions is called in a task with resource manager set, the given message tag is sent to to resource man- ager. Libpvm call RM message Normal message pvm_addhosts() SM_ADDHOST TM_ADDHOST pvm_config() SM_CONFIG TM_CONFIG pvm_delhosts() SM_DELHOST TM_DELHOST pvm_notify() SM_NOTIFY TM_NOTIFY pvm_spawn() SM_SPAWN TM_SPAWN pvm_tasks() SM_TASK TM_TASK pvm_reg_rm() SM_SCHED TM_SCHED The resource manager must in turn compose the following messages and send them to the pvmds: RM message Normal message SM_EXEC DM_EXEC SM_EXECACK DM_EXECACK SM_ADD DM_ADD SM_ADDACK DM_ADDACK SM_HANDOFF (none - change of resource manager) The following messages are sent asynchronously to the resource manager by the system: RM message Meaning SM_TASKX notify of task exit/fail SM_HOSTX notify of host delete/fail The resource manager task must use pvm_setopt(PvmResvTids, 1) to allow sending reserved messages. Messages should be packed using encoding PvmDataDefault to ensure they can be unpacked anywhere in the system. pvm_reg_rm() returns PvmOk when successful. SEE ALSO
pvm_addhosts(3PVM), pvm_config(3PVM), pvm_delhosts(3PVM), pvm_notify(3PVM), pvm_spawn(3PVM), pvm_tasks(3PVM) 4 March, 1994 REG_RM(3PVM)
All times are GMT -4. The time now is 11:40 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy