Difficult transposing of data from profiles blocks Post: 302698971

Sponsored Content

Top Forums Shell Programming and Scripting Difficult transposing of data from profiles blocks Post 302698971 by Ophiuchus on Monday 10th of September 2012 11:52:43 PM

09-11-2012

Registered User

Difficult transposing of data from profiles blocks

Hello to all,

I really hope some expert or awk guru could help me with this. I don't have how to begin and hope is not so difficult for somebody. I'll expecting how someone could resolve this problem I have to parse this.

I have blocks of parameters for each MSISDN and I would like to extract them and put for each MSISDN all the parameters in a single line with different columns.

- Each block begins with <HGSDP and ends with END.
- I need the value below NAM
- I need the values below "PERMANENT SUBSCRIBER DATA" where in some blocks appear more parameters than within others.
- I need the values below "VLR ADDRESS" and below "SGSN NUMBER" if its present.

The input is:

Code:

<HGSDP:MSISDN=99946129512,ALL;
HLR SUBSCRIBER DATA

SUBSCRIBER IDENTITY
MSISDN           IMSI             STATE          AUTHD
99946129512      123450016625444  CONNECTED      AVAILABLE

NAM
0

PERMANENT SUBSCRIBER DATA
SUD
CAT-10       DBSG-1       TSMO-0       STYPE-13
BS26-1       TS11-1       TS21-1       TS22-1
SOSDCF-7     HOLD-1       MPTY-1       CLIP-1
SCHAR-0-0

AMSISDN            BS       BC
NONE   

LOCATION DATA
VLR ADDRESS       MSRN            MSC NUMBER          LMSID
4-99945269537                     99945269537        

SGSN NUMBER
UNKNOWN

PACKET DATA PROTOCOL CONTEXT DATA
APNID   PDPADD                EQOSID  VPAA  PDPCH    PDPTY  PDPID
    1                          537    YES            IPV4    1
    2                           24    YES            IPV4    2
    3                           23    YES            IPV4    3
                               537    YES            IPV4   10

END
<HGSDP:MSISDN=99949091700,ALL;
HLR SUBSCRIBER DATA

SUBSCRIBER IDENTITY
MSISDN           IMSI             STATE          AUTHD
99949091700      123450011753067  CONNECTED      AVAILABLE

NAM
1

PERMANENT SUBSCRIBER DATA
SUD
CAT-15       DBSG-4       STYPE-21     BS26-1
TS11-1       TS21-1       TS22-3       BS3G-1
SOSDCF-5     HOLD-1       SCPU-3       CLIP-1

AMSISDN            BS       BC
NONE   

LOCATION DATA
VLR ADDRESS       MSRN            MSC NUMBER          LMSID
4-99945269547                     99945269547        
PURGED

PACKET DATA PROTOCOL CONTEXT DATA
NONE

END
<HGSDP:MSISDN=99948748519,ALL;
HLR SUBSCRIBER DATA

SUBSCRIBER IDENTITY
MSISDN           IMSI             STATE          AUTHD
99948748519      123450019654001  CONNECTED      AVAILABLE

NAM
0

PERMANENT SUBSCRIBER DATA
SUD
BS26-1       TS11-1       TS21-1       TS22-1
PTR-78       CLIP-1       SCHAR-2-4

AMSISDN            BS       BC
NONE   

LOCATION DATA
VLR ADDRESS       MSRN            MSC NUMBER          LMSID
4-99945269545                     99945269545        

SGSN NUMBER
4-99945269564    

PACKET DATA PROTOCOL CONTEXT DATA
APNID   PDPADD                EQOSID  VPAA  PDPCH    PDPTY  PDPID
    1                          537    YES            IPV4    1
    2                           24    YES            IPV4    2
                               537    YES            IPV4   10

END

and the output desired is:

Code:

MSISDN,IMSI,STATE,NAM,BS26,BS3G,CAT,CLIP,DBSG,HOLD,MPTY,PTR,SCHAR,SCPU,SOSDCF,STYPE,TS11,TS21,TS22,TSMO,VLR ADDRESS,STATE,SGSN NUMBER,STATE
99946129512,123450016625444,CONNECTED,0,1,,10,1,1,1,1,,0-0,,7,13,1,1,1,0,4-99945269537,,UNKNOWN,
99949091700,123450011753067,CONNECTED,1,1,1,15,1,4,1,,,,3,5,21,1,1,3,,4-99945269547,PURGED,,
99948748519,123450019654001,CONNECTED,0,1,,,1,,,,78,2-4,,,,1,1,1,,4-99945269545,,4-99945269564,

In the output all the parameters are as headers ordered alphabetically, and if some value is not present in some block, should appear empty in the corresponding column.

Many thanks in advance for help on this guys.

Ophiuchus

View Public Profile for Ophiuchus

Find all posts by Ophiuchus

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Delete blocks with no data..

Hi, I tried this but could not get it... here is what I need I have an xml where I get all the data in blocks but some times I get empty blocks with no data...shown below..I need to delete only those blocks with no data, I tried couple of ways but could not do it..any help is appreciated......

2. Shell Programming and Scripting

Sorting blocks of data

Hello all, Below is what I am trying to accomplish: I have a file that looks like this /* ----------------- xxxx.y_abcd_00000050 ----------------- */ jdghjghkla sadgsdags asdgsdgasd asdgsagasdg /* ----------------- xxxx.y_abcd_00000055 ----------------- */ sdgsdg sdgxcvzxcbv...

3. UNIX for Dummies Questions & Answers

Transposing data output

Hi, I've just created a shell script that produces the following output: hd1 hd3 hd9 /optnonaix/esp /optnonaix/app/oracle /u06 (564.67) (675.97) (678.90) I would like the output to be as hd1 /optnonaix/esp (564.67) hd3 /optnonaix/app/oracle (675.97) hd9 /u06 (678.90) Need some...

4. Shell Programming and Scripting

how to split this file into blocks and then send these blocks as input to the tool called Yices?

Hello, I have a file like this: FILE.TXT: (define argc :: int) (assert ( > argc 1)) (assert ( = argc 1)) <check> # (define c :: float) (assert ( > c 0)) (assert ( = c 0)) <check> # now, i want to separate each block('#' is the delimeter), make them separate files, and then send them as...

5. Shell Programming and Scripting

transposing square matrixs or blocks in a big file

Hi I do have a big file of the following format a b c d e f g 2 3 5 6 6 6 7 3 4 5 6 7 9 0 4 5 7 8 9 9 0 1 2 4 5 6 7 8 3 5 6 7 2 3 4 5 6 7 4 3 2 4 5 4 5 6 3 5 5 r h i j k l m 2 3 4 5 6 7 8 4 5 7 8 9 9 0 3 5 6 7 2 3 4 2 3 5 6 6 6 7 5 5 7 8 9 2 3 1 2...

6. Shell Programming and Scripting

Help for a Perl newcomer! Transposing data from columns to rows

I have to create a Perl script which will transpose the data output from my experiment, from columns to rows, in order for me to analyse the data. I am a complete Perl novice so any help would be greatly appreciated. The data as it stands looks like this: Subject Condition Fp1 ...

7. Shell Programming and Scripting

Extracting data blocks from file

Hi all, I want to extract blocks of data from a file depending on the contents of that block. The input file(table) has several blocks each starting with 'gene' in the first column. I want to extract only those blocks which do not have the expression '_T02' in the second column. Input file ...

8. Shell Programming and Scripting

Transposing X and Y axis of CSV data

Hello list, I have a source CSV data file as follows: PC_NAME,MS11-040,MS11-039,MS11-038,MS11-035 abc123,Not Applicable,Not Applicable,Not Applicable,Not Applicable abc987,Not Applicable,Not Applicable,Not Applicable,Not Applicable tnt999,Not Applicable,Not Applicable,Applicable,Not...

9. UNIX for Dummies Questions & Answers

Delete data blocks based on missing combinations

Hello masters, I am filtering data based on completeness. A (Name , Group) combination in File2 is only complete when it has data for all subgroups specified in File1. All incomplete (Name , Group) combinations do not appear in the output. So for example , Name1 Group 1 in File2 is...

10. Shell Programming and Scripting

Transposing data based on 1st column

I do have a big tab delimited file of the following format aa 344 456 aa 34 67 bb 34 90 bb 23 100 bb 1 89 d 0 12 e 45 678 e 78 90 e 56 90 .... .... .... I would like to transpose the data based on the category on column one and get the output file in the following tab delimited...

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Delete blocks with no data..

Discussion started by: mgirinath

2. Shell Programming and Scripting

Sorting blocks of data

Discussion started by: alfredo123

3. UNIX for Dummies Questions & Answers

Transposing data output

Discussion started by: bazzabogan

4. Shell Programming and Scripting

how to split this file into blocks and then send these blocks as input to the tool called Yices?

Discussion started by: paramad

5. Shell Programming and Scripting

transposing square matrixs or blocks in a big file

Discussion started by: Lucky Ali

6. Shell Programming and Scripting

Help for a Perl newcomer! Transposing data from columns to rows

Discussion started by: Sarah_W

7. Shell Programming and Scripting

Extracting data blocks from file

Discussion started by: newbie83

8. Shell Programming and Scripting

Transposing X and Y axis of CSV data

Discussion started by: landossa

9. UNIX for Dummies Questions & Answers

Delete data blocks based on missing combinations

Discussion started by: senhia83

10. Shell Programming and Scripting

Transposing data based on 1st column

Discussion started by: Kanja