Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Pivoting data based on a header field Post 303032441 by saj on Monday 18th of March 2019 10:36:42 AM
Old 03-18-2019
Pivoting data based on a header field

Hi Team,

Could you please help me with the below scenario.

I have a file which is in the below format.

Code:
Zipcode,001,001f,002,002f,003,003f,004,004f,005,005f,006,006f,007,007f
0050, ,0, ,0, ,0, ,1,*,7, ,7, ,7
0060, ,0, ,0, ,7, ,0,*,7, ,0, ,0

Would need the output as below.
First field will be repeating for the values.
Header value need to be pivoted as second field, and corresponding header values in the third field.

Code:
005,001,0
005,001f,	
005,002,0
005,002f,	
005,003,0
005,003f,	
005,004,1
005,004f,*	
005,005,7
005,005f,0
005,006,7
005,006f,	
006,001,0
006,001f,	
006,002,0
006,002f,	
006,003,0
006,003f,	
006,004,0
006,004f,	
006,005,0
006,005f,0
006,006,7
006,006f,

Please provide your valuable inputs.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

generating reports based on time field of network data

hi i have data extracted in the following format ranging around 300000 to 800000 records in a text file , the format is of network data . No. Time Source Destination Protocol 1 1998-06-05 17:20:23.569905 HP_61:aa:c9 HP_61:aa:c9 ... (1 Reply)
Discussion started by: renukaprasadb
1 Replies

2. Shell Programming and Scripting

extract data in a csv file based on a certain field.

I have a csv file that I need to extract some data from depending on another field after reading info from another text file. The text file would say have 592560 in it. The csv file may have some data like so Field 1 Field2 Field3 Field4 Field5 Field6 20009756 1 ... (9 Replies)
Discussion started by: GroveTuckey
9 Replies

3. UNIX for Dummies Questions & Answers

Sorting data in file based on field in another file

Hi, I have two files, one of which I would like to sort based on the order of the data in the second. I would like to do this using a simple unix statement. My two files as follows: File 1: 12345 1 2 2 2 0 0 12349 0 0 2 2 1 2 12350 1 2 1 2 2 2 . . . File2: 12350... (3 Replies)
Discussion started by: kasan0
3 Replies

4. Shell Programming and Scripting

Matching and Merging csv data fields based on a common field

Dear List, I have a file of csv data which has a different line per compliance check per host. I do not want any omissions from this csv data file which looks like this: date,hostname,status,color,check 02-03-2012,COMP1,FAIL,Yellow,auth_pass_change... (3 Replies)
Discussion started by: landossa
3 Replies

5. Shell Programming and Scripting

Pivoting the data

Hello Unix guys, I have the following 4 column data, which is a output of db2 select query: Need to pivot the data. sample Input: Year Month Country Counts 2012 Aug Canada 114 2012 Aug USA 92 2012 Aug Mexico 3 2012 Aug ... (3 Replies)
Discussion started by: karumudi7
3 Replies

6. Shell Programming and Scripting

awk : Filter a set of data to parse header line and last field of multiple same match.

Hi Experts, I have a data with multiple entry , I want to filter PKG= & the last column "00060110" or "00088150" in the output file: ############################################################################################### PKG= P8SDB :: VGS = vgP8SOra vgP8SDB1 vgP8S001... (5 Replies)
Discussion started by: rveri
5 Replies

7. Shell Programming and Scripting

Pivoting csv field from pipe delimited file

Hello All, Thanks for taking time to read through the thread and for providing any possible solution. I am trying to pivot a comma separated field in a pipe delimited file. Data looks something like this: Field1|Field2 123|345,567,789 234|563,560 345|975,098,985,397,984 456|736 Desired... (8 Replies)
Discussion started by: svks1985
8 Replies

8. Linux

Pivoting data with awk

Hi Friends, I need to pivot data . Below is my source data Source Data PK PRTY_KEY_ID PRTY_SUB_KEY_ID KEY_COL_VAL_TX MTCH_CNFDNCE_RATE 007824822 428844791 1 #Jemmy#Pom#600 Kearsarge Way 100 007824822 429283974 1 #Jemmy#Pom#120 Broadway 100 007824822 429739103 1 #Jemmy#Pom#600 Keae Way#757... (0 Replies)
Discussion started by: patiljeevan3
0 Replies

9. UNIX for Beginners Questions & Answers

Problem with getting awk to multiply a field by a value set based on condition of another field

Hi, So awk is driving me crazy on this one. I have searched everywhere and read man, docs and every related post Google can find and still no luck. The actual files I need to run this on are sensitive in nature, but it is the same thing as if I needed to calculate weighted grades for multiple... (15 Replies)
Discussion started by: cotilloe
15 Replies
ascii(5)							File Formats Manual							  ascii(5)

NAME
ascii - map of ASCII character set SYNOPSIS
DESCRIPTION
The file provides a map of the ASCII character set, giving both octal and hexadecimal equivalents of each character. The file contains the following text: |000 nul|001 soh|002 stx|003 etx|004 eot|005 enq|006 ack|007 bel| |010 bs |011 ht |012 nl |013 vt |014 np |015 cr |016 so |017 si | |020 dle|021 dc1|022 dc2|023 dc3|024 dc4|025 nak|026 syn|027 etb| |030 can|031 em |032 sub|033 esc|034 fs |035 gs |036 rs |037 us | |040 sp |041 ! |042 " |043 # |044 $ |045 % |046 & |047 ' | |050 ( |051 ) |052 * |053 + |054 , |055 - |056 . |057 / | |060 0 |061 1 |062 2 |063 3 |064 4 |065 5 |066 6 |067 7 | |070 8 |071 9 |072 : |073 ; |074 < |075 = |076 > |077 ? | |100 @ |101 A |102 B |103 C |104 D |105 E |106 F |107 G | |110 H |111 I |112 J |113 K |114 L |115 M |116 N |117 O | |120 P |121 Q |122 R |123 S |124 T |125 U |126 V |127 W | |130 X |131 Y |132 Z |133 [ |134 |135 ] |136 ^ |137 _ | |140 ` |141 a |142 b |143 c |144 d |145 e |146 f |147 g | |150 h |151 i |152 j |153 k |154 l |155 m |156 n |157 o | |160 p |161 q |162 r |163 s |164 t |165 u |166 v |167 w | |170 x |171 y |172 z |173 { |174 | |175 } |176 ~ |177 del| | 00 nul| 01 soh| 02 stx| 03 etx| 04 eot| 05 enq| 06 ack| 07 bel| | 08 bs | 09 ht | 0a nl | 0b vt | 0c np | 0d cr | 0e so | 0f si | | 10 dle| 11 dc1| 12 dc2| 13 dc3| 14 dc4| 15 nak| 16 syn| 17 etb| | 18 can| 19 em | 1a sub| 1b esc| 1c fs | 1d gs | 1e rs | 1f us | | 20 sp | 21 ! | 22 " | 23 # | 24 $ | 25 % | 26 & | 27 ' | | 28 ( | 29 ) | 2a * | 2b + | 2c , | 2d - | 2e . | 2f / | | 30 0 | 31 1 | 32 2 | 33 3 | 34 4 | 35 5 | 36 6 | 37 7 | | 38 8 | 39 9 | 3a : | 3b ; | 3c < | 3d = | 3e > | 3f ? | | 40 @ | 41 A | 42 B | 43 C | 44 D | 45 E | 46 F | 47 G | | 48 H | 49 I | 4a J | 4b K | 4c L | 4d M | 4e N | 4f O | | 50 P | 51 Q | 52 R | 53 S | 54 T | 55 U | 56 V | 57 W | | 58 X | 59 Y | 5a Z | 5b [ | 5c | 5d ] | 5e ^ | 5f _ | | 60 ` | 61 a | 62 b | 63 c | 64 d | 65 e | 66 f | 67 g | | 68 h | 69 i | 6a j | 6b k | 6c l | 6d m | 6e n | 6f o | | 70 p | 71 q | 72 r | 73 s | 74 t | 75 u | 76 v | 77 w | | 78 x | 79 y | 7a z | 7b { | 7c | | 7d } | 7e ~ | 7f del| Control Characters The following table shows the set of ASCII control characters with their octal, decimal, and hexadecimal values. To obtain the respective characters from the keyboard, use the indicated keypress combinations. To place control characters in a file when using the or editor, type Ctrl-before typing the desired control character. +----+-----+-----+---------+--------+------------------------+--------------+ |Oct | Dec | Hex | Display | Symbol | Char Name | Keypress | +----+-----+-----+---------+--------+------------------------+--------------+ |000 | 000 | 00 | none | NUL | Null | Ctrl-Shift-@ | |001 | 001 | 01 | ^A | SOH | Start of Header | Ctrl-A | |002 | 002 | 02 | ^B | STX | Start of Text | Ctrl-B | |003 | 003 | 03 | ^C | ETX | End of Text | Ctrl-C | |004 | 004 | 04 | ^D | EOT | End of Transmission | Ctrl-D | |005 | 005 | 05 | ^E | ENQ | Enquire | Ctrl-E | |006 | 006 | 06 | ^F | ACK | Acknowledge | Ctrl-F | |007 | 007 | 07 | ^G | BEL | Bell | Ctrl-G | +----+-----+-----+---------+--------+------------------------+--------------+ |010 | 008 | 08 | ^H | BS | Back Space | Ctrl-H | |011 | 009 | 09 | ^I | HT | Horizontal Tab | Ctrl-I | |012 | 010 | 0A | ^J | LF | Line Feed | Ctrl-J | |013 | 011 | 0B | ^K | VT | Vertical Tab | Ctrl-K | |014 | 012 | 0C | ^L | FF | Form Feed | Ctrl-L | |015 | 013 | 0D | ^M | CR | Carriage Return | Ctrl-M | |016 | 014 | 0E | ^N | SO | Shift Out | Ctrl-N | |017 | 015 | 0F | ^O | SI | Shift In | Ctrl-O | +----+-----+-----+---------+--------+------------------------+--------------+ |020 | 016 | 10 | ^P | DLE | Data Link Escape | Ctrl-P | |021 | 017 | 11 | ^Q | DC1 | Device Control 1 | Ctrl-Q | |022 | 018 | 12 | ^R | DC2 | Device Control 2 | Ctrl-R | |023 | 019 | 13 | ^S | DC3 | Device Control 3 | Ctrl-S | |024 | 020 | 14 | ^T | DC4 | Device Control 4 | Ctrl-T | |025 | 021 | 15 | ^U | NAK | Negative Acknowledge | Ctrl-U | |026 | 022 | 16 | ^V | SYN | Synchronize | Ctrl-V | |027 | 023 | 17 | ^W | ETB | End Transmission Block | Ctrl-W | +----+-----+-----+---------+--------+------------------------+--------------+ |030 | 024 | 18 | ^X | CAN | Cancel | Ctrl-X | |031 | 025 | 19 | ^Y | EM | End of Medium | Ctrl-Y | |032 | 026 | 1A | ^Z | SUB | Substitute | Ctrl-Z | |033 | 027 | 1B | ^[ | ESC | Escape | Ctrl-[ | |034 | 028 | 1C | ^ | FS | File Separator | Ctrl- | |035 | 029 | 1D | ^] | GS | Group Separator | Ctrl-] | |036 | 030 | 1E | ^^ | RS | Record Separator | Ctrl-Shift-^ | |037 | 031 | 1F | ^_ | US | Unit Separator | Ctrl-Shift-_ | +----+-----+-----+---------+--------+------------------------+--------------+ |177 | 127 | 7F | ^? | DEL | Delete | DEL | +----+-----+-----+---------+--------+------------------------+--------------+ WARNINGS
Note that some HP-UX subsystems, such as the keyboard interface, window systems, and other system software, may use selected keyboard con- trol characters for special purposes, possibly causing unexpected results. FILES
ascii(5)
All times are GMT -4. The time now is 02:01 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy