Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Matching the header of a .CSV file with dynamic field names
Top Forums Shell Programming and Scripting Matching the header of a .CSV file with dynamic field names Post 302910993 by dhruuv369 on Tuesday 29th of July 2014 01:33:54 PM
Old 07-29-2014
Matching the header of a .CSV file with dynamic field names
I have a .CSV file (frequency - weekly) whose header contains the year-week value in two of the columns which keeps changing every week. For an instance please see below.
Code:
Column1,Column2,Column3,Column4,Column5,Column6,Column7,Column8,Column9,Column10,Column11,Column12,Column13,201420 Column14,201420 Column15

I have to check if the data is placed under the right column and then proceed loading that data into the datamart. I created a standard header to compare it with the header of this file, but due to the dynamic nature of the field 14 and 15, I am not able to match the header every week. There is no date in the field name and I cannot use sysdate. Could you please suggest me how can I achieve this either using cat/awk/sed or any wildcards? Also let me know if you need more information.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How can I add a header to a csv file

I have a csv file which has no header. the file has 15 fields and needs to go out with a header of 8 fields. The header content needs to have some variables and some fixed that i have set up: variable header fields OUTFILE_YEAR=`date '+%y'` DATE=`date '+%d%m%y'` TIME=`date '+%H:%M:%S'`... (6 Replies)
Discussion started by: Pablo_beezo
6 Replies

2. Shell Programming and Scripting

Append Header in CSV file

Hi, I create a csv file and the output looks like below Arun,E001 Sathish,E003 Now i need to include the below header and the output should like below Name,Number Arun,E001 Sathish,E003 Please guide me. Thanks (4 Replies)
Discussion started by: Sekar1
4 Replies

3. Shell Programming and Scripting

Matching lines across multiple csv files and merging a particular field

I have about 20 CSV's that all look like this: "","","","","","","","","","","","","","","",""What I've been told I need to produce is the exact same thing, but with each file now containing the start_code from every other file where the email matches. It doesn't matter if any of the other... (1 Reply)
Discussion started by: Demosthenes
1 Replies

4. Shell Programming and Scripting

Add header to a .csv file

Hi, I am trying to add a header record to all the .csv files in a directory. I am using the below sed commnad sed -i '1 i \abc,sam,xyz,tip,pep,rip' xyz.csv but this is not adding the header and I am not getting any error,pls tell me if any thing is wrong in the code. Thanks, Shruthi (2 Replies)
Discussion started by: shruthidwh
2 Replies

5. UNIX for Dummies Questions & Answers

Merge all csv files in one folder considering only 1 header row and ignoring header of all others

Friends, I need help with the following in UNIX. Merge all csv files in one folder considering only 1 header row and ignoring header of all other files. FYI - All files are in same format and contains same headers. Thank you (4 Replies)
Discussion started by: Shiny_Roy
4 Replies

6. Shell Programming and Scripting

Matching and Merging csv data fields based on a common field

Dear List, I have a file of csv data which has a different line per compliance check per host. I do not want any omissions from this csv data file which looks like this: date,hostname,status,color,check 02-03-2012,COMP1,FAIL,Yellow,auth_pass_change... (3 Replies)
Discussion started by: landossa
3 Replies

7. Shell Programming and Scripting

How to get sqlplus column header once in csv file?

Hi All, Could anyoone please let me know how do I get sqlplus column header once in csv file Scripts are below: cat concreq.sh #!/bin/bash . $HOME/.profile while ; do sqlplus apps/pwd <<-EOF set lines 100 pages 100 col "USER_CONCURRENT_QUEUE_NAME" format a40; --set termout off... (5 Replies)
Discussion started by: a1_win
5 Replies

8. Linux

How do I format a Date field of a .CSV file with multiple commas in a string field?

I have a .CSV file (file.csv) whose data are all enclosed in double quotes. Sample format of the file is as below: column1,column2,column3,column4,column5,column6, column7, Column8, Column9, Column10 "12","B000QRIGJ4","4432","string with quotes, and with a comma, and colon: in... (3 Replies)
Discussion started by: dhruuv369
3 Replies

9. Shell Programming and Scripting

Match columns from two csv files and update field in one of the csv file

Hi, I have a file of csv data, which looks like this: file1: 1AA,LGV_PONCEY_LES_ATHEE,1,\N,1,00020460E1,0,\N,\N,\N,\N,2,00.22335321,0.00466628 2BB,LES_POUGES_ASF,\N,200,200,00006298G1,0,\N,\N,\N,\N,1,00.30887539,0.00050312... (10 Replies)
Discussion started by: djoseph
10 Replies

10. UNIX for Dummies Questions & Answers

Check for empty line at end of a dynamic header in each file

Hi Folks, I have a requirement to develop a shell script. PFB my requirement, Requirement: I need to check an empty line after the end of each header in respective file and if a empty line is present simply echo file OK and if empty line is not present echo "Adding empty line" and add an... (6 Replies)
Discussion started by: tpk
6 Replies

LEARN ABOUT OPENSOLARIS

langinfo

langinfo.h(3HEAD)						      Headers							 langinfo.h(3HEAD)

NAME

       langinfo.h, langinfo - language information constants

SYNOPSIS

       #include <langinfo.h>

DESCRIPTION

       The  <langinfo.h>  header  contains  the constants used to identify items of langinfo data (see nl_langinfo(3C)). The type of the constant,
       nl_item, is defined as described in <nl_types.h>.

       The following constants are defined. The entries under Category indicate in which setlocale(3C) category each item is defined.

		       |		|
	  Constant     |   Category	|		 Meaning
       ----------------+----------------+----------------------------------------
       CODESET	       |LC_CTYPE	|codeset name
       ----------------+----------------+----------------------------------------
       D_T_FMT	       |LC_TIME 	|string for formatting date and time
       ----------------+----------------+----------------------------------------
       D_FMT	       |LC_TIME 	|date format string
       ----------------+----------------+----------------------------------------
       T_FMT	       |LC_TIME 	|time format string
       ----------------+----------------+----------------------------------------
       T_FMT_AMPM      |LC_TIME 	|a.m. or p.m. time format string
       ----------------+----------------+----------------------------------------
       AM_STR	       |LC_TIME 	|ante-meridiem affix
       ----------------+----------------+----------------------------------------
       PM_STR	       |LC_TIME 	|post-meridiem affix
       ----------------+----------------+----------------------------------------
       DAY_1	       |LC_TIME 	|name of the first day of the week  (for
		       |		|example, Sunday)
       ----------------+----------------+----------------------------------------
       DAY_2	       |LC_TIME 	|name of the second day of the week (for
		       |		|example, Monday)
       ----------------+----------------+----------------------------------------
       DAY_3	       |LC_TIME 	|name of the third day of the week  (for
		       |		|example, Tuesday)
       ----------------+----------------+----------------------------------------
       DAY_4	       |LC_TIME 	|name of the fourth day of the week (for
		       |		|example, Wednesday)
       ----------------+----------------+----------------------------------------
       DAY_5	       |LC_TIME 	|name of the fifth day of the week  (for
		       |		|example, Thursday)
       ----------------+----------------+----------------------------------------
       DAY_6	       |LC_TIME 	|name  of the sixth day of the week (for
		       |		|example, Friday)
       ----------------+----------------+----------------------------------------
       DAY_7	       |LC_TIME 	|name of the seventh  day  of  the  week
		       |		|(for example, Saturday)
       ----------------+----------------+----------------------------------------
       ABDAY_1	       |LC_TIME 	|abbreviated  name  of	the first day of
		       |		|the week
       ----------------+----------------+----------------------------------------
       ABDAY_2	       |LC_TIME 	|abbreviated name of the second  day  of
		       |		|the week
       ----------------+----------------+----------------------------------------

       ABDAY_3	       |LC_TIME 	|abbreviated  name  of	the third day of
		       |		|the week
       ----------------+----------------+----------------------------------------
       ABDAY_4	       |LC_TIME 	|abbreviated name of the fourth  day  of
		       |		|the week
       ----------------+----------------+----------------------------------------
       ABDAY_5	       |LC_TIME 	|abbreviated  name  of	the fifth day of
		       |		|the week
       ----------------+----------------+----------------------------------------
       ABDAY_6	       |LC_TIME 	|abbreviated name of the seventh day  of
		       |		|the week
       ----------------+----------------+----------------------------------------
       ABDAY_7	       |LC_TIME 	|abbreviated  name of the seventh day of
		       |		|the week
       ----------------+----------------+----------------------------------------
       MON_1	       |LC_TIME 	|name of the first month of the year
       ----------------+----------------+----------------------------------------
       MON_2	       |LC_TIME 	|name of the second month
       ----------------+----------------+----------------------------------------
       MON_3	       |LC_TIME 	|name of the third month
       ----------------+----------------+----------------------------------------
       MON_4	       |LC_TIME 	|name of the fourth month
       ----------------+----------------+----------------------------------------
       MON_5	       |LC_TIME 	|name of the fifth month
       ----------------+----------------+----------------------------------------
       MON_6	       |LC_TIME 	|name of the sixth month
       ----------------+----------------+----------------------------------------
       MON_7	       |LC_TIME 	|name of the seventh month
       ----------------+----------------+----------------------------------------
       MON_8	       |LC_TIME 	|name of the eighth month
       ----------------+----------------+----------------------------------------
       MON_9	       |LC_TIME 	|name of the ninth month
       ----------------+----------------+----------------------------------------
       MON_10	       |LC_TIME 	|name of the tenth month
       ----------------+----------------+----------------------------------------
       MON_11	       |LC_TIME 	|name of the eleventh month
       ----------------+----------------+----------------------------------------
       MON_12	       |LC_TIME 	|name of the twelfth month
       ----------------+----------------+----------------------------------------
       ABMON_1	       |LC_TIME 	|abbreviated name of the first month
       ----------------+----------------+----------------------------------------
       ABMON_2	       |LC_TIME 	|abbreviated name of the second month
       ----------------+----------------+----------------------------------------
       ABMON_3	       |LC_TIME 	|abbreviated name of the third month
       ----------------+----------------+----------------------------------------
       ABMON_4	       |LC_TIME 	|abbreviated name of the fourth month
       ----------------+----------------+----------------------------------------
       ABMON_5	       |LC_TIME 	|abbreviated name of the fifth month
       ----------------+----------------+----------------------------------------
       ABMON_6	       |LC_TIME 	|abbreviated name of the sixth month
       ----------------+----------------+----------------------------------------
       ABMON_7	       |LC_TIME 	|abbreviated name of the seventh month
       ----------------+----------------+----------------------------------------
       ABMON_8	       |LC_TIME 	|abbreviated name of the eighth month
       ----------------+----------------+----------------------------------------
       ABMON_9	       |LC_TIME 	|abbreviated name of the ninth month
       ----------------+----------------+----------------------------------------
       ABMON_10        |LC_TIME 	|abbreviated name of the tenth month
       ----------------+----------------+----------------------------------------
       ABMON_11        |LC_TIME 	|abbreviated name of the eleventh month
       ----------------+----------------+----------------------------------------
       ABMON_12        | LC_TIME	|abbreviated name of the twelfth month
       ----------------+----------------+----------------------------------------
       ERA	       |LC_TIME 	|era description segments
       ----------------+----------------+----------------------------------------

       ERA_D_FMT       |LC_TIME 	|era date format string
       ----------------+----------------+----------------------------------------
       ERA_D_T_FMT     |LC_TIME 	|era date and time format string
       ----------------+----------------+----------------------------------------
       ERA_T_FMT       |LC_TIME 	|era time format string
       ----------------+----------------+----------------------------------------
       ALT_DIGITS      |LC_TIME 	|alternative symbols for digits
       ----------------+----------------+----------------------------------------
       RADIXCHAR       |LC_NUMERIC	|radix character
       ----------------+----------------+----------------------------------------
       THOUSEP	       |LC_NUMERIC	|separator for thousands
       ----------------+----------------+----------------------------------------
       YESEXPR	       |LC_MESSAGES	|affirmative response expression
       ----------------+----------------+----------------------------------------
       NOEXPR	       |LC_MESSAGES	|negative response expression
       ----------------+----------------+----------------------------------------
       YESSTR	       |LC_MESSAGES	|affirmative response for yes/no queries
       ----------------+----------------+----------------------------------------
       NOSTR	       |LC_MESSAGES	|negative response ro yes/no queries
       ----------------+----------------+----------------------------------------
       CRNCYSTR        |LC_MONETARY	|local currency symbol, preceded by  '-'
		       |		|if  the  symbol sould appear before the
		       |		|value, '+' if the symbol should  appear
		       |		|after	the  value, or '.' if the symbol
		       |		|should replace the radix character

       If the locale's values for p_cs_precedes and n_cs_precedes do not match, the value of nl_langinfo(CRNCYSTR) is unspecified.

       The <langinfo.h> header declares the following as a function:

	 char *nl_langinfo(nl_item);

       Inclusion of <langinfo.h> header may also make visible all symbols from <nl_types.h>.

USAGE

       Wherever possible, users are advised to use functions compatible with those in the ISO C standard to access items of langinfo data. In par-
       ticular, the strftime(3C) function should be used to access date and time information defined in category LC_TIME. The localeconv(3C) func-
       tion should be used to access information corresponding to RADIXCHAR, THOUSEP, and CRNCYSTR.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Standard			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       mkmsgs(1), localeconv(3C), nl_langinfo(3C), nl_types.h(3HEAD), setlocale(3C), strftime(3C), attributes(5), standards(5)

SunOS 5.11							    30 Aug 2002 						 langinfo.h(3HEAD)
All times are GMT -4. The time now is 08:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy