Sponsored Content
Top Forums Shell Programming and Scripting Matching the header of a .CSV file with dynamic field names Post 302910993 by dhruuv369 on Tuesday 29th of July 2014 01:33:54 PM
Old 07-29-2014
Matching the header of a .CSV file with dynamic field names

I have a .CSV file (frequency - weekly) whose header contains the year-week value in two of the columns which keeps changing every week. For an instance please see below.
Code:
Column1,Column2,Column3,Column4,Column5,Column6,Column7,Column8,Column9,Column10,Column11,Column12,Column13,201420 Column14,201420 Column15

I have to check if the data is placed under the right column and then proceed loading that data into the datamart. I created a standard header to compare it with the header of this file, but due to the dynamic nature of the field 14 and 15, I am not able to match the header every week. There is no date in the field name and I cannot use sysdate. Could you please suggest me how can I achieve this either using cat/awk/sed or any wildcards? Also let me know if you need more information.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How can I add a header to a csv file

I have a csv file which has no header. the file has 15 fields and needs to go out with a header of 8 fields. The header content needs to have some variables and some fixed that i have set up: variable header fields OUTFILE_YEAR=`date '+%y'` DATE=`date '+%d%m%y'` TIME=`date '+%H:%M:%S'`... (6 Replies)
Discussion started by: Pablo_beezo
6 Replies

2. Shell Programming and Scripting

Append Header in CSV file

Hi, I create a csv file and the output looks like below Arun,E001 Sathish,E003 Now i need to include the below header and the output should like below Name,Number Arun,E001 Sathish,E003 Please guide me. Thanks (4 Replies)
Discussion started by: Sekar1
4 Replies

3. Shell Programming and Scripting

Matching lines across multiple csv files and merging a particular field

I have about 20 CSV's that all look like this: "","","","","","","","","","","","","","","",""What I've been told I need to produce is the exact same thing, but with each file now containing the start_code from every other file where the email matches. It doesn't matter if any of the other... (1 Reply)
Discussion started by: Demosthenes
1 Replies

4. Shell Programming and Scripting

Add header to a .csv file

Hi, I am trying to add a header record to all the .csv files in a directory. I am using the below sed commnad sed -i '1 i \abc,sam,xyz,tip,pep,rip' xyz.csv but this is not adding the header and I am not getting any error,pls tell me if any thing is wrong in the code. Thanks, Shruthi (2 Replies)
Discussion started by: shruthidwh
2 Replies

5. UNIX for Dummies Questions & Answers

Merge all csv files in one folder considering only 1 header row and ignoring header of all others

Friends, I need help with the following in UNIX. Merge all csv files in one folder considering only 1 header row and ignoring header of all other files. FYI - All files are in same format and contains same headers. Thank you (4 Replies)
Discussion started by: Shiny_Roy
4 Replies

6. Shell Programming and Scripting

Matching and Merging csv data fields based on a common field

Dear List, I have a file of csv data which has a different line per compliance check per host. I do not want any omissions from this csv data file which looks like this: date,hostname,status,color,check 02-03-2012,COMP1,FAIL,Yellow,auth_pass_change... (3 Replies)
Discussion started by: landossa
3 Replies

7. Shell Programming and Scripting

How to get sqlplus column header once in csv file?

Hi All, Could anyoone please let me know how do I get sqlplus column header once in csv file Scripts are below: cat concreq.sh #!/bin/bash . $HOME/.profile while ; do sqlplus apps/pwd <<-EOF set lines 100 pages 100 col "USER_CONCURRENT_QUEUE_NAME" format a40; --set termout off... (5 Replies)
Discussion started by: a1_win
5 Replies

8. Linux

How do I format a Date field of a .CSV file with multiple commas in a string field?

I have a .CSV file (file.csv) whose data are all enclosed in double quotes. Sample format of the file is as below: column1,column2,column3,column4,column5,column6, column7, Column8, Column9, Column10 "12","B000QRIGJ4","4432","string with quotes, and with a comma, and colon: in... (3 Replies)
Discussion started by: dhruuv369
3 Replies

9. Shell Programming and Scripting

Match columns from two csv files and update field in one of the csv file

Hi, I have a file of csv data, which looks like this: file1: 1AA,LGV_PONCEY_LES_ATHEE,1,\N,1,00020460E1,0,\N,\N,\N,\N,2,00.22335321,0.00466628 2BB,LES_POUGES_ASF,\N,200,200,00006298G1,0,\N,\N,\N,\N,1,00.30887539,0.00050312... (10 Replies)
Discussion started by: djoseph
10 Replies

10. UNIX for Dummies Questions & Answers

Check for empty line at end of a dynamic header in each file

Hi Folks, I have a requirement to develop a shell script. PFB my requirement, Requirement: I need to check an empty line after the end of each header in respective file and if a empty line is present simply echo file OK and if empty line is not present echo "Adding empty line" and add an... (6 Replies)
Discussion started by: tpk
6 Replies
langinfo.h(3HEAD)						      Headers							 langinfo.h(3HEAD)

NAME
langinfo.h, langinfo - language information constants SYNOPSIS
#include <langinfo.h> DESCRIPTION
The <langinfo.h> header contains the constants used to identify items of langinfo data (see nl_langinfo(3C)). The type of the constant, nl_item, is defined as described in <nl_types.h>. The following constants are defined. The entries under Category indicate in which setlocale(3C) category each item is defined. Constant Category Meaning CODESET LC_CTYPE codeset name D_T_FMT LC_TIME string for formatting date and time D_FMT LC_TIME date format string T_FMT LC_TIME time format string T_FMT_AMPM LC_TIME a.m. or p.m. time format string AM_STR LC_TIME ante-meridiem affix PM_STR LC_TIME post-meridiem affix DAY_1 LC_TIME name of the first day of the week (for example, Sunday) DAY_2 LC_TIME name of the second day of the week (for example, Monday) DAY_3 LC_TIME name of the third day of the week (for example, Tuesday) DAY_4 LC_TIME name of the fourth day of the week (for example, Wednesday) DAY_5 LC_TIME name of the fifth day of the week (for example, Thursday) DAY_6 LC_TIME name of the sixth day of the week (for example, Friday) DAY_7 LC_TIME name of the seventh day of the week (for example, Saturday) ABDAY_1 LC_TIME abbreviated name of the first day of the week ABDAY_2 LC_TIME abbreviated name of the second day of the week ABDAY_3 LC_TIME abbreviated name of the third day of the week ABDAY_4 LC_TIME abbreviated name of the fourth day of the week ABDAY_5 LC_TIME abbreviated name of the fifth day of the week ABDAY_6 LC_TIME abbreviated name of the seventh day of the week ABDAY_7 LC_TIME abbreviated name of the seventh day of the week MON_1 LC_TIME name of the first month of the year MON_2 LC_TIME name of the second month MON_3 LC_TIME name of the third month MON_4 LC_TIME name of the fourth month MON_5 LC_TIME name of the fifth month MON_6 LC_TIME name of the sixth month MON_7 LC_TIME name of the seventh month MON_8 LC_TIME name of the eighth month MON_9 LC_TIME name of the ninth month MON_10 LC_TIME name of the tenth month MON_11 LC_TIME name of the eleventh month MON_12 LC_TIME name of the twelfth month ABMON_1 LC_TIME abbreviated name of the first month ABMON_2 LC_TIME abbreviated name of the second month ABMON_3 LC_TIME abbreviated name of the third month ABMON_4 LC_TIME abbreviated name of the fourth month ABMON_5 LC_TIME abbreviated name of the fifth month ABMON_6 LC_TIME abbreviated name of the sixth month ABMON_7 LC_TIME abbreviated name of the seventh month ABMON_8 LC_TIME abbreviated name of the eighth month ABMON_9 LC_TIME abbreviated name of the ninth month ABMON_10 LC_TIME abbreviated name of the tenth month ABMON_11 LC_TIME abbreviated name of the eleventh month ABMON_12 LC_TIME abbreviated name of the twelfth month ERA LC_TIME era description segments ERA_D_FMT LC_TIME era date format string ERA_D_T_FMT LC_TIME era date and time format string ERA_T_FMT LC_TIME era time format string ALT_DIGITS LC_TIME alternative symbols for digits RADIXCHAR LC_NUMERIC radix character THOUSEP LC_NUMERIC separator for thousands YESEXPR LC_MESSAGES affirmative response expression NOEXPR LC_MESSAGES negative response expression YESSTR LC_MESSAGES affirmative response for yes/no queries NOSTR LC_MESSAGES negative response ro yes/no queries CRNCYSTR LC_MONETARY local currency symbol, preceded by '-' if the symbol sould appear before the value, '+' if the symbol should appear after the value, or '.' if the symbol should replace the radix character If the locale's values for p_cs_precedes and n_cs_precedes do not match, the value of nl_langinfo(CRNCYSTR) is unspecified. The <langinfo.h> header declares the following as a function: char *nl_langinfo(nl_item); Inclusion of <langinfo.h> header may also make visible all symbols from <nl_types.h>. USAGE
Wherever possible, users are advised to use functions compatible with those in the ISO C standard to access items of langinfo data. In par- ticular, the strftime(3C) function should be used to access date and time information defined in category LC_TIME. The localeconv(3C) func- tion should be used to access information corresponding to RADIXCHAR, THOUSEP, and CRNCYSTR. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Interface Stability |Standard | +-----------------------------+-----------------------------+ SEE ALSO
mkmsgs(1), localeconv(3C), nl_langinfo(3C), nl_types.h(3HEAD), setlocale(3C), strftime(3C), attributes(5), standards(5) SunOS 5.10 30 Aug 2002 langinfo.h(3HEAD)
All times are GMT -4. The time now is 05:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy