10-10-2017
Read CSV file and delete hdfs, hive and hbase tables
I have a CSV file with hdfs directories, hive tables and hbase tables.
1. first column - hdfs directories
2. second column - hive tables
3. third column - hbase tables
I have to check the csv file and look for the first column and delete the hdfs directory from the hdfs path, now search for the second column and delete the hive table, after that look for third column and delete the hbase table.
appreciate your help.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello to all members,
I am very new in unix stuff (shell scripting), but a want to learn a lot. I am a ex windows user but now i am absolutely Linux super user... :D
So i am tryng to made a function to do this:
I have two csv files only with numbers, the first one a have:
1
2
3
4
5... (6 Replies)
Discussion started by: Sadarrab
6 Replies
2. Shell Programming and Scripting
Hi All,
I need to check if a csv file is empty, leaving the first line as the first line is header
pls help
Thanks (3 Replies)
Discussion started by: gwrm
3 Replies
3. UNIX and Linux Applications
Hi
I'm using an oracle database... Lets call it databasename
My username and password are the same .... lets all that andrea/andrea
So I want to write a script to copy all the data from my table called tablename and store that data to a csv file called filename.
I cant seem to get... (2 Replies)
Discussion started by: ladyAnne
2 Replies
4. Shell Programming and Scripting
Need UNIX script read below .csv file and print the line only records where type = TRN.
Srno,Type,InputFileName,NewColumnData
1,TRN,File1.dat,11
2,TRN,File2.dat,12
3,TRN,File3.dat,13
4,REF,File4.dat,
5,REF,File5.dat,
regards,
santosh (4 Replies)
Discussion started by: santosh2k2
4 Replies
5. UNIX for Dummies Questions & Answers
Hello All,
i am a newbie and need some help when reading a csv file in a bourne shell script. I want to read 10 lines, then wait for a minute and then do a reading of another 10 lines and so on in the same way. I want to do this till the end of file.
Any inputs are appreciated
... (3 Replies)
Discussion started by: victor.s
3 Replies
6. Shell Programming and Scripting
Hello,
this is my very first comment on this forum and i hope i don't mess it up. If i do, please forgive me (also for any language mistakes you may wanna know that i'm not native speaking).
As i just started doing a bigger paper for my studies i got a bunch of data in seperate csv-files... (1 Reply)
Discussion started by: FabianDe
1 Replies
7. Shell Programming and Scripting
Hi,
I have a script file where i'm validatig the input file and storing the validated records on HDFS.
I wanted to load data from HDFS to HBASE using pig script. So for that i have created a HBASE table and written pig script to load data from HDFS to HBASE which is working fine. Now i wanted... (0 Replies)
Discussion started by: shree11
0 Replies
8. Shell Programming and Scripting
I have the data in csv in 3 tables. how can I output the same into 3 tables in html.also how can I set the width. tried multiple options . attached is the format.
#!/bin/ksh
awk 'BEGIN{
FS=","
print "<HTML><BODY><TABLE border = '1' cellpadding=10 width=100>"
print... (7 Replies)
Discussion started by: archana25
7 Replies
9. Programming
Hi Guys,
Is there a way to check hive external tables which are created 90 days before and drop those tables along with underlying hdfs data. Can this be achieved in unix script? (10 Replies)
Discussion started by: Master_Mind
10 Replies
10. UNIX for Beginners Questions & Answers
HI Team,
I am working on reading hive table and send email in email body using shell script, can you please help on fixing the errors: I have 6 columns in my hive table and trying to send the email in the mail body.
below script:
#!/bin/bash
hive -e 'SELECT count(*) from db.table' >... (4 Replies)
Discussion started by: Mi4304
4 Replies
LEARN ABOUT X11R4
nisplus_table
NISPLUS_TABLE(5) File Formats Manual NISPLUS_TABLE(5)
NAME
nisplus_table - Postfix NIS+ client
SYNOPSIS
postmap -q "string" "nisplus:[name=%s];name.name."
postmap -q - "nisplus:[name=%s];name.name." <inputfile
DESCRIPTION
The Postfix mail system uses optional lookup tables. These tables are usually in dbm or db format. Alternatively, lookup tables can be
specified as NIS+ databases.
To find out what types of lookup tables your Postfix system supports use the "postconf -m" command.
To test Postfix NIS+ lookup tables, use the "postmap -q" command as described in the SYNOPSIS above.
QUERY SYNTAX
Most of the NIS+ query is specified via the NIS+ map name. The general format of a Postfix NIS+ map name is as follows:
nisplus:[name=%s];name.name.name.:column
Postfix NIS+ map names differ from what one normally would use with commands such as niscat:
o With each NIS+ table lookup, "%s" is replaced by a version of the lookup string. There can be only one "%s" instance in a Postfix
NIS+ map name.
o Postfix NIS+ map names use ";" instead of ",", because the latter character is special in the Postfix main.cf file. Postfix
replaces ";" characters in the map name by "," before making NIS+ queries.
o The ":column" part in the NIS+ map name is not part of the actual NIS+ query. Instead, it specifies the number of the table column
that provides the lookup result. When no ":column" is specified the first column (1) is used.
EXAMPLE
A NIS+ aliases map might be queried as follows:
alias_maps = dbm:/etc/mail/aliases,
nisplus:[alias=%s];mail_aliases.org_dir.$mydomain.:1
This queries the local aliases file before the NIS+ file.
SEE ALSO
postmap(1), Postfix lookup table manager
README FILES
Use "postconf readme_directory" or "postconf html_directory" to locate this information.
DATABASE_README, Postfix lookup table overview
LICENSE
The Secure Mailer license must be distributed with this software.
AUTHOR(S)
Geoff Gibbs
UK-HGMP-RC
Hinxton
Cambridge
CB10 1SB, UK
Adopted and adapted by:
Wietse Venema
IBM T.J. Watson Research
P.O. Box 704
Yorktown Heights, NY 10598, USA
Wietse Venema
Google, Inc.
111 8th Avenue
New York, NY 10011, USA
NISPLUS_TABLE(5)