10-11-2017
CSV file name: interface.csv
HDFS - Hive - Hbase <<< CSV Header
/unix/win/filename1 - con_tag_incr - con_tag <<< row 1
/unix/win/filename2 - crm_tag_incr - crm_tag <<< row 2
/unix/win/filename3 - retail_tag_incr - retail_tag_incr <<< row 3
Please let me know, if you need more details and appreciate your help
---------- Post updated 10-11-17 at 06:32 AM ---------- Previous update was 10-10-17 at 09:19 AM ----------
#!/bin/bash
input="/home/username/interface.csv"
while IFS=',' read -r f1 f2 f3
do
echo "$f1 $f2 $f3"
hdfs dfs -rm -R /user/"$f1"/retail.csv
hive -f /home/username/droptable.sql
done < "$input"
Now I have to pass the DB_NAME and TABLE_NAME as parameters into the shell script.
DB_NAME's: CON, RETAIL, CRM
DROP TABLE IF EXISTS ${DB_NAME}.${TABLE_NAME};
Last edited by shivamayam; 10-11-2017 at 10:45 AM..
Reason: CSV file with rows and updated DB
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello to all members,
I am very new in unix stuff (shell scripting), but a want to learn a lot. I am a ex windows user but now i am absolutely Linux super user... :D
So i am tryng to made a function to do this:
I have two csv files only with numbers, the first one a have:
1
2
3
4
5... (6 Replies)
Discussion started by: Sadarrab
6 Replies
2. Shell Programming and Scripting
Hi All,
I need to check if a csv file is empty, leaving the first line as the first line is header
pls help
Thanks (3 Replies)
Discussion started by: gwrm
3 Replies
3. UNIX and Linux Applications
Hi
I'm using an oracle database... Lets call it databasename
My username and password are the same .... lets all that andrea/andrea
So I want to write a script to copy all the data from my table called tablename and store that data to a csv file called filename.
I cant seem to get... (2 Replies)
Discussion started by: ladyAnne
2 Replies
4. Shell Programming and Scripting
Need UNIX script read below .csv file and print the line only records where type = TRN.
Srno,Type,InputFileName,NewColumnData
1,TRN,File1.dat,11
2,TRN,File2.dat,12
3,TRN,File3.dat,13
4,REF,File4.dat,
5,REF,File5.dat,
regards,
santosh (4 Replies)
Discussion started by: santosh2k2
4 Replies
5. UNIX for Dummies Questions & Answers
Hello All,
i am a newbie and need some help when reading a csv file in a bourne shell script. I want to read 10 lines, then wait for a minute and then do a reading of another 10 lines and so on in the same way. I want to do this till the end of file.
Any inputs are appreciated
... (3 Replies)
Discussion started by: victor.s
3 Replies
6. Shell Programming and Scripting
Hello,
this is my very first comment on this forum and i hope i don't mess it up. If i do, please forgive me (also for any language mistakes you may wanna know that i'm not native speaking).
As i just started doing a bigger paper for my studies i got a bunch of data in seperate csv-files... (1 Reply)
Discussion started by: FabianDe
1 Replies
7. Shell Programming and Scripting
Hi,
I have a script file where i'm validatig the input file and storing the validated records on HDFS.
I wanted to load data from HDFS to HBASE using pig script. So for that i have created a HBASE table and written pig script to load data from HDFS to HBASE which is working fine. Now i wanted... (0 Replies)
Discussion started by: shree11
0 Replies
8. Shell Programming and Scripting
I have the data in csv in 3 tables. how can I output the same into 3 tables in html.also how can I set the width. tried multiple options . attached is the format.
#!/bin/ksh
awk 'BEGIN{
FS=","
print "<HTML><BODY><TABLE border = '1' cellpadding=10 width=100>"
print... (7 Replies)
Discussion started by: archana25
7 Replies
9. Programming
Hi Guys,
Is there a way to check hive external tables which are created 90 days before and drop those tables along with underlying hdfs data. Can this be achieved in unix script? (10 Replies)
Discussion started by: Master_Mind
10 Replies
10. UNIX for Beginners Questions & Answers
HI Team,
I am working on reading hive table and send email in email body using shell script, can you please help on fixing the errors: I have 6 columns in my hive table and trying to send the email in the mail body.
below script:
#!/bin/bash
hive -e 'SELECT count(*) from db.table' >... (4 Replies)
Discussion started by: Mi4304
4 Replies
LEARN ABOUT CENTOS
hivexget
hivexget(1) Windows Registry hivexget(1)
NAME
hivexget - Get subkey from a Windows Registry binary "hive" file
SYNOPSIS
hivexget hivefile 'PathToSubKey'
hivexget hivefile 'PathToSubKey' name
NOTE
This is a low-level tool. For a more convenient way to navigate the Windows Registry in Windows virtual machines, see virt-win-reg(1).
For proper regedit formatting, use hivexregedit(1).
DESCRIPTION
This program navigates through a Windows Registry binary "hive" file and extracts either all the (key, value) data pairs stored in that
subkey or just the single named data item.
In the first form:
hivexget hivefile 'PathToSubKey'
"hivefile" is some Windows Registry binary hive, and "PathToSubkey" is a path within that hive. NB the path is relative to the top of
this hive, and is not the full path as you would use in Windows (eg. "HKEY_LOCAL_MACHINESYSTEM" is not a valid path).
If the subkey exists, then the output lists all data pairs under this subkey, in a format similar to "regedit" in Windows.
In the second form:
hivexget hivefile 'PathToSubKey' name
"hivefile" and path are as above. "name" is the name of the value of interest (use "@" for the default value).
The corresponding data item is printed "raw" (ie. no processing or escaping) except:
1. If it's a string we will convert it from Windows UTF-16 to UTF-8, if this conversion is possible. The string is printed with a single
trailing newline.
2. If it's a multiple-string value, each string is printed on a separate line.
3. If it's a numeric value, it is printed as a decimal number.
SEE ALSO
hivex(3), hivexml(1), hivexsh(1), hivexregedit(1), virt-win-reg(1), guestfs(3), <http://libguestfs.org/>, virt-cat(1), virt-edit(1).
AUTHORS
Richard W.M. Jones ("rjones at redhat dot com")
COPYRIGHT
Copyright (C) 2009 Red Hat Inc.
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
hivex-1.3.8 2012-12-03 hivexget(1)