Search Results

This is Hadoop cluster, master node. this was installed by admins, i am just a developer on hadoop. some of the scripts of ETL are developed on python which works with python 3.4 version uses xl...

When i run the command you have provided i am getting this please: thank you.


[rreddy@svrhdpm01 ~]$ scl enable rh-python34 bash <<"EOF"
> printf '%s\n' "$PATH"
> type python rh-python34
> EOF...

Thanks a lot for the reply, when i execute the command i am getting the following please, by default it is 2.6.6, i do have some python scripts that extracts xlsx files into csv and does some...

On our server default python version is 2.6, how to enable rh-python34 via bash shell.
Thanks a lot for the helpful info.

There is no error message coming at all. just exiting the shell.

I have a bash shell script, within it i am using the below two commands . its failing right on scl enable command itself.

if i run it by itself without a shell, it works fine.

by default it is...

I have a folder with 100s of dat files, with delimiter "|", in some files they didn't provide this delimiter. how to automatically check those list of files in a folder which doesnt have a delimiter...

I am on linux red hat, want to use the logic within bash shell script file.

I have the following type, named files in folder /staging, want to move with new filename just the firstpart upto...

I am trying to use the below sed command to replace all "|" to ^, in a folder had 50 dat files. when i tried with 1 file it worked but when i tried with wild card, is not working.

sed -i...

with in my files i have the data like this, starting with a pipe and ending the line with a pipe.

all i want is to replace the first and last pipe , remove those
trying to use following sed...

I have few bash shells, which i want to run sequentially,

how to create a shell file, and execute/call one after other shell file. I am very new to shell programming. Bult some and running...

I have the following with in my existing bash shell file.


#here the below impala shell command only to be executed if day is saturday dayof week=6
if [$ date +%w]=6 then
impala-shell -i...

How to check the day name,is it saturday in bash shell script.

If dayname = saturday then
run the full load
else
run just the incremental loads
end if

Thank you very much for the...

I have the following csv file at the path; now using sed command. what is this exactly doing.


sed -i 's/[\t]/,/g' /FTP/LAB_RESULT_CM.csv


Thank you very much for the helpful info.

I have a shell script, research_dump_sub.sh
the first 3 lines are below. the below two lines writing to log file, i am not finding the log file, how to locate, and what is the exec command doing...

I am trying to merge all csv files from source path into one single csv file in target. but getting error message:


hadoop fs -cat /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/TCH-charge_*.csv >...

Currently using the below script to being all compressed files .gz files from source folder and appending to the target txt file uncompressed.
Teh target txt file is getting too large in size, right...

Sorry, i didn't realize i put the variables.

here are the exact full paths:
hadoop fs -text /user/hive/warehouse/stage.db/CLINICAL_EVENT/CLINICAL_EVENT* | hadoop fs -put -...

what does the below script doing, the first path with wild card clinical_event* has all .gz compressed files multiple and the final path has 1 single clinical_event.txt file

almost 350GB in size....

Hello Aia,

Thanks a lot for the helpful response, now making sense and understanding thank you.

from stage_process.sh file has the following:

PROCESS_DIR=/usr/local/bin/mchhadoop...

I have the following script used, i am new to shell scripting. tryign to understand.
in the put $BASE_FOLDER/$base_name holds which path.
What does it mean by $1

second path in put command is it...

I have the below script triggered daily at 330am in the morning, since last 7 days job not writing anything to database.

below impala shell calling shell file which has sql , it is extracting data...

I have shell file that has the following logic, i am new to shell programming.
What does process month $1 do?

I am assuming that the below dates go back three months from sysdate month. is it...

How to view the cron jobs that ran on kinit i keep getting must be privileged to use -u

this is the control used,

echo 'cat /usr/local/bin/tpthadoop/secret/hadoop.txt' | kinit hdfs

what...