03-10-2014
Big Data for System Admins
Hello,
I have been working as Solaris/Linux Admin since past 8 years. I am looking options for my profile change, but there is some limitation. I worked as 24x7 support for admin, server support, high availability, etc. But been worked on developing side and scripting part.
When I search for Big Data jobs on internet, most of them deal with java, scripts and development part. I just want to know, is there any scope for hardcore system admin in Big Data, which deals with admin parts only ? Like managing Namenode, datanode, performance and other tasks in day to day routine, as we do as Unix admin. I have been reading Big data books for sometime and there are many tasks which are related to admin parts, but not sure if that kind of job exists in market.
Thanks in advance.
9 More Discussions You Might Find Interesting
1. AIX
hello
I have a file system with 737 Go of data (oracle)
I want to add 230 Go.
IBM technician says to me that it's better (for performance) to backup the file system, rebuild it with the new 250Go and restore it....
737 Go to backup, it is not very simple... !!!!
You confirm what says the... (6 Replies)
Discussion started by: pascalbout
6 Replies
2. What is on Your Mind?
Hello All,
Today is System Admins day. it comes on last friday of July. Congratulations to all of you. Keep Posting....
System Administrator Appreciation Day
Awadhesh (3 Replies)
Discussion started by: Awadhesh
3 Replies
3. Shell Programming and Scripting
Morning guys. Another day another question. :rolleyes:
I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution:
for results in `grep "^\
... works, but takes ages (we're talking minutes) to run. The data is held... (8 Replies)
Discussion started by: dlam
8 Replies
4. Shell Programming and Scripting
How to cut data from big file
my file around 30 gb
I tried "head -50022172 filename > newfile.txt ,and tail -5454283 newfile.txt. It's slowy.
afer that I tried sed -n '46467831,50022172p' filename > newfile.txt ,also slow
Please recommend me , faster command to cut some data from... (4 Replies)
Discussion started by: almanto
4 Replies
5. Shell Programming and Scripting
Hi,
I did read a few posts on the subjects, tried out a few solutions, but did not solve my problem.
https://www.unix.com/302121568-post11.html
https://www.unix.com/shell-programming-scripting/137953-large-file-columns-into-rows-etc-4.html
Please help. Problem very similar to the second link... (15 Replies)
Discussion started by: genehunter
15 Replies
6. Shell Programming and Scripting
Hello,
I have a big data file (160 MB) full of records with pipe(|) delimited those fields. I`m sorting the file on the first field.
I'm trying to sort with "sort" command and it brings me 6 minutes.
I have tried with some transformation methods in perl but it results "Out of memory". I was... (2 Replies)
Discussion started by: rubber08
2 Replies
7. Red Hat
Hey guys, we will be interested in learning from your experience in using Linux in Big Data projects. Has anyone used Hadoop, or MapR or Horton Works on Linux and any experiences you may have had on these. I am more interested in knowing if a certain distribution of Linux is better supported for... (1 Reply)
Discussion started by: johnsmith111
1 Replies
8. Shell Programming and Scripting
The dataset I'm working on is about 450G, with about 7000 colums and 30,000,000 rows.
I want to extract about 2000 columns from the original file to form a new file.
I have the list of number of the columns I need, but don't know how to extract them.
Thanks! (14 Replies)
Discussion started by: happypoker
14 Replies
9. Solaris
Gents
Actually I have question and i need your support.
I have this NAS file system mounted as /coresys has size of 7 TB
I need to Split this file system into several file systems as mount points I mean how to can I Split it professionally to different NAS mount points how to can I decide... (2 Replies)
Discussion started by: AbuAliiiiiiiiii
2 Replies
LEARN ABOUT DEBIAN
myproxy-admin-change-pass
myproxy-admin-change-pass(8) MyProxy myproxy-admin-change-pass(8)
NAME
myproxy-admin-change-pass - change credential passphrase
SYNOPSIS
myproxy-admin-change-pass [ options ]
DESCRIPTION
The myproxy-admin-change-pass command changes the passphrase used to encrypt a credential in the MyProxy repository. The command first
prompts for the current passphrase for the credential, then prompts twice for the new passphrase. If an empty passphrase is given, the
credential will not be encrypted. It accesses the repository directly and must be run on the machine where the myproxy-server(8) is
installed from the account that owns the repository.
OPTIONS
-h Displays command usage text and exits.
-u Displays command usage text and exits.
-s dir Specifies the location of the credential storage directory. The directory must be accessible only by the user running the myproxy-
server process for security reasons. Default: /var/lib/myproxy or /var/myproxy or $GLOBUS_LOCATION/var/myproxy
-l username
Specifies the MyProxy account under which the credential should be stored.
-k name
Specifies the credential name.
-S, --stdin_pass
By default, the command prompts for a passphrase and reads the passphrase from the active tty. When running the command non-inter-
actively, there may be no associated tty. Specifying this option tells the command to read passphrases from standard input without
prompts or confirmation.
EXIT STATUS
0 on success, >0 on error
AUTHORS
See http://myproxy.ncsa.uiuc.edu/about for the list of MyProxy authors.
SEE ALSO
myproxy-change-pass-phrase(1), myproxy-destroy(1), myproxy-info(1), myproxy-init(1), myproxy-logon(1), myproxy-retrieve(1), myproxy-
store(1), myproxy-server.config(5), myproxy-admin-adduser(8), myproxy-admin-load-credential(8), myproxy-admin-query(8), myproxy-server(8)
MyProxy 2009-12-1 myproxy-admin-change-pass(8)