Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Big Data for System Admins
The Lounge What is on Your Mind? Big Data for System Admins Post 302892044 by nightup2222 on Monday 10th of March 2014 01:06:50 PM
Old 03-10-2014
I thought, if there are all together different admins who manages Big Data Clusters like HDFS support and maintenance, performance check/tuning on Big Data clusters, day to day routine jobs. System admin is always my first choice, but by looking at market trend where many companies are targeting more on virtual servers and actual hardcore UNIX admin job is getting limited, I though I should learn some new technologies also which can be aligned with my kind of job. In my company only, we had 1200 physical servers (UNIX based) 2 years back. Now only 313 are left, other are large number or Oracle VM's or VMware VM's (running on ESX).
Your suggestion is good, I should look for a company, who has system admin doing Big Data also.
 

9 More Discussions You Might Find Interesting

1. AIX

Organization in a big file system

hello I have a file system with 737 Go of data (oracle) I want to add 230 Go. IBM technician says to me that it's better (for performance) to backup the file system, rebuild it with the new 250Go and restore it.... 737 Go to backup, it is not very simple... !!!! You confirm what says the... (6 Replies)
Discussion started by: pascalbout
6 Replies

2. What is on Your Mind?

System Admins Day Today

Hello All, Today is System Admins day. it comes on last friday of July. Congratulations to all of you. Keep Posting.... System Administrator Appreciation Day Awadhesh (3 Replies)
Discussion started by: Awadhesh
3 Replies

3. Shell Programming and Scripting

Big data file - sed/grep/awk?

Morning guys. Another day another question. :rolleyes: I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution: for results in `grep "^\ ... works, but takes ages (we're talking minutes) to run. The data is held... (8 Replies)
Discussion started by: dlam
8 Replies

4. Shell Programming and Scripting

How to cut some data from big file

How to cut data from big file my file around 30 gb I tried "head -50022172 filename > newfile.txt ,and tail -5454283 newfile.txt. It's slowy. afer that I tried sed -n '46467831,50022172p' filename > newfile.txt ,also slow Please recommend me , faster command to cut some data from... (4 Replies)
Discussion started by: almanto
4 Replies

5. Shell Programming and Scripting

Transpose columns to Rows : Big data

Hi, I did read a few posts on the subjects, tried out a few solutions, but did not solve my problem. https://www.unix.com/302121568-post11.html https://www.unix.com/shell-programming-scripting/137953-large-file-columns-into-rows-etc-4.html Please help. Problem very similar to the second link... (15 Replies)
Discussion started by: genehunter
15 Replies

6. Shell Programming and Scripting

Sort a big data file

Hello, I have a big data file (160 MB) full of records with pipe(|) delimited those fields. I`m sorting the file on the first field. I'm trying to sort with "sort" command and it brings me 6 minutes. I have tried with some transformation methods in perl but it results "Out of memory". I was... (2 Replies)
Discussion started by: rubber08
2 Replies

7. Red Hat

Linux in Big Data projects

Hey guys, we will be interested in learning from your experience in using Linux in Big Data projects. Has anyone used Hadoop, or MapR or Horton Works on Linux and any experiences you may have had on these. I am more interested in knowing if a certain distribution of Linux is better supported for... (1 Reply)
Discussion started by: johnsmith111
1 Replies

8. Shell Programming and Scripting

Extract certain columns from big data

The dataset I'm working on is about 450G, with about 7000 colums and 30,000,000 rows. I want to extract about 2000 columns from the original file to form a new file. I have the list of number of the columns I need, but don't know how to extract them. Thanks! (14 Replies)
Discussion started by: happypoker
14 Replies

9. Solaris

Split a big file system to several files

Gents Actually I have question and i need your support. I have this NAS file system mounted as /coresys has size of 7 TB I need to Split this file system into several file systems as mount points I mean how to can I Split it professionally to different NAS mount points how to can I decide... (2 Replies)
Discussion started by: AbuAliiiiiiiiii
2 Replies

LEARN ABOUT DEBIAN

time-admin

time-admin(1)						      General Commands Manual						     time-admin(1)

NAME

       time-admin - Time Administration Tool

SYNOPSIS

       time-admin [OPTION...]

DESCRIPTION

       time-admin is part of the GNOME system tools, a set of tools to easily access and manage system configuration.

       time-admin  allows you to set the time, date and timezone of your system, as well as setting any time server to synchronize your local time
       server.

OPTIONS

       time-admin accepts the standard GNOME and GTK options.

AUTHORS

       time-admin was written by Carlos Garnacho Parro <garnacho@tuxerver.net> and others.

       This manual page was written by Sven Arvidsson <sa@whiz.se>, for the Debian project (but may be used by others).

SEE ALSO

       services-admin(1), shares-admin(1), network-admin(1), users-admin(1), gtk-options(7), gnome-options(7)

       The online documentation available through the program's Help menu.

GNOME
								    2007-05-08							     time-admin(1)
All times are GMT -4. The time now is 04:03 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy