Sponsored Content
Full Discussion: Linux in Big Data projects
Operating Systems Linux Red Hat Linux in Big Data projects Post 302650977 by mark54g on Monday 4th of June 2012 04:02:49 PM
Old 06-04-2012
Talk to the Cloudera folks. That or you can look at HPCC. It depends on how you want to structure your code. Hadoop 2.0 is in beta still, if I recall, but they are trying to fix the issue with master node failover.

If you just need a really resilient database, look at riak.
 

7 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

A Big Problem in LINUX Booting

i have some problem in linux booting will u please help me the problem is i was using federo core 1 on my system everything was fine i made one entry in /etc/fstab file for accessing E drive of WINDOWS XP in that i had given file system as VFAT after rebooting system it was not... (1 Reply)
Discussion started by: great_indian
1 Replies

2. Shell Programming and Scripting

Big data file - sed/grep/awk?

Morning guys. Another day another question. :rolleyes: I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution: for results in `grep "^\ ... works, but takes ages (we're talking minutes) to run. The data is held... (8 Replies)
Discussion started by: dlam
8 Replies

3. Shell Programming and Scripting

How to cut some data from big file

How to cut data from big file my file around 30 gb I tried "head -50022172 filename > newfile.txt ,and tail -5454283 newfile.txt. It's slowy. afer that I tried sed -n '46467831,50022172p' filename > newfile.txt ,also slow Please recommend me , faster command to cut some data from... (4 Replies)
Discussion started by: almanto
4 Replies

4. Shell Programming and Scripting

Transpose columns to Rows : Big data

Hi, I did read a few posts on the subjects, tried out a few solutions, but did not solve my problem. https://www.unix.com/302121568-post11.html https://www.unix.com/shell-programming-scripting/137953-large-file-columns-into-rows-etc-4.html Please help. Problem very similar to the second link... (15 Replies)
Discussion started by: genehunter
15 Replies

5. Shell Programming and Scripting

Sort a big data file

Hello, I have a big data file (160 MB) full of records with pipe(|) delimited those fields. I`m sorting the file on the first field. I'm trying to sort with "sort" command and it brings me 6 minutes. I have tried with some transformation methods in perl but it results "Out of memory". I was... (2 Replies)
Discussion started by: rubber08
2 Replies

6. Shell Programming and Scripting

Extract certain columns from big data

The dataset I'm working on is about 450G, with about 7000 colums and 30,000,000 rows. I want to extract about 2000 columns from the original file to form a new file. I have the list of number of the columns I need, but don't know how to extract them. Thanks! (14 Replies)
Discussion started by: happypoker
14 Replies

7. What is on Your Mind?

Big Data for System Admins

Hello, I have been working as Solaris/Linux Admin since past 8 years. I am looking options for my profile change, but there is some limitation. I worked as 24x7 support for admin, server support, high availability, etc. But been worked on developing side and scripting part. When I search for Big... (2 Replies)
Discussion started by: nightup2222
2 Replies
projects(1)							   User Commands						       projects(1)

NAME
projects - print project membership of user SYNOPSIS
projects [-dv] [ user] projects -l [projectname [projectname...]] DESCRIPTION
The projects command prints on standard output the projects to which the invoking user or an optionally specified user belongs. Each user belongs to some set of projects specified in the project(4) file and possibly in the associated NIS maps and LDAP databases for project information. OPTIONS
The following options are supported: -d Prints only default project. -l Prints verbose info on each project projectname. If no projectnames are given, info on all projects is printed. -v Prints project descriptions along with project names. OPERANDS
The following operand is supported: projectnaDisplay information for the specified project. user Displays project memberships for the specified user. EXAMPLES
Example 1: Displaying Membership for a Specified User example$ projects paul default beatles wings example$ projects ringo default beatles example$ projects -d paul beatles EXIT STATUS
The following exit values are returned: 0 Successful completion. 1 A fatal error occurred during execution. 2 Invalid command line options were specified. FILES
/etc/project Local database containing valid project definitions for this machine. ATTRIBUTES
See attributes(5) for a description of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWcsu | +-----------------------------+-----------------------------+ |Stability |See below. | +-----------------------------+-----------------------------+ The invocation is Evolving. The human-readable output is Unstable. SEE ALSO
getdefaultproj(3PROJECT), getprojent(3PROJECT), project(4), attributes(5) SunOS 5.10 13 May 2004 projects(1)
All times are GMT -4. The time now is 07:07 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy