06-04-2012
Talk to the Cloudera folks. That or you can look at HPCC. It depends on how you want to structure your code. Hadoop 2.0 is in beta still, if I recall, but they are trying to fix the issue with master node failover.
If you just need a really resilient database, look at riak.
7 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
i have some problem in linux booting
will u please help me
the problem is
i was using federo core 1 on my system
everything was fine
i made one entry in /etc/fstab file for accessing E
drive of WINDOWS XP
in that i had given file system as VFAT after
rebooting system it
was not... (1 Reply)
Discussion started by: great_indian
1 Replies
2. Shell Programming and Scripting
Morning guys. Another day another question. :rolleyes:
I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution:
for results in `grep "^\
... works, but takes ages (we're talking minutes) to run. The data is held... (8 Replies)
Discussion started by: dlam
8 Replies
3. Shell Programming and Scripting
How to cut data from big file
my file around 30 gb
I tried "head -50022172 filename > newfile.txt ,and tail -5454283 newfile.txt. It's slowy.
afer that I tried sed -n '46467831,50022172p' filename > newfile.txt ,also slow
Please recommend me , faster command to cut some data from... (4 Replies)
Discussion started by: almanto
4 Replies
4. Shell Programming and Scripting
Hi,
I did read a few posts on the subjects, tried out a few solutions, but did not solve my problem.
https://www.unix.com/302121568-post11.html
https://www.unix.com/shell-programming-scripting/137953-large-file-columns-into-rows-etc-4.html
Please help. Problem very similar to the second link... (15 Replies)
Discussion started by: genehunter
15 Replies
5. Shell Programming and Scripting
Hello,
I have a big data file (160 MB) full of records with pipe(|) delimited those fields. I`m sorting the file on the first field.
I'm trying to sort with "sort" command and it brings me 6 minutes.
I have tried with some transformation methods in perl but it results "Out of memory". I was... (2 Replies)
Discussion started by: rubber08
2 Replies
6. Shell Programming and Scripting
The dataset I'm working on is about 450G, with about 7000 colums and 30,000,000 rows.
I want to extract about 2000 columns from the original file to form a new file.
I have the list of number of the columns I need, but don't know how to extract them.
Thanks! (14 Replies)
Discussion started by: happypoker
14 Replies
7. What is on Your Mind?
Hello,
I have been working as Solaris/Linux Admin since past 8 years. I am looking options for my profile change, but there is some limitation. I worked as 24x7 support for admin, server support, high availability, etc. But been worked on developing side and scripting part.
When I search for Big... (2 Replies)
Discussion started by: nightup2222
2 Replies
LEARN ABOUT POSIX
projects
projects(1) User Commands projects(1)
NAME
projects - print project membership of user
SYNOPSIS
projects [-dv] [ user]
projects -l [projectname [projectname...]]
DESCRIPTION
The projects command prints on standard output the projects to which the invoking user or an optionally specified user belongs. Each user
belongs to some set of projects specified in the project(4) file and possibly in the associated NIS maps and LDAP databases for project
information.
OPTIONS
The following options are supported:
-d Prints only default project.
-l Prints verbose info on each project projectname. If no projectnames are given, info on all projects is printed.
-v Prints project descriptions along with project names.
OPERANDS
The following operand is supported:
projectnaDisplay information for the specified project.
user Displays project memberships for the specified user.
EXAMPLES
Example 1: Displaying Membership for a Specified User
example$ projects paul
default beatles wings
example$ projects ringo
default beatles
example$ projects -d paul
beatles
EXIT STATUS
The following exit values are returned:
0 Successful completion.
1 A fatal error occurred during execution.
2 Invalid command line options were specified.
FILES
/etc/project Local database containing valid project definitions for this machine.
ATTRIBUTES
See attributes(5) for a description of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWcsu |
+-----------------------------+-----------------------------+
|Stability |See below. |
+-----------------------------+-----------------------------+
The invocation is Evolving. The human-readable output is Unstable.
SEE ALSO
getdefaultproj(3PROJECT), getprojent(3PROJECT), project(4), attributes(5)
SunOS 5.10 13 May 2004 projects(1)