[..]
I haven't tried a performance comparison, but the following uses fewer processes and pushes less data through the pipes so it could be faster. [..]
The number of processes between the various non-find solutions does not differ much, but I never realized that the amount of data through the pipes could matter that much. Thank you for that insight..
I did some tests with 10.000 input file and it was up to a factor 5 when selection is done before the pipe (obviously depending on the amount of data that can be saved by selecting before the pipe)..
--
My system does not have a lot of line length limitations , so I was able to use this script (since the header and footer do not matter):
Which is a little bit faster still, since it doesn't even use a pipe..
I have 2 files pipe delimted and want to merge them based on a key
e.g file 1
123$aaa$yyy$zzz
345$xab$yzy$zyz
456$sss$ttt$foo
799$aaa$ggg$dee
file 2
123$hhh
345$ddd
456$xxx
888$zzz
so if the key is the first field, and the result should be the common key between file 1 and 2 (6 Replies)
Help in writing a script using sed which updates fileOne with the contents from fileTwo
Example:
Contents of fileOne
1,111111
2,897823
3,235473
4,222222
Contents of fileTwo
1,111111,A,1,2
4,222222,A,2,2
5,374632,A,3,2
6,374654,A,4,2
Final File should be:
1,111111,A,1,2... (9 Replies)
Hello everyone!!
I am not completely new to shell script but I havent been able to find the answer to my problem and I'm sure there are some smart brains here up for the challenge :D.
I have several CSV files that I need to combine into one, but I also need to know where each row came from.... (7 Replies)
Friends,
I need help with the following in UNIX.
Merge all csv files in one folder considering only 1 header row and ignoring header of all other files.
FYI - All files are in same format and contains same headers.
Thank you (4 Replies)
:confused:Hello -- i just joined the forums. I am a complete noob -- only about 1 week into learning how to program anything... and starting with linux.
I am working in Linux terminal.
I have a folder with a bunch of txt files. Each file has several lines of html code. I want to combine... (2 Replies)
Hi all,
I have two separate csv files(comma delimited) file 1 and file 2.
File 1 contains
PAN,NAME,Salary
AAAAA5467D,Raj,50000
AAFAC5467D,Ram,60000
BDCFA5677D,Kumar,90000
File 2 contains
PAN,NAME,Dept,Salary
ASDFG6756T,Karthik,ABC,450000
QWERT8765Y,JAX,CDR,780000... (5 Replies)
I am trying to merge all csv files from source path into one single csv file in target. but getting error message:
hadoop fs -cat /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/TCH-charge_*.csv > /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/final/TCH_pb_charge.csv
getting error message:... (0 Replies)
Hi all,
i need help.
I have two csv files with a huge amount of data.
I need the first column of the first file, to be compared with the data of the second, to have at the end a file with the data not present in the second file.
Example
File1: (only one column)
profile_id
57036226... (11 Replies)
I have three files with similar pattern i need to merge all the coloumns side by side from all three files according to the first coloumn example as shown below
I mentioned 5 coloumns only in example but i have around 15 coloumns in each file.
file1:
Name,Samples,Error,95RT,90RT... (4 Replies)
Discussion started by: Raghuram717
4 Replies
LEARN ABOUT DEBIAN
vodovod
vodovod(6) Games vodovod(6)NAME
vodovod - lead the water from the house to the storage tank
SYNOPSIS
vodovod
DESCRIPTION
Vodovod is a free game, released under GNU GPL license. Graphics and programming are done by Milan Babuskov. This is an over-weekend
project for now, so don't expect miracles. However, game is completely playable.
The goal of the game is to reach the highest possible score. You get a limited number of pipes on each level and need to combine them to
lead the water from the house at the top of the screen to the storage tank at the bottom. For each pipe water goes through, you get 20
points and if you fill the cross-pipe both ways, you get 60 points. At end of each level, you are awarded depending on the skill level:
* Beginner: 100 points
* Toolman: 100 points + number of pipes remaining
* Master plumber: 100 points + 2 x number of pipes remaining
Some of the levels have obstacles where you cannot place pipes, checkpoints through which the water must go and holes in the ground that
slow the flow. Select HELP from the main menu to get more info. The game is playable with joystick/joypad: just move it and press buttons
when you go to Options -> Configure controls
USAGE
The goal of the game is to use pipes to connect the house at the top of the screen with the tank at the bottom. You have time to construct
the initial pipeline before the man enters the house.
For each level you get a limited number of pipes, so use them wisely. If you make a mistake, you can place another pipe over it.
There are certain special blocks in the map:
* Blocked Area - You cannot place pipes on these fields.
* Checkpoint - Your pipeline must go through this field.
* Hole in the ground - Slows down the flow.
SEE ALSO
You can find more information at http://home.gna.org/vodovod/
May 2007 vodovod(6)