Sponsored Content
Top Forums UNIX for Beginners Questions & Answers UNIX and HDFS - file systems on same partition. Post 302971699 by Narendra Eliset on Sunday 24th of April 2016 01:39:20 PM
Old 04-24-2016
UNIX and HDFS - file systems on same partition.

I am learning Hadoop. As a part of that, Hdfs - Hadoop distributed file system has commands similar to unix where we can create,copy,move files from unix/linux file system to HDFS.
My question is
1) how two file systems (unix and hdfs) can coexist on thr same partition..
2)What if block used by one FS is overwritten/ modified by another FS.
3) Who does this block handling mechanism inorder to avoid unwanted results.
4) what happens to inodes(unix) pointing to data blocks being used/blocked by HDFS.
Please explain what happens at atomic level when mutiple file systems coexists on same partition.
 

8 More Discussions You Might Find Interesting

1. SCO

Sharing unix drives from two unix systems

I have two SCO openserver systems, 1 in the US and 1 in the UK. I am setting up a vpn to connect the two local networks that also have windows pc's on them. Is there a way that either unix system can see the hard drive on the other unix system so that I can share data between them. I run a cobol... (1 Reply)
Discussion started by: rongrout
1 Replies

2. UNIX for Dummies Questions & Answers

file systems for unix

please someone give me 3 file systems for unix HP-UX version !!! thnks (2 Replies)
Discussion started by: androc
2 Replies

3. UNIX for Dummies Questions & Answers

Monitoring Unix systems

I am looking for a commercial tool that will give me -UNIX Monitoring performance solution+ reports on CCV format. (as perfmon on windows machines). The tool must have following counters per PROCESS: Page Faults/sec Virtual Bytes % Processor Time Handles count Threads count... (19 Replies)
Discussion started by: gen4ik
19 Replies

4. Shell Programming and Scripting

Downloading hdfs file to local UNIX through UNIX script

Hi All , I am very new to unix script.I am aware of unix commands but never put together in unix script level.If any one can suggest me technical guidance in the below scenario that will highly beneficial. Data have been already migrated from mainframe to Hadoop file system(HDFS).HDFS server... (15 Replies)
Discussion started by: STCET22
15 Replies

5. Shell Programming and Scripting

Need help how to copy few records from hdfs to UNIX

Hi All , I am facing one issue here...I have a huge file in hadoop file system.Some disk space issues are thr ,thatswhy I want to copy 1st 100 records from hdfs to local unix.I tried below command but it is no working .Its giving error like cat: Unable to write to output stream.if any one can... (2 Replies)
Discussion started by: STCET22
2 Replies

6. UNIX for Advanced & Expert Users

UNIX and HDFS - file systems on same partition.

I am learning Hadoop. As a part of that, Hdfs - Hadoop distributed file system has commands similar to unix where we can create,copy,move files from unix/linux file system to HDFS. My question is 1) how two file systems (unix and hdfs) can coexist on thr same partition.. 2)What if block used... (0 Replies)
Discussion started by: Narendra Eliset
0 Replies

7. Shell Programming and Scripting

Read CSV file and delete hdfs, hive and hbase tables

I have a CSV file with hdfs directories, hive tables and hbase tables. 1. first column - hdfs directories 2. second column - hive tables 3. third column - hbase tables I have to check the csv file and look for the first column and delete the hdfs directory from the hdfs path, now... (2 Replies)
Discussion started by: shivamayam
2 Replies

8. Shell Programming and Scripting

To get latest hdfs file system

Hi All, I am having below hdfs file system /user/home/dte=2019_01_30/part_1 /user/home/dte=2019_01_30/part_2 /user/home/dte=2019_01_31/part_1 I need to take the latest month hdfs folder while passing date as parameter. For eg . if i pass as Feb month i.e. 20190201(YYYYMMDD), then... (0 Replies)
Discussion started by: Master_Mind
0 Replies
PDISK(8)						    BSD System Manager's Manual 						  PDISK(8)

NAME
pdisk -- Apple partition table editor SYNOPSIS
pdisk [-acdfhilLrv] [--abbr] [--compute_size] [--debug] [--fname] [--help] [--interactive] [--list device] [--logical] [--readonly] [--version] [device ...] DESCRIPTION
pdisk is a menu driven program which partitions disks using the standard Apple disk partitioning scheme described in "Inside Macintosh: Devices". It does not support the Intel/DOS partitioning scheme supported by fdisk(8). Supported options are: -a --abbr Abbreviate the partition types shown in the partition list. -c --compute_size Causes pdisk to always ignore the device size listed in the partition table and compute the device size by other means. -d --debug Turns on debugging. Doesn't add that much output, but does add a new command 'x' to the editing commands that accesses an eclectic bunch of undocumented functionality. -f --fname Show HFS volume names instead of partition name when available. -h --help Prints a short help message. -i --interactive Causes pdisk to go into an interactive mode similar to the MacOS version of the program. -l --list device List the partition tables for the specified devices. -L --logical Show partition limits in logical blocks. Default is physical blocks. -r --readonly Prevents pdisk from writing to the device. -v --version Prints the version number of pdisk. Editing Partition Tables An argument which is simply the name of a device indicates that pdisk should edit the partition table of that device. The current top level editing commands are: C (create with type also specified) c create new partition d delete a partition h command help i initialize partition map n (re)name a partition P (print ordered by base address) p print the partition table q quit editing (don't save changes) r reorder partition entry in map s change size of partition map t change the type of an existing partition w write the partition table Commands which take arguments prompt for each argument in turn. You can also type any number of the arguments separated by spaces and those prompts will be skipped. The only exception to typeahead are the confirmation prompts on the i and w commands, since if we expect you to confirm the decision, we shouldn't undermine that by allowing you to be precipitate about it. Partitions are always specified by their number, which is the index of the partition entry in the partition map. Most of the commands will change the index numbers of all partitions after the affected partition. You are advised to print the table as frequently as necessary. The c (create new partition) command is the only one with complicated arguments. The first argument is the base address (in blocks) of the partition. Besides a raw number, you can also specify a partition number followed by the letter 'p' to indicate that the first block of the new partition should be the same as the first block of that existing free space partition. The second argument is the length of the parti- tion in blocks. This can be a raw number or can be a partition number followed by the letter 'p' to use the size of that partition or can be a number followed by 'k', 'm', or 'g' to indicate the size in kilobytes, megabytes, or gigabytes respectively. (These are powers of 1024, of course, not powers of 1000.) The third argument is the name of the partition. This can be a single word without quotes, or a string sur- rounded by single or double quotes. The type of the created partition will be Apple_UNIX_SVR2, which is the correct type for use with NetBSD. This command will prompt for the unix filesystem slice to set in the Block Zero Block bits. The C command is similar to the c command, with the addition of a partition type argument after the other arguments. Choosing a type of Apple_UNIX_SVR2 will prompt for the unix filesystem slice to set in the Block Zero Block bits. The i (initalize) command prompts for the size of the device. The n (name) command allows the name of a partition to be changed. Note that the various "Apple_Driver" partitions depend on the name field for proper functioning. We are not aware of any other partition types with this limitation. The r (reorder) command allows the index number of partitions to be changed. The index numbers are constrained to be a contiguous sequence. The t (change partition type) command allows the type of a partition to be changed. Changing the type to Apple_UNIX_SVR2 will prompt for the unix filesystem slice to set in the Block Zero Block bits. The w (write) command writes the partition map out. In order to use the new partition map you must reboot. SEE ALSO
fdisk(8), newfs(8) HISTORY
The pdisk utility was originally developed for MkLinux. AUTHORS
Eryk Vershen BUGS
Some people believe there should really be just one disk partitioning utility. Filesystem volume names are out of place in a partition utility. This utility supports HFS volume names, but not volume names of any other filesystem types. The --logical option has not been heavily tested. pdisk will first try to use lseek(2) with SEEK_END to compute the size of the device. If this fails, it will try a binary search using lseek(2) and read(2) to find the end of the device. This has been observed to fail on some raw disk devices. As a workaround, try using the block device instead. pdisk should probably read the disklabel using the DIOCGDINFO ioctl(2) to get the device size instead. BSD
April 24, 2003 BSD
All times are GMT -4. The time now is 11:52 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy