UNIX and HDFS - file systems on same partition.


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users UNIX and HDFS - file systems on same partition.
# 1  
Old 04-24-2016
UNIX and HDFS - file systems on same partition.

I am learning Hadoop. As a part of that, Hdfs - Hadoop distributed file system has commands similar to unix where we can create,copy,move files from unix/linux file system to HDFS.
My question is
1) how two file systems (unix and hdfs) can coexist on thr same partition..
2)What if block used by one FS is overwritten/ modified by another FS.
3) Who does this block handling mechanism inorder to avoid unwanted results.
4) what happens to inodes(unix) pointing to data blocks being used/blocked by HDFS.
Please explain what happens at atomic level when mutiple file systems coexists on same partition.
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To get latest hdfs file system

Hi All, I am having below hdfs file system /user/home/dte=2019_01_30/part_1 /user/home/dte=2019_01_30/part_2 /user/home/dte=2019_01_31/part_1 I need to take the latest month hdfs folder while passing date as parameter. For eg . if i pass as Feb month i.e. 20190201(YYYYMMDD), then... (0 Replies)
Discussion started by: Master_Mind
0 Replies

2. Shell Programming and Scripting

Read CSV file and delete hdfs, hive and hbase tables

I have a CSV file with hdfs directories, hive tables and hbase tables. 1. first column - hdfs directories 2. second column - hive tables 3. third column - hbase tables I have to check the csv file and look for the first column and delete the hdfs directory from the hdfs path, now... (2 Replies)
Discussion started by: shivamayam
2 Replies

3. UNIX for Beginners Questions & Answers

UNIX and HDFS - file systems on same partition.

I am learning Hadoop. As a part of that, Hdfs - Hadoop distributed file system has commands similar to unix where we can create,copy,move files from unix/linux file system to HDFS. My question is 1) how two file systems (unix and hdfs) can coexist on thr same partition.. 2)What if block... (1 Reply)
Discussion started by: Narendra Eliset
1 Replies

4. Shell Programming and Scripting

Need help how to copy few records from hdfs to UNIX

Hi All , I am facing one issue here...I have a huge file in hadoop file system.Some disk space issues are thr ,thatswhy I want to copy 1st 100 records from hdfs to local unix.I tried below command but it is no working .Its giving error like cat: Unable to write to output stream.if any one can... (2 Replies)
Discussion started by: STCET22
2 Replies

5. Shell Programming and Scripting

Downloading hdfs file to local UNIX through UNIX script

Hi All , I am very new to unix script.I am aware of unix commands but never put together in unix script level.If any one can suggest me technical guidance in the below scenario that will highly beneficial. Data have been already migrated from mainframe to Hadoop file system(HDFS).HDFS server... (15 Replies)
Discussion started by: STCET22
15 Replies

6. UNIX for Dummies Questions & Answers

Monitoring Unix systems

I am looking for a commercial tool that will give me -UNIX Monitoring performance solution+ reports on CCV format. (as perfmon on windows machines). The tool must have following counters per PROCESS: Page Faults/sec Virtual Bytes % Processor Time Handles count Threads count... (19 Replies)
Discussion started by: gen4ik
19 Replies

7. UNIX for Dummies Questions & Answers

file systems for unix

please someone give me 3 file systems for unix HP-UX version !!! thnks (2 Replies)
Discussion started by: androc
2 Replies

8. SCO

Sharing unix drives from two unix systems

I have two SCO openserver systems, 1 in the US and 1 in the UK. I am setting up a vpn to connect the two local networks that also have windows pc's on them. Is there a way that either unix system can see the hard drive on the other unix system so that I can share data between them. I run a cobol... (1 Reply)
Discussion started by: rongrout
1 Replies
Login or Register to Ask a Question
HFS(1)                                                        General Commands Manual                                                       HFS(1)

NAME
hfs - shell for manipulating HFS volumes SYNOPSIS
hfs [hfs-path [partition-no]] DESCRIPTION
hfs is an interactive command-oriented tool for manipulating HFS volumes. hfs is based on the Tcl interpreter, so basic Tcl constructs can be used in addition to the following commands: mount path [partition-no] The specified UNIX path is opened as an HFS volume. If a partition number n is specified and the volume source is located on a par- titioned medium, the nth discovered HFS partition will be mounted. The default partition-no is 1. umount [path] The volume previously mounted from the specified path (or the current volume, if none specified) is unmounted. vol path The volume previously mounted from the specified path is made current. info General information about the currently mounted volume is displayed. This information is also displayed automatically when the vol- ume is mounted. pwd The full path to the current working HFS directory is displayed. cd [hfs-path] The current working directory is changed to the given HFS path. If no path is given, the working directory is changed to the root of the volume. dir [hfs-path] A directory listing of the specified HFS directory is displayed. If no path is given, the contents of the current working directory are shown. mkdir hfs-path A new, empty directory is created with the specified path. rmdir hfs-path The specified directory is removed. It must be empty. create hfs-path [type [creator]] An empty file is created with the specified path. The Macintosh type and creator may be specified, or they will default to TEXT and UNIX, respectively. del hfs-path Both forks of the specified file are deleted. stat hfs-path Status information about the specified HFS path-identified entity is displayed. cat hfs-path The data fork of the specified HFS file is displayed. copyin unix-path [hfs-path [mode]] The specified UNIX file is copied to the named HFS destination path. Unless specified otherwise, the file will be copied into the current HFS working directory using a heuristically chosen mode. The mode may be one of: macb (MacBinary II), binh (BinHex), text, or raw. copyout hfs-path [unix-path [mode]] The specified HFS file is copied into the named UNIX destination path. Unless specified otherwise, the file will be copied into the current UNIX working directory using a heuristically chosen mode. The modes are the same as for copyin. format path [partition-no [volume-name]] The specified UNIX path is initialized as an empty HFS volume with the given name, and this volume is subsequently mounted. The default volume name is Untitled. The shell is scriptable, however it should be understood that the above commands are actually implemented by Tcl procedures prefixed with the character "h", e.g. hmount, hcd, etc., in order to avoid name collisions with other Tcl utilities. The "h" may be omitted in interac- tive use for convenience. SEE ALSO
hfsutils(1), xhfs(1) BUGS
cat can only display the data fork of a file. Text translations are performed unconditionally on the output. Furthermore, binary data can- not be handled properly from within Tcl scripts since the character with value 0 cannot be represented in Tcl strings. Use copyout to copy files without these limitations. AUTHOR
Robert Leslie <rob@mars.org> HFSUTILS 15-Jan-1997 HFS(1)