Filesystem(3) Tcl Library Procedures Filesystem(3) _________________________________________________________________________________________________ NAME Tcl_FSRegister, Tcl_FSUnregister, Tcl_FSData, Tcl_FSMountsChanged, Tcl_FSGetFileSystemFor- Path, Tcl_FSGetPathType, Tcl_FSCopyFile, Tcl_FSCopyDirectory, Tcl_FSCreateDirectory, Tcl_FSDeleteFile, Tcl_FSRemoveDirectory, Tcl_FSRenameFile, Tcl_FSListVolumes, Tcl_FSEval- File, Tcl_FSLoadFile, Tcl_FSMatchInDirectory, Tcl_FSLink, Tcl_FSLstat, Tcl_FSUtime, Tcl_FSFileAttrsGet, Tcl_FSFileAttrsSet, Tcl_FSFileAttrStrings, Tcl_FSStat, Tcl_FSAccess, Tcl_FSOpenFileChannel, Tcl_FSGetCwd, Tcl_FSChdir, Tcl_FSPathSeparator, Tcl_FSJoinPath, Tcl_FSSplitPath, Tcl_FSEqualPaths, Tcl_FSGetNormalizedPath, Tcl_FSJoinToPath, Tcl_FSCon- vertToPathType, Tcl_FSGetInternalRep, Tcl_FSGetTranslatedPath, Tcl_FSGetTranslatedString- Path, Tcl_FSNewNativePath, Tcl_FSGetNativePath, Tcl_FSFileSystemInfo, Tcl_AllocStatBuf - procedures to interact with any filesystem SYNOPSIS #include <tcl.h> int Tcl_FSRegister(clientData, fsPtr) int Tcl_FSUnregister(fsPtr) ClientData Tcl_FSData(fsPtr) void Tcl_FSMountsChanged(fsPtr) Tcl_Filesystem* Tcl_FSGetFileSystemForPath(pathObjPtr) Tcl_PathType Tcl_FSGetPathType(pathObjPtr) int Tcl_FSCopyFile(srcPathPtr, destPathPtr) int Tcl_FSCopyDirectory(srcPathPtr, destPathPtr, errorPtr) int Tcl_FSCreateDirectory(pathPtr) int Tcl_FSDeleteFile(pathPtr) int Tcl_FSRemoveDirectory(pathPtr, int recursive, errorPtr) int Tcl_FSRenameFile(srcPathPtr, destPathPtr) Tcl_Obj* Tcl_FSListVolumes(void) int Tcl_FSEvalFile(interp, pathPtr) int Tcl_FSLoadFile(interp, pathPtr, sym1, sym2, proc1Ptr, proc2Ptr, handlePtr, unloadProcPtr) int Tcl_FSMatchInDirectory(interp, result, pathPtr, pattern, types) Tcl_Obj* Tcl_FSLink(linkNamePtr, toPtr, linkAction) int Tcl_FSLstat(pathPtr, statPtr) int Tcl_FSUtime(pathPtr, tval) int Tcl_FSFileAttrsGet(interp, int index, pathPtr, objPtrRef) int Tcl_FSFileAttrsSet(interp, int index, pathPtr, Tcl_Obj *objPtr) CONST char** Tcl_FSFileAttrStrings(pathPtr, objPtrRef) int Tcl_FSStat(pathPtr, statPtr) int Tcl_FSAccess(pathPtr, mode) Tcl_Channel Tcl_FSOpenFileChannel(interp, pathPtr, modeString, permissions) Tcl_Obj* Tcl_FSGetCwd(interp) int Tcl_FSChdir(pathPtr) Tcl_Obj* Tcl_FSPathSeparator(pathPtr) Tcl_Obj* Tcl_FSJoinPath(listObj, elements) Tcl_Obj* Tcl_FSSplitPath(pathPtr, lenPtr) int Tcl_FSEqualPaths(firstPtr, secondPtr) Tcl_Obj* Tcl_FSGetNormalizedPath(interp, pathPtr) Tcl_Obj* Tcl_FSJoinToPath(basePtr, objc, objv) int Tcl_FSConvertToPathType(interp, pathPtr) ClientData Tcl_FSGetInternalRep(pathPtr, fsPtr) Tcl_Obj* Tcl_FSGetTranslatedPath(interp, pathPtr) CONST char* Tcl_FSGetTranslatedStringPath(interp, pathPtr) Tcl_Obj* Tcl_FSNewNativePath(fsPtr, clientData) CONST char* Tcl_FSGetNativePath(pathPtr) Tcl_Obj* Tcl_FSFileSystemInfo(pathPtr) Tcl_StatBuf* Tcl_AllocStatBuf() ARGUMENTS Tcl_Filesystem *fsPtr (in) Points to a structure containing the addresses of pro- cedures that can be called to perform the various filesystem operations. Tcl_Obj *pathPtr (in) The path represented by this object is used for the operation in question. If the object does not already have an internal path representation, it will be con- verted to have one. Tcl_Obj *srcPathPtr(in) As for pathPtr, but used for the source file for a copy or rename operation. Tcl_Obj *destPathPtr(in) As for pathPtr, but used for the destination filename for a copy or rename operation. CONST char *pattern (in) Only files or directories matching this pattern will be returned by Tcl_FSMatchInDirectory. GlobTypeData *types (in) Only files or directories matching the type descrip- tions contained in this structure will be returned by Tcl_FSMatchInDirectory. It is very important that the 'directory' flag is properly handled. This parameter may be NULL. Tcl_Interp *interp (in) Interpreter to use either for results, evaluation, or reporting error messages. ClientData clientData(in) The native description of the path object to create. Tcl_Obj *firstPtr(in) The first of two path objects to compare. The object may be converted to path type. Tcl_Obj *secondPtr(in) The second of two path objects to compare. The object may be converted to path type. Tcl_Obj *listObj (in) The list of path elements to operate on with a join operation. int elements (in) If non-negative, the number of elements in the listObj which should be joined together. If negative, then all elements are joined. Tcl_Obj **errorPtr(out) In the case of an error, filled with an object con- taining the name of the file which caused an error in the various copy/rename operations. Tcl_Obj **objPtrRef(out) Filled with an object containing the result of the operation. Tcl_Obj *result (out) Pre-allocated object in which to store (by lappending) the list of files or directories which are success- fully matched in Tcl_FSMatchInDirectory. int mode (in) Mask consisting of one or more of R_OK, W_OK, X_OK and F_OK. R_OK, W_OK and X_OK request checking whether the file exists and has read, write and execute permissions, respectively. F_OK just requests check- ing for the existence of the file. Tcl_StatBuf *statPtr (out) The structure that contains the result of a stat or lstat operation. CONST char *sym1 (in) Name of a procedure to look up in the file's symbol table CONST char *sym2 (in) Name of a procedure to look up in the file's symbol table Tcl_PackageInitProc **proc1Ptr(out) Filled with the init function for this code. Tcl_PackageInitProc **proc2Ptr(out) Filled with the safe-init function for this code. ClientData *clientDataPtr(out) Filled with the clientData value to pass to this code's unload function when it is called. TclfsUnloadFileProc_ **unloadProcPtr(out) Filled with the function to use to unload this piece of code. utimbuf *tval (in) The access and modification times in this structure are read and used to set those values for a given file. CONST char *modeString(in) Specifies how the file is to be accessed. May have any of the values allowed for the mode argument to the Tcl open command. int permissions(in) POSIX-style permission flags such as 0644. If a new file is created, these permissions will be set on the created file. int *lenPtr (out) If non-NULL, filled with the number of elements in the split path. Tcl_Obj *basePtr (in) The base path on to which to join the given elements. May be NULL. int objc (in) The number of elements in objv. Tcl_Obj *CONST objv[] (in) The elements to join to the given base path. _________________________________________________________________ DESCRIPTION There are several reasons for calling the Tcl_FS... functions rather than calling system level functions like access and stat directly. First, they will work cross-platform, so an extension which calls them should work unmodified on Unix, MacOS and Windows. Second, the Windows implementation of some of these functions fixes some bugs in the system level calls. Third, these function calls deal with any 'Utf to platform-native' path conver- sions which may be required (and may cache the results of such conversions for greater efficiency on subsequent calls). Fourth, and perhaps most importantly, all of these func- tions are 'virtual filesystem aware'. Any virtual filesystem which has been registered (through Tcl_FSRegister) may reroute file access to alternative media or access methods. This means that all of these functions (and therefore the corresponding file, glob, pwd, cd, open, etc. Tcl commands) may be operate on 'files' which are not native files in the native filesystem. This also means that any Tcl extension which accesses the filesystem through this API is automatically 'virtual filesystem aware'. Of course, if an extension accesses the native filesystem directly (through platform-specific APIs, for example), then Tcl cannot intercept such calls. If appropriate vfs's have been registered, the 'files' may, to give two examples, be remote (e.g. situated on a remote ftp server) or archived (e.g. lying inside a .zip ar- chive). Such registered filesystems provide a lookup table of functions to implement all or some of the functionality listed here. Finally, the Tcl_FSStat and Tcl_FSLstat calls abstract away from what the 'struct stat' buffer buffer is actually declared to be, allow- ing the same code to be used both on systems with and systems without support for files larger than 2GB in size. The Tcl_FS... are objectified and may cache internal representations and other path- related strings (e.g. the current working directory). One side-effect of this is that one must not pass in objects with a refCount of zero to any of these functions. If such calls were handled, they might result in memory leaks (under some circumstances, the filesystem code may wish to retain a reference to the passed in object, and so one must not assume that after any of these calls return, the object still has a refCount of zero - it may have been incremented), or in a direct segfault due to the object being freed part way through the complex object manipulation required to ensure that the path is fully normal- ized and absolute for filesystem determination. The practical lesson to learn from this is that Tcl_Obj *path = Tcl_NewStringObj(...) ; Tcl_FS...(path) ; Tcl_DecrRefCount(path) is wrong, and may segfault. The 'path' must have its refCount incremented before passing it in, or decrementing it. For this reason, objects with a refCount of zero are consid- ered not to be valid filesystem paths and calling any Tcl_FS API with such an object will result in no action being taken. Tcl_FSCopyFile attempts to copy the file given by srcPathPtr to the path name given by destPathPtr. If the two paths given lie in the same filesystem (according to Tcl_FSGet- FileSystemForPath) then that filesystem's 'copy file' function is called (if it is non- NULL). Otherwise the function returns -1 and sets Tcl's errno to the 'EXDEV' posix error code (which signifies a 'cross-domain link'). Tcl_FSCopyDirectory attempts to copy the directory given by srcPathPtr to the path name given by destPathPtr. If the two paths given lie in the same filesystem (according to Tcl_FSGetFileSystemForPath) then that filesystem's 'copy file' function is called (if it is non-NULL). Otherwise the function returns -1 and sets Tcl's errno to the 'EXDEV' posix error code (which signifies a 'cross-domain link'). Tcl_FSCreateDirectory attempts to create the directory given by pathPtr by calling the owning filesystem's 'create directory' function. Tcl_FSDeleteFile attempts to delete the file given by pathPtr by calling the owning filesystem's 'delete file' function. Tcl_FSRemoveDirectory attempts to remove the directory given by pathPtr by calling the owning filesystem's 'remove directory' function. Tcl_FSRenameFile attempts to rename the file or directory given by srcPathPtr to the path name given by destPathPtr. If the two paths given lie in the same filesystem (according to Tcl_FSGetFileSystemForPath) then that filesystem's 'rename file' function is called (if it is non-NULL). Otherwise the function returns -1 and sets Tcl's errno to the 'EXDEV' posix error code (which signifies a ``cross-domain link''). Tcl_FSListVolumes calls each filesystem which has a non-NULL 'list volumes' function and asks them to return their list of root volumes. It accumulates the return values in a list which is returned to the caller (with a refCount of 0). Tcl_FSEvalFile reads the file given by pathPtr and evaluates its contents as a Tcl script. It returns the same information as Tcl_EvalObjEx. If the file couldn't be read then a Tcl error is returned to describe why the file couldn't be read. The eofchar for files is '\32' (^Z) for all platforms. If you require a ``^Z'' in code for string comparison, you can use ``\032'' or ``\u001a'', which will be safely substituted by the Tcl interpreter into ``^Z''. Tcl_FSLoadFile dynamically loads a binary code file into memory and returns the addresses of two procedures within that file, if they are defined. The appropriate function for the filesystem to which pathPtr belongs will be called. If that filesystem does not implement this function (most virtual filesystems will not, because of OS limitations in dynamically loading binary code), Tcl will attempt to copy the file to a temporary directory and load that temporary file. Returns a standard Tcl completion code. If an error occurs, an error message is left in the interp's result. Tcl_FSMatchInDirectory is used by the globbing code to search a directory for all files which match a given pattern. The appropriate function for the filesystem to which pathPtr belongs will be called. The return value is a standard Tcl result indicating whether an error occurred in glob- bing. Error messages are placed in interp, but good results are placed in the resultPtr given. Note that the 'glob' code implements recursive patterns internally, so this function will only ever be passed simple patterns, which can be matched using the logic of 'string match'. To handle recursion, Tcl will call this function frequently ask- ing only for directories to be returned. Tcl_FSLink replaces the library version of readlink(), and extends it to support the cre- ation of links. The appropriate function for the filesystem to which linkNamePtr belongs will be called. If the toPtr is NULL, a readlink action is performed. The result is a Tcl_Obj specifying the contents of the symbolic link given by linkNamePtr, or NULL if the link could not be read. The result is owned by the caller, which should call Tcl_DecrRefCount when the result is no longer needed. If the toPtr is not NULL, Tcl should create a link of one of the types passed in in the linkAction flag. This flag is an or'd combination of TCL_CRE- ATE_SYMBOLIC_LINK and TCL_CREATE_HARD_LINK. Where a choice exists (i.e. more than one flag is passed in), the Tcl convention is to prefer symbolic links. When a link is suc- cessfully created, the return value should be toPtr (which is therefore already owned by the caller). If unsuccessful, NULL should be returned. Tcl_FSLstat fills the stat structure statPtr with information about the specified file. You do not need any access rights to the file to get this information but you need search rights to all directories named in the path leading to the file. The stat structure includes info regarding device, inode (always 0 on Windows), privilege mode, nlink (always 1 on Windows), user id (always 0 on Windows), group id (always 0 on Windows), rdev (same as device on Windows), size, last access time, last modification time, and creation time. If path exists, Tcl_FSLstat returns 0 and the stat structure is filled with data. Other- wise, -1 is returned, and no stat info is given. Tcl_FSUtime replaces the library version of utime. For results see 'utime' documentation. If successful, the function will update the 'atime' and 'mtime' values of the file given. Tcl_FSFileAttrsGet implements read access for the hookable 'file attributes' subcommand. The appropriate function for the filesystem to which pathPtr belongs will be called. If the result is TCL_OK, then an object was placed in objPtrRef, which will only be tempo- rarily valid (unless Tcl_IncrRefCount is called). Tcl_FSFileAttrsSet implements write access for the hookable 'file attributes' subcommand. The appropriate function for the filesystem to which pathPtr belongs will be called. Tcl_FSFileAttrStrings implements part of the hookable 'file attributes' subcommand. The appropriate function for the filesystem to which pathPtr belongs will be called. The called procedure may either return an array of strings, or may instead return NULL and place a Tcl list into the given objPtrRef. Tcl will take that list and first increment its refCount before using it. On completion of that use, Tcl will decrement its refCount. Hence if the list should be disposed of by Tcl when done, it should have a refCount of zero, and if the list should not be disposed of, the filesystem should ensure it retains a refCount on the object. Tcl_FSAccess checks whether the process would be allowed to read, write or test for exis- tence of the file (or other file system object) whose name is pathname. If pathname is a symbolic link on Unix, then permissions of the file referred by this symbolic link are tested. On success (all requested permissions granted), zero is returned. On error (at least one bit in mode asked for a permission that is denied, or some other error occurred), -1 is returned. Tcl_FSStat fills the stat structure statPtr with information about the specified file. You do not need any access rights to the file to get this information but you need search rights to all directories named in the path leading to the file. The stat structure includes info regarding device, inode (always 0 on Windows), privilege mode, nlink (always 1 on Windows), user id (always 0 on Windows), group id (always 0 on Windows), rdev (same as device on Windows), size, last access time, last modification time, and creation time. If path exists, Tcl_FSStat returns 0 and the stat structure is filled with data. Other- wise, -1 is returned, and no stat info is given. Tcl_FSOpenFileChannel opens a file specified by pathPtr and returns a channel handle that can be used to perform input and output on the file. This API is modeled after the fopen procedure of the Unix standard I/O library. The syntax and meaning of all arguments is similar to those given in the Tcl open command when opening a file. If an error occurs while opening the channel, Tcl_FSOpenFileChannel returns NULL and records a POSIX error code that can be retrieved with Tcl_GetErrno. In addition, if interp is non-NULL, Tcl_FSOpenFileChannel leaves an error message in interp's result after any error. The newly created channel is not registered in the supplied interpreter; to register it, use Tcl_RegisterChannel, described below. If one of the standard channels, stdin, stdout or stderr was previously closed, the act of creating the new channel also assigns it as a replacement for the standard channel. Tcl_FSGetCwd replaces the library version of getcwd(). It returns the Tcl library's current working directory. This may be different to the native platform's working directory, in the case for which the cwd is not in the native filesystem. The result is a pointer to a Tcl_Obj specifying the current directory, or NULL if the cur- rent directory could not be determined. If NULL is returned, an error message is left in the interp's result. The result already has its refCount incremented for the caller. When it is no longer needed, that refCount should be decremented. This is needed for thread-safety purposes, to allow multiple threads to access this and related functions, while ensuring the results are always valid. Tcl_FSChdir replaces the library version of chdir(). The path is normalized and then passed to the filesystem which claims it. If that filesystem does not implement this function, Tcl will fallback to a combination of stat and access to check whether the directory exists and has appropriate permissions. For results, see chdir() documentation. If successful, we keep a record of the successful path in cwdPathPtr for subsequent calls to getcwd. Tcl_FSPathSeparator returns the separator character to be used for most specific element of the path specified by pathPtr (i.e. the last part of the path). The separator is returned as a Tcl_Obj containing a string of length 1. If the path is invalid, NULL is returned. Tcl_FSJoinPath takes the given Tcl_Obj, which should be a valid list, and returns the path object given by considering the first 'elements' elements as valid path segments. If ele- ments < 0, we use the entire list. Returns object with refCount of zero, containing the joined path. Tcl_FSSplitPath takes the given Tcl_Obj, which should be a valid path, and returns a Tcl List object containing each segment of that path as an element. Returns list object with refCount of zero. If the passed in lenPtr is non-NULL, we use it to return the number of elements in the returned list. Tcl_FSEqualPaths tests whether the two paths given represent the same filesystem object It returns 1 if the paths are equal, and 0 if they are different. If either path is NULL, 0 is always returned. Tcl_FSGetNormalizedPath this important function attempts to extract from the given Tcl_Obj a unique normalized path representation, whose string value can be used as a unique iden- tifier for the file. It returns the normalized path object, with refCount of zero, or NULL if the path was invalid or could otherwise not be successfully converted. Extraction of absolute, normal- ized paths is very efficient (because the filesystem operates on these representations internally), although the result when the filesystem contains numerous symbolic links may not be the most user-friendly version of a path. Tcl_FSJoinToPath takes the given object, which should usually be a valid path or NULL, and joins onto it the array of paths segments given. Returns object with refCount of zero, containing the joined path. Tcl_FSConvertToPathType tries to convert the given Tcl_Obj to a valid Tcl path type, tak- ing account of the fact that the cwd may have changed even if this object is already sup- posedly of the correct type. The filename may begin with "~" (to indicate current user's home directory) or "~<user>" (to indicate any user's home directory). If the conversion succeeds (i.e. the object is a valid path in one of the current filesys- tems), then TCL_OK is returned. Otherwise TCL_ERROR is returned, and an error message may be left in the interpreter. Tcl_FSGetInternalRep extracts the internal representation of a given path object, in the given filesystem. If the path object belongs to a different filesystem, we return NULL. If the internal representation is currently NULL, we attempt to generate it, by calling the filesystem's Tcl_FSCreateInternalRepProc. Returns NULL or a valid internal path representation. This internal representation is cached, so that repeated calls to this function will not require additional conversions. Tcl_FSGetTranslatedPath attempts to extract the translated path from the given Tcl_Obj. If the translation succeeds (i.e. the object is a valid path), then it is returned. Oth- erwise NULL will be returned, and an error message may be left in the interpreter. A "translated" path is one which contains no "~" or "~user" sequences (these have been expanded to their current representation in the filesystem). Tcl_FSGetTranslatedStringPath does the same as Tcl_FSGetTranslatedPath, but returns a character string or NULL. Tcl_FSNewNativePath performs something like that reverse of the usual obj->path->nativerep conversions. If some code retrieves a path in native form (from, e.g. readlink or a native dialog), and that path is to be used at the Tcl level, then calling this function is an efficient way of creating the appropriate path object type. The resulting object is a pure 'path' object, which will only receive a Utf-8 string rep- resentation if that is required by some Tcl code. Tcl_FSGetNativePath is for use by the Win/Unix/MacOS native filesystems, so that they can easily retrieve the native (char* or TCHAR*) representation of a path. This function is a convenience wrapper around Tcl_FSGetInternalRep, and assumes the native representation is string-based. It may be desirable in the future to have non-string-based native represen- tations (for example, on MacOS, a representation using a fileSpec of FSRef structure would probably be more efficient). On Windows a full Unicode representation would allow for paths of unlimited length. Currently the representation is simply a character string con- taining the complete, absolute path in the native encoding. The native representation is cached so that repeated calls to this function will not require additional conversions. Tcl_FSFileSystemInfo returns a list of two elements. The first element is the name of the filesystem (e.g. "native" or "vfs" or "zip" or "prowrap", perhaps), and the second is the particular type of the given path within that filesystem (which is filesystem dependent). The second element may be empty if the filesystem does not provide a further categoriza- tion of files. A valid list object is returned, unless the path object is not recognized, when NULL will be returned. Tcl_FSGetFileSystemForPath returns the a pointer to the Tcl_Filesystem which accepts this path as valid. If no filesystem will accept the path, NULL is returned. Tcl_FSGetPathType determines whether the given path is relative to the current directory, relative to the current volume, or absolute. It returns one of TCL_PATH_ABSOLUTE, TCL_PATH_RELATIVE, or TCL_PATH_VOLUME_RELATIVE Tcl_AllocStatBuf allocates a Tcl_StatBuf on the system heap (which may be deallocated by being passed to ckfree.) This allows extensions to invoke Tcl_FSStat and Tcl_FSLStat without being dependent on the size of the buffer. That in turn depends on the flags used to build Tcl. TCL_FILESYSTEM A filesystem provides a Tcl_Filesystem structure that contains pointers to functions that implement the various operations on a filesystem; these operations are invoked as needed by the generic layer, which generally occurs through the functions listed above. The Tcl_Filesystem structures are manipulated using the following methods. Tcl_FSRegister takes a pointer to a filesystem structure and an optional piece of data to associated with that filesystem. On calling this function, Tcl will attach the filesystem to the list of known filesystems, and it will become fully functional immediately. Tcl does not check if the same filesystem is registered multiple times (and in general that is not a good thing to do). TCL_OK will be returned. Tcl_FSUnregister removes the given filesystem structure from the list of known filesys- tems, if it is known, and returns TCL_OK. If the filesystem is not currently registered, TCL_ERROR is returned. Tcl_FSData will return the ClientData associated with the given filesystem, if that filesystem is registered. Otherwise it will return NULL. Tcl_FSMountsChanged is used to inform the Tcl's core that the set of mount points for the given (already registered) filesystem have changed, and that cached file representations may therefore no longer be correct. The Tcl_Filesystem structure contains the following fields: typedef struct Tcl_Filesystem { CONST char *typeName; int structureLength; Tcl_FSVersion version; Tcl_FSPathInFilesystemProc *pathInFilesystemProc; Tcl_FSDupInternalRepProc *dupInternalRepProc; Tcl_FSFreeInternalRepProc *freeInternalRepProc; Tcl_FSInternalToNormalizedProc *internalToNormalizedProc; Tcl_FSCreateInternalRepProc *createInternalRepProc; Tcl_FSNormalizePathProc *normalizePathProc; Tcl_FSFilesystemPathTypeProc *filesystemPathTypeProc; Tcl_FSFilesystemSeparatorProc *filesystemSeparatorProc; Tcl_FSStatProc *statProc; Tcl_FSAccessProc *accessProc; Tcl_FSOpenFileChannelProc *openFileChannelProc; Tcl_FSMatchInDirectoryProc *matchInDirectoryProc; Tcl_FSUtimeProc *utimeProc; Tcl_FSLinkProc *linkProc; Tcl_FSListVolumesProc *listVolumesProc; Tcl_FSFileAttrStringsProc *fileAttrStringsProc; Tcl_FSFileAttrsGetProc *fileAttrsGetProc; Tcl_FSFileAttrsSetProc *fileAttrsSetProc; Tcl_FSCreateDirectoryProc *createDirectoryProc; Tcl_FSRemoveDirectoryProc *removeDirectoryProc; Tcl_FSDeleteFileProc *deleteFileProc; Tcl_FSCopyFileProc *copyFileProc; Tcl_FSRenameFileProc *renameFileProc; Tcl_FSCopyDirectoryProc *copyDirectoryProc; Tcl_FSLstatProc *lstatProc; Tcl_FSLoadFileProc *loadFileProc; Tcl_FSGetCwdProc *getCwdProc; Tcl_FSChdirProc *chdirProc; } Tcl_Filesystem; Except for the first three fields in this structure which contain simple data elements, all entries contain addresses of functions called by the generic filesystem layer to per- form the complete range of filesystem related actions. The many functions in this structure are broken down into three categories: infrastructure functions (almost all of which must be implemented), operational functions (which must be implemented if a complete filesystem is provided), and efficiency functions (which need only be implemented if they can be done so efficiently, or if they have side-effects which are required by the filesystem; Tcl has less efficient emulations it can fall back on). It is important to note that, in the current version of Tcl, most of these fallbacks are only used to handle commands initiated in Tcl, not in C. What this means is, that if a 'file rename' command is issued in Tcl, and the relevant filesystem(s) do not implement their Tcl_FSRenameFileProc, Tcl's core will instead fallback on a combination of other filesystem functions (it will use Tcl_FSCopyFileProc followed by Tcl_FSDeleteFileProc, and if Tcl_FSCopyFileProc is not implemented there is a further fallback). However, if a Tcl_FSRenameFile command is issued at the C level, no such fallbacks occur. This is true except for the last four entries in the filesystem table (lstat, load, getcwd and chdir) for which fallbacks do in fact occur at the C level. As an example, here is the filesystem lookup table used by the "vfs" extension which allows filesystem actions to be implemented in Tcl. static Tcl_Filesystem vfsFilesystem = { "tclvfs", sizeof(Tcl_Filesystem), TCL_FILESYSTEM_VERSION_1, &VfsPathInFilesystem, &VfsDupInternalRep, &VfsFreeInternalRep, /* No internal to normalized, since we don't create any * pure 'internal' Tcl_Obj path representations */ NULL, /* No create native rep function, since we don't use it * and don't choose to support uses of 'Tcl_FSNewNativePath' */ NULL, /* Normalize path isn't needed - we assume paths only have * one representation */ NULL, &VfsFilesystemPathType, &VfsFilesystemSeparator, &VfsStat, &VfsAccess, &VfsOpenFileChannel, &VfsMatchInDirectory, &VfsUtime, /* We choose not to support symbolic links inside our vfs's */ NULL, &VfsListVolumes, &VfsFileAttrStrings, &VfsFileAttrsGet, &VfsFileAttrsSet, &VfsCreateDirectory, &VfsRemoveDirectory, &VfsDeleteFile, /* No copy file - fallback will occur at Tcl level */ NULL, /* No rename file - fallback will occur at Tcl level */ NULL, /* No copy directory - fallback will occur at Tcl level */ NULL, /* Core will use stat for lstat */ NULL, /* No load - fallback on core implementation */ NULL, /* We don't need a getcwd or chdir - fallback on Tcl's versions */ NULL, NULL }; Any functions which take path names in Tcl_Obj form take those names in UTF-8 form. The filesystem infrastructure API is designed to support efficient, cached conversion of these UTF-8 paths to other native representations. TYPENAME The typeName field contains a null-terminated string that identifies the type of the filesystem implemented, e.g. native or zip or vfs. STRUCTURE LENGTH The structureLength field is generally implemented as sizeof(Tcl_Filesystem), and is there to allow easier binary backwards compatibility if the size of the structure changes in a future Tcl release. VERSION The version field should be set to TCL_FILESYSTEM_VERSION_1. FILESYSTEM INFRASTRUCTURE These fields contain addresses of functions which are used to associate a particular filesystem with a file path, and deal with the internal handling of path representations, for example copying and freeing such representations. PATHINFILESYSTEMPROC The pathInFilesystemProc field contains the address of a function which is called to determine whether a given path object belongs to this filesystem or not. Tcl will only call the rest of the filesystem functions with a path for which this function has returned TCL_OK. If the path does not belong, -1 should be returned (the behaviour of Tcl for any other return value is not defined). If TCL_OK is returned, then the optional clientDat- aPtr output parameter can be used to return an internal (filesystem specific) representa- tion of the path, which will be cached inside the path object, and may be retrieved effi- ciently by the other filesystem functions. Tcl will simultaneously cache the fact that this path belongs to this filesystem. Such caches are invalidated when filesystem struc- tures are added or removed from Tcl's internal list of known filesystems. typedef int Tcl_FSPathInFilesystemProc( Tcl_Obj *pathPtr, ClientData *clientDataPtr); DUPINTERNALREPPROC This function makes a copy of a path's internal representation, and is called when Tcl needs to duplicate a path object. If NULL, Tcl will simply not copy the internal repre- sentation, which may then need to be regenerated later. typedef ClientData Tcl_FSDupInternalRepProc( ClientData clientData); FREEINTERNALREPPROC Free the internal representation. This must be implemented if internal representations need freeing (i.e. if some memory is allocated when an internal representation is gener- ated), but may otherwise be NULL. typedef void Tcl_FSFreeInternalRepProc( ClientData clientData); INTERNALTONORMALIZEDPROC Function to convert internal representation to a normalized path. Only required if the filesystem creates pure path objects with no string/path representation. The return value is a Tcl object whose string representation is the normalized path. typedef Tcl_Obj* Tcl_FSInternalToNormalizedProc( ClientData clientData); CREATEINTERNALREPPROC Function to take a path object, and calculate an internal representation for it, and store that native representation in the object. May be NULL if paths have no internal represen- tation, or if the Tcl_FSPathInFilesystemProc for this filesystem always immediately cre- ates an internal representation for paths it accepts. typedef ClientData Tcl_FSCreateInternalRepProc( Tcl_Obj *pathPtr); NORMALIZEPATHPROC Function to normalize a path. Should be implemented for all filesystems which can have multiple string representations for the same path object. In Tcl, every 'path' must have a single unique 'normalized' string representation. Depending on the filesystem, there may be more than one unnormalized string representation which refers to that path (e.g. a relative path, a path with different character case if the filesystem is case insensitive, a path contain a reference to a home directory such as '~', a path containing symbolic links, etc). If the very last component in the path is a symbolic link, it should not be converted into the object it points to (but its case or other aspects should be made unique). All other path components should be converted from symbolic links. This one exception is required to agree with Tcl's semantics with 'file delete', 'file rename', 'file copy' operating on symbolic links. This function may be called with 'nextCheck- point' either at the beginning of the path (i.e. zero), at the end of the path, or at any intermediate file separator in the path. It will never point to any other arbitrary posi- tion in the path. In the last of the three valid cases, the implementation can assume that the path up to and including the file separator is known and normalized. typedef int Tcl_FSNormalizePathProc( Tcl_Interp *interp, Tcl_Obj *pathPtr, int nextCheckpoint); FILESYSTEM OPERATIONS The fields in this section of the structure contain addresses of functions which are called to carry out the basic filesystem operations. A filesystem which expects to be used with the complete standard Tcl command set must implement all of these. If some of them are not implemented, then certain Tcl commands may fail when operating on paths within that filesystem. However, in some instances this may be desirable (for example, a read-only filesystem should not implement the last four functions, and a filesystem which does not support symbolic links need not implement the readlink function, etc. The Tcl core expects filesystems to behave in this way). FILESYSTEMPATHTYPEPROC Function to determine the type of a path in this filesystem. May be NULL, in which case no type information will be available to users of the filesystem. The 'type' is used only for informational purposes, and should be returned as the string representation of the Tcl_Obj which is returned. A typical return value might be "networked", "zip" or "ftp". The Tcl_Obj result is owned by the filesystem and so Tcl will increment the refCount of that object if it wishes to retain a reference to it. typedef Tcl_Obj* Tcl_FSFilesystemPathTypeProc( Tcl_Obj *pathPtr); FILESYSTEMSEPARATORPROC Function to return the separator character(s) for this filesystem. Must be implemented, otherwise the file separator command will not function correctly. The usual return value will be a Tcl_Obj containing the string "/". typedef Tcl_Obj* Tcl_FSFilesystemSeparatorProc( Tcl_Obj *pathPtr); STATPROC Function to process a Tcl_FSStat() call. Must be implemented for any reasonable filesys- tem, since many Tcl level commands depend crucially upon it (e.g. file atime, file isdi- rectory, file size, glob). typedef int Tcl_FSStatProc( Tcl_Obj *pathPtr, Tcl_StatBuf *statPtr); The Tcl_FSStatProc fills the stat structure statPtr with information about the specified file. You do not need any access rights to the file to get this information but you need search rights to all directories named in the path leading to the file. The stat struc- ture includes info regarding device, inode (always 0 on Windows), privilege mode, nlink (always 1 on Windows), user id (always 0 on Windows), group id (always 0 on Windows), rdev (same as device on Windows), size, last access time, last modification time, and creation time. If the file represented by pathPtr exists, the Tcl_FSStatProc returns 0 and the stat structure is filled with data. Otherwise, -1 is returned, and no stat info is given. ACCESSPROC Function to process a Tcl_FSAccess() call. Must be implemented for any reasonable filesystem, since many Tcl level commands depend crucially upon it (e.g. file exists, file readable). typedef int Tcl_FSAccessProc( Tcl_Obj *pathPtr, int mode); The Tcl_FSAccessProc checks whether the process would be allowed to read, write or test for existence of the file (or other file system object) whose name is pathname. If path- name is a symbolic link, then permissions of the file referred by this symbolic link should be tested. On success (all requested permissions granted), zero is returned. On error (at least one bit in mode asked for a permission that is denied, or some other error occurred), -1 is returned. OPENFILECHANNELPROC Function to process a Tcl_FSOpenFileChannel() call. Must be implemented for any reason- able filesystem, since any operations which require open or accessing a file's contents will use it (e.g. open, encoding, and many Tk commands). typedef Tcl_Channel Tcl_FSOpenFileChannelProc( Tcl_Interp *interp, Tcl_Obj *pathPtr, int mode, int permissions); The Tcl_FSOpenFileChannelProc opens a file specified by pathPtr and returns a channel han- dle that can be used to perform input and output on the file. This API is modeled after the fopen procedure of the Unix standard I/O library. The syntax and meaning of all argu- ments is similar to those given in the Tcl open command when opening a file, where the mode argument is a combination of the POSIX flags O_RDONLY, O_WRONLY, etc. If an error occurs while opening the channel, the Tcl_FSOpenFileChannelProc returns NULL and records a POSIX error code that can be retrieved with Tcl_GetErrno. In addition, if interp is non- NULL, the Tcl_FSOpenFileChannelProc leaves an error message in interp's result after any error. The newly created channel is not registered in the supplied interpreter; to register it, use Tcl_RegisterChannel. If one of the standard channels, stdin, stdout or stderr was pre- viously closed, the act of creating the new channel also assigns it as a replacement for the standard channel. MATCHINDIRECTORYPROC Function to process a Tcl_FSMatchInDirectory() call. If not implemented, then glob and recursive copy functionality will be lacking in the filesystem (and this may impact com- mands like 'encoding names' which use glob functionality internally). typedef int Tcl_FSMatchInDirectoryProc( Tcl_Interp* interp, Tcl_Obj *result, Tcl_Obj *pathPtr, CONST char *pattern, Tcl_GlobTypeData * types); The function should return all files or directories (or other filesystem objects) which match the given pattern and accord with the types specification given. There are two ways in which this function may be called. If pattern is NULL, then pathPtr is a full path specification of a single file or directory which should be checked for existence and cor- rect type. Otherwise, pathPtr is a directory, the contents of which the function should search for files or directories which have the correct type. In either case, pathPtr can be assumed to be both non-NULL and non-empty. It is not currently documented whether pathPtr will have a file separator at its end of not, so code should be flexible to both possibilities. The return value is a standard Tcl result indicating whether an error occurred in the matching process. Error messages are placed in interp, but on a TCL_OK result, the inter- preter should not be modified, but rather results should be added to the result object given (which can be assumed to be a valid Tcl list). The matches added to result should include any path prefix given in pathPtr (this usually means they will be absolute path specifications). Note that if no matches are found, that simply leads to an empty result --- errors are only signaled for actual file or filesystem problems which may occur during the matching process. UTIMEPROC Function to process a Tcl_FSUtime() call. Required to allow setting (not reading) of times with 'file mtime', 'file atime' and the open-r/open-w/fcopy implementation of 'file copy'. typedef int Tcl_FSUtimeProc( Tcl_Obj *pathPtr, struct utimbuf *tval); The access and modification times of the file specified by pathPtr should be changed to the values given in the tval structure. The return value is a standard Tcl result indicating whether an error occurred in the process. LINKPROC Function to process a Tcl_FSLink() call. Should be implemented only if the filesystem supports links, and may otherwise be NULL. typedef Tcl_Obj* Tcl_FSLinkProc( Tcl_Obj *linkNamePtr, Tcl_Obj *toPtr, int linkAction); If toPtr is NULL, the function is being asked to read the contents of a link. The result is a Tcl_Obj specifying the contents of the link given by linkNamePtr, or NULL if the link could not be read. The result is owned by the caller, which should call Tcl_DecrRefCount when the result is no longer needed. If toPtr is not NULL, the function should attempt to create a link. The result in this case should be toPtr if the link was successful and NULL otherwise. In this case the result is not owned by the caller. See the documentation for Tcl_FSLink for the correct interpretation of the linkAction flags. LISTVOLUMESPROC Function to list any filesystem volumes added by this filesystem. Should be implemented only if the filesystem adds volumes at the head of the filesystem, so that they can be returned by 'file volumes'. typedef Tcl_Obj* Tcl_FSListVolumesProc(void); The result should be a list of volumes added by this filesystem, or NULL (or an empty list) if no volumes are provided. The result object is considered to be owned by the filesystem (not by Tcl's core), but should be given a refCount for Tcl. Tcl will use the contents of the list and then decrement that refCount. This allows filesystems to choose whether they actually want to retain a 'master list' of volumes or not (if not, they gen- erate the list on the fly and pass it to Tcl with a refCount of 1 and then forget about the list, if yes, then they simply increment the refCount of their master list and pass it to Tcl which will copy the contents and then decrement the count back to where it was). Therefore, Tcl considers return values from this proc to be read-only. FILEATTRSTRINGSPROC Function to list all attribute strings which are valid for this filesystem. If not imple- mented the filesystem will not support the file attributes command. This allows arbitrary additional information to be attached to files in the filesystem. If it is not imple- mented, there is no need to implement the get and set methods. typedef CONST char** Tcl_FSFileAttrStringsProc( Tcl_Obj *pathPtr, Tcl_Obj** objPtrRef); The called function may either return an array of strings, or may instead return NULL and place a Tcl list into the given objPtrRef. Tcl will take that list and first increment its refCount before using it. On completion of that use, Tcl will decrement its refCount. Hence if the list should be disposed of by Tcl when done, it should have a refCount of zero, and if the list should not be disposed of, the filesystem should ensure it retains a refCount on the object. FILEATTRSGETPROC Function to process a Tcl_FSFileAttrsGet() call, used by 'file attributes'. typedef int Tcl_FSFileAttrsGetProc( Tcl_Interp *interp, int index, Tcl_Obj *pathPtr, Tcl_Obj **objPtrRef); Returns a standard Tcl return code. The attribute value retrieved, which corresponds to the index'th element in the list returned by the Tcl_FSFileAttrStringsProc, is a Tcl_Obj placed in objPtrRef (if TCL_OK was returned) and is likely to have a refCount of zero. Either way we must either store it somewhere (e.g. the Tcl result), or Incr/Decr its ref- Count to ensure it is properly freed. FILEATTRSSETPROC Function to process a Tcl_FSFileAttrsSet() call, used by 'file attributes'. If the filesystem is read-only, there is no need to implement this. typedef int Tcl_FSFileAttrsSetProc( Tcl_Interp *interp, int index, Tcl_Obj *pathPtr, Tcl_Obj *objPtr); The attribute value of the index'th element in the list returned by the Tcl_FSFileAt- trStringsProc should be set to the objPtr given. CREATEDIRECTORYPROC Function to process a Tcl_FSCreateDirectory() call. Should be implemented unless the FS is read-only. typedef int Tcl_FSCreateDirectoryProc( Tcl_Obj *pathPtr); The return value is a standard Tcl result indicating whether an error occurred in the process. If successful, a new directory should have been added to the filesystem in the location specified by pathPtr. REMOVEDIRECTORYPROC Function to process a 'Tcl_FSRemoveDirectory()' call. Should be implemented unless the FS is read-only. typedef int Tcl_FSRemoveDirectoryProc( Tcl_Obj *pathPtr, int recursive, Tcl_Obj **errorPtr); The return value is a standard Tcl result indicating whether an error occurred in the process. If successful, the directory specified by pathPtr should have been removed from the filesystem. If the recursive flag is given, then a non-empty directory should be deleted without error. If an error does occur, the name of the file or directory which caused the error should be placed in errorPtr. DELETEFILEPROC Function to process a Tcl_FSDeleteFile() call. Should be implemented unless the FS is read-only. typedef int Tcl_FSDeleteFileProc( Tcl_Obj *pathPtr); The return value is a standard Tcl result indicating whether an error occurred in the process. If successful, the file specified by pathPtr should have been removed from the filesystem. Note that, if the filesystem supports symbolic links, Tcl will always call this function and not Tcl_FSRemoveDirectoryProc when needed to delete them (even if they are symbolic links to directories). FILESYSTEM EFFICIENCY LSTATPROC Function to process a Tcl_FSLstat() call. If not implemented, Tcl will attempt to use the statProc defined above instead. Therefore it need only be implemented if a filesystem can differentiate between stat and lstat calls. typedef int Tcl_FSLstatProc( Tcl_Obj *pathPtr, Tcl_StatBuf *statPtr); The behavior of this function is very similar to that of the Tcl_FSStatProc defined above, except that if it is applied to a symbolic link, it returns information about the link, not about the target file. COPYFILEPROC Function to process a Tcl_FSCopyFile() call. If not implemented Tcl will fall back on open-r, open-w and fcopy as a copying mechanism. Therefore it need only be implemented if the filesystem can perform that action more efficiently. typedef int Tcl_FSCopyFileProc( Tcl_Obj *srcPathPtr, Tcl_Obj *destPathPtr); The return value is a standard Tcl result indicating whether an error occurred in the copying process. Note that, destPathPtr is the name of the file which should become the copy of srcPathPtr. It is never the name of a directory into which srcPathPtr could be copied (i.e. the function is much simpler than the Tcl level 'file copy' subcommand). Note that, if the filesystem supports symbolic links, Tcl will always call this function and not Tcl_FSCopyDirectoryProc when needed to copy them (even if they are symbolic links to directories). RENAMEFILEPROC Function to process a Tcl_FSRenameFile() call. If not implemented, Tcl will fall back on a copy and delete mechanism. Therefore it need only be implemented if the filesystem can perform that action more efficiently. typedef int Tcl_FSRenameFileProc( Tcl_Obj *srcPathPtr, Tcl_Obj *destPathPtr); The return value is a standard Tcl result indicating whether an error occurred in the renaming process. COPYDIRECTORYPROC Function to process a Tcl_FSCopyDirectory() call. If not implemented, Tcl will fall back on a recursive create-dir, file copy mechanism. Therefore it need only be implemented if the filesystem can perform that action more efficiently. typedef int Tcl_FSCopyDirectoryProc( Tcl_Obj *srcPathPtr, Tcl_Obj *destPathPtr, Tcl_Obj **errorPtr); The return value is a standard Tcl result indicating whether an error occurred in the copying process. If an error does occur, the name of the file or directory which caused the error should be placed in errorPtr. Note that, destPathPtr is the name of the direc- tory-name which should become the mirror-image of srcPathPtr. It is not the name of a directory into which srcPathPtr should be copied (i.e. the function is much simpler than the Tcl level 'file copy' subcommand). LOADFILEPROC Function to process a Tcl_FSLoadFile() call. If not implemented, Tcl will fall back on a copy to native-temp followed by a Tcl_FSLoadFile on that temporary copy. Therefore it need only be implemented if the filesystem can load code directly, or it can be imple- mented simply to return TCL_ERROR to disable load functionality in this filesystem entirely. typedef int Tcl_FSLoadFileProc( Tcl_Interp * interp, Tcl_Obj *pathPtr, Tcl_LoadHandle * handlePtr, Tcl_FSUnloadFileProc * unloadProcPtr); Returns a standard Tcl completion code. If an error occurs, an error message is left in the interp's result. The function dynamically loads a binary code file into memory. On a successful load, the handlePtr should be filled with a token for the dynamically loaded file, and the unloadProcPtr should be filled in with the address of a procedure. The pro- cedure will be called with the given Tcl_LoadHandle as its only parameter when Tcl needs to unload the file. UNLOADFILEPROC Function to unload a previously successfully loaded file. If load was implemented, then this should also be implemented, if there is any cleanup action required. typedef void Tcl_FSUnloadFileProc( Tcl_LoadHandle loadHandle); GETCWDPROC Function to process a Tcl_FSGetCwd() call. Most filesystems need not implement this. It will usually only be called once, if 'getcwd' is called before 'chdir'. May be NULL. typedef Tcl_Obj* Tcl_FSGetCwdProc( Tcl_Interp *interp); If the filesystem supports a native notion of a current working directory (which might perhaps change independent of Tcl), this function should return that cwd as the result, or NULL if the current directory could not be determined (e.g. the user does not have appro- priate permissions on the cwd directory). If NULL is returned, an error message is left in the interp's result. CHDIRPROC Function to process a Tcl_FSChdir() call. If filesystems do not implement this, it will be emulated by a series of directory access checks. Otherwise, virtual filesystems which do implement it need only respond with a positive return result if the dirName is a valid, accessible directory in their filesystem. They need not remember the result, since that will be automatically remembered for use by GetCwd. Real filesystems should carry out the correct action (i.e. call the correct system 'chdir' api). typedef int Tcl_FSChdirProc( Tcl_Obj *pathPtr); The Tcl_FSChdirProc changes the applications current working directory to the value speci- fied in pathPtr. The function returns -1 on error or 0 on success. KEYWORDS stat access filesystem vfs Tcl 8.4 Filesystem(3)