Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

Split files using Csplit

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Split files using Csplit
# 8  
Old 12-01-2007
Hi.

If your Excel file is in native format, another possibility is to look at:
binp/xls2tsv - filter Excel worksheets into tab-separated text at Steve Kinzler - Home Directory -- then using a split or csplit to slice up your file.

It may require that a few perl modules from CPAN are available on your system, so if you are not comfortable installing those, then this is not a useful idea.

If your problem is a transfer limitation (e.g. some limit of the ftp server with which you are working), then standard split will split at a specific number of bytes. A brief look at fsplit suggests that it will work as well, and is described as working with a binary file, which I interpret as any file, because it uses dd, and dd is does not look at line structures. (Do not confuse that fsplit with a similarly-named fsplit which parses Fortran modules.)

Best wishes ... cheers, drl
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Automate splitting of files , scp files as each split completes and combine files on target server

i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies

2. UNIX for Beginners Questions & Answers

Split and Rename Split Files

Hello, I need to split a file by number of records and rename each split file with actual filename pre-pended with 3 digit split number. What I have tried is the below command with 2 digit numeric value split -l 3 -d abc.txt F (# Will Produce split Files as F00 F01 F02) How to produce... (19 Replies)
Discussion started by: techedipro
19 Replies

3. Shell Programming and Scripting

split file by delimiter with csplit

Hello, I want to split a big file into smaller ones with certain "counts". I am aware this type of job has been asked quite often, but I posted again when I came to csplit, which may be simpler to solve the problem. Input file (fasta format): >seq1 agtcagtc agtcagtc ag >seq2 agtcagtcagtc... (8 Replies)
Discussion started by: yifangt
8 Replies

4. UNIX for Dummies Questions & Answers

csplit to stdout

I want to split big files based on a pattern to stdout. Although csplit works well for me splitting the output into separate files (e.g. xx00, xx01, xx02, ...), the following is not working as expected: <code> # assuming pattern occurs less than 100 times csplit bigfile '%pattern%'... (2 Replies)
Discussion started by: uiop44
2 Replies

5. Shell Programming and Scripting

CSPLIT help

I have a file with contents <wmqi> sdf sdf sdffghghhjjfh </wmqi> <wmqi> gh dfg hhjhj sdfsdf g </wmqi> <wmqi> dfgdf fg dfgfg </wmqi> <wmqi> (6 Replies)
Discussion started by: Shivdatta
6 Replies

6. Shell Programming and Scripting

csplit issue

Hello all The below command works perfeft when executed from the shell prompt. "csplit -f first Allocation.log.1 "%. Oct 02 .%" {1} " and generates first00 file. But it fails if I include the same command in my script. I am trying to automate some process and this is turning... (1 Reply)
Discussion started by: uandme2k2
1 Replies

7. UNIX for Dummies Questions & Answers

naming files that csplit creates

Hi, This is my first time on this forum.. I searched the previous answers, but didn't find the answer I was looking for at first glance. csplit works beautifully for me, except for one thing. My file looks like this: ad|name1|asdf...(several pages)..asdf ... ad|name2|asdf...(several... (8 Replies)
Discussion started by: juliette salexa
8 Replies

8. Shell Programming and Scripting

Problem with csplit

Hi All, I have a strange behaviour from csplit command on some text files. I have a comma separated file and data with in double quotes. This file is being generated from Sequential stage of Data stage tool. This file has 67 fields in each records with some null and blank in the data.... (4 Replies)
Discussion started by: shreekrishnagd
4 Replies

9. UNIX for Dummies Questions & Answers

Split a file with no pattern -- Split, Csplit, Awk

I have gone through all the threads in the forum and tested out different things. I am trying to split a 3GB file into multiple files. Some files are even larger than this. For example: split -l 3000000 filename.txt This is very slow and it splits the file with 3 million records in each... (10 Replies)
Discussion started by: madhunk
10 Replies

10. UNIX for Advanced & Expert Users

csplit not behaving

I have a large file with the first 2 characters of each line determining the type of record. type 03 being a subheader and then it will have multiple 04 records. eg: 03,xxx,xxxx,xxxx 04,xxxxxxxxxxxxxxxxxxxxxxxxxxxx 04,xxxxxxxxxxxxxxxxxxxxxxxxxxxx 03,xxx,xxx,xxx ... (2 Replies)
Discussion started by: badg3r
2 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

spreadsheet::xlsx::utility2007

Spreadsheet::XLSX::Utility2007(3pm)			User Contributed Perl Documentation		       Spreadsheet::XLSX::Utility2007(3pm)

NAME

       Spreadsheet::XLSX::Utility2007 - Utility function for Spreadsheet::XLSX

SYNOPSIS

	   use strict;
	   #Declare
	   use Spreadsheet::XLSX::Utility qw(ExcelFmt ExcelLocaltime LocaltimeExcel);

	   #Convert localtime ->Excel Time
	   my $iBirth = LocaltimeExcel(11, 10, 12, 23, 2, 64);
				      # = 1964-3-23 12:10:11
	   print $iBirth, "
";       # 23459.5070717593

	   #Convert Excel Time -> localtime
	   my @aBirth = ExcelLocaltime($iBirth, undef);
	   print join(":", @aBirth), "
";   # 11:10:12:23:2:64:1:0

	   #Formatting
	   print ExcelFmt('yyyy-mm-dd', $iBirth), "
"; #1964-3-23
	   print ExcelFmt('m-d-yy', $iBirth), "
";	# 3-23-64
	   print ExcelFmt('#,##0', $iBirth), "
";	# 23,460
	   print ExcelFmt('#,##0.00', $iBirth), "
";	# 23,459.51
	   print ExcelFmt('"My Birthday is (m/d):" m/d', $iBirth), "
";
					     # My Birthday is (m/d): 3/23

DESCRIPTION

       Spreadsheet::XLSX::Utility exports utility functions concerned with Excel format setting.

       ExcelFmt is used by Spreadsheet::XLSX::Fmt2007.pm which is used by Spreadsheet::XLSX.

Functions
       This module can export 3 functions: ExcelFmt, ExcelLocaltime and LocaltimeExcel.

   ExcelFmt
       $sTxt = ExcelFmt($sFmt, $iData [, $i1904]);

       $sFmt is a format string for Excel. $iData is the target value.	If $flg1904 is true, this functions assumes that epoch is 1904.  $sTxt is
       the result.

       For more detail and examples, please refer sample/chkFmt.pl in this distribution.

       ex.

   ExcelLocaltime
       ($iSec, $iMin, $iHour, $iDay, $iMon, $iYear, $iwDay, $iMSec) =
		   ExcelLocaltime($iExTime [, $flg1904]);

       ExcelLocaltime converts time information in Excel format into Perl localtime format.  $iExTime is a time of Excel. If $flg1904 is true,
       this functions assumes that epoch is 1904.  $iSec, $iMin, $iHour, $iDay, $iMon, $iYear, $iwDay are same as localtime.  $iMSec means
       1/1,000,000 seconds(ms).

   LocaltimeExcel
       $iExTime = LocaltimeExcel($iSec, $iMin, $iHour, $iDay, $iMon, $iYear [,$iMSec] [,$flg1904])

       LocaltimeExcel converts time information in Perl localtime format into Excel format .  $iSec, $iMin, $iHour, $iDay, $iMon, $iYear are same
       as localtime.

       If $flg1904 is true, this functions assumes that epoch is 1904.	$iExTime is a time of Excel.

   col2int
       $iInt = col2int($sCol);

       converts a excel row letter into an int for use in an array

       This function was contributed by Kevin Mulholland.

   int2col
       $sCol = int2col($iRow);

       convert a column number into column letters NOET: This is quite a brute force coarse method does not manage values over 701 (ZZ)

       This function was contributed by Kevin Mulholland.

   sheetRef
       ($iRow, $iCol) = sheetRef($sStr);

       convert an excel letter-number address into a useful array address NOTE: That also Excel uses X-Y notation, we normally use Y-X in arrays
       $sStr, excel coord (eg. A2).

       This function was contributed by Kevin Mulholland.

   xls2csv
       $sCsvTxt = xls2csv($sFileName, $sRegion, $iRotate);

       convert a chunk of an excel file into csv text chunk $sRegions = "sheet-colrow:colrow" (ex. '1-A1:B2' means 'A1:B2' for sheet 1) $iRotate
       = 0 or 1 (output should be rotated or not)

       This function was contributed by Kevin Mulholland.

AUTHOR

       Rob Polocz rob.polocz@trackvia.com based on work by for Spreadsheet::ParseExcel by Kawai Takanori (Hippo2000) used with permission

SEE ALSO

       Spreadsheet::ParseExcel, Spreadsheet::WriteExcel

COPYRIGHT

       This module is part of the Spreadsheet::XLSX distribution.

perl v5.10.1							    2010-05-16				       Spreadsheet::XLSX::Utility2007(3pm)