Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: how to split a huge file by every 100 lines
Top Forums Shell Programming and Scripting how to split a huge file by every 100 lines Post 302550764 by tukuyomi on Saturday 27th of August 2011 03:56:19 AM
Old 08-27-2011
See -l option of the split command : Man Page for split (Linux Section 1) - The UNIX and Linux Forums
Then, after split is done, do something like (code not tested):
Code:
#!/bin/sh

i=0
#split default names split files as xaa, xab, xac, ..., hence the x* in the command below
for f in x*; do
 i=$((i+1))
 cat head.txt "$f" tail.txt > "q$i.xml"
done

exit 0

Last edited by tukuyomi; 08-27-2011 at 05:04 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split a huge line into multiple 120 characters lines with sed?

Hello , I'm trying to split a file which contains a single very long line. My aim is to split this single line each 120 characters. I tried with the sed command : `cat ${MYPATH}/${FILE}|sed -e :a -e 's/^.\{1,120\}$/&\n/;ta' >{MYPATH}/${DEST}` but when I wc -l the destination file it is... (2 Replies)
Discussion started by: jerome_1664
2 Replies

2. Shell Programming and Scripting

Delete lines from huge file

I have to delete 1st 7000 lines of a file which is 12GB large. As it is so large, i can't open in vi and delete these lines. Also I found one post here which gave solution using perl, but I don't have perl installed. Also some solutions were redirecting the o/p to a different file and renaming it.... (3 Replies)
Discussion started by: rahulrathod
3 Replies

3. UNIX for Dummies Questions & Answers

copy and paste certain many lines of huge file in linux

Dear All, I am working with windoes OS but remote a linux machine. I wonder the way to copy an paste some part of a huge file in linux machine. the contain of file like as follow: ... dump annealling all custom 10 anneal_*.dat id type x y z q timestep 0.02 run 200000 Memory... (2 Replies)
Discussion started by: ariesto
2 Replies

4. Shell Programming and Scripting

NAWK array to store lines from huge file

Hi, I would like to clarify about the NAWK array to store multiple lines from huge file. The file is having an unique REF.NO, I wants to store the lines (it may be 100+ lines) till I found the new REF.NO. How can I apply NAWK - arrays for the above? Rgds, sharif. (1 Reply)
Discussion started by: sharif
1 Replies

5. Shell Programming and Scripting

Help- counting delimiter in a huge file and split data into 2 files

I’m new to Linux script and not sure how to filter out bad records from huge flat files (over 1.3GB each). The delimiter is a semi colon “;” Here is the sample of 5 lines in the file: Name1;phone1;address1;city1;state1;zipcode1 Name2;phone2;address2;city2;state2;zipcode2;comment... (7 Replies)
Discussion started by: lv99
7 Replies

6. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Discussion started by: krishnix
16 Replies

7. UNIX for Dummies Questions & Answers

How to split a huge file into small pieces (per 2000 columns)?

Dear all, I have a big file:2879(rows)x400,170 (columns) like below. I 'd like to split the file into small pieces:2879(rows)x2000(columns) per file (the last small piece will be 2879x170. So far, I only know how to create one samll piece at one time. But actually I need to repeat this work... (6 Replies)
Discussion started by: forevertl
6 Replies

8. UNIX for Dummies Questions & Answers

Split a huge 7 GB File Based on Pattern into 4 files

Hi, I have a Huge 7 GB file which has around 1 million records, i want to split this file into 4 files to contain around 250k messages each. Please help me as Split command cannot work here as it might miss tags.. Format of the file is as below <!--###### ###### START-->... (6 Replies)
Discussion started by: KishM
6 Replies

9. UNIX for Advanced & Expert Users

How to split a large file with the first 100 lines of each condition?

I have a huge file with the following input: Case1 Specific_Info Specific_Info Case1 Specific_Info Specific_Info Case3 Specific_Info Specific_Info Case4 Specific_Info Specific_Info Case1 Specific_Info Specific_Info Case2 Specific_Info Specific_Info Case2 Specific_Info Specific_Info... (2 Replies)
Discussion started by: laurigo
2 Replies

10. Solaris

Split huge File System

Gents I have huge NAS File System as /sys with size 10 TB and I want to Split each 1TB in spirit File System to be mounted in the server. How to can I do that without changing anything in the source. Please your support. (1 Reply)
Discussion started by: AbuAliiiiiiiiii
1 Replies

LEARN ABOUT DEBIAN

verifier

verifier(1M)                                                Application Server Utility                                                verifier(1M)

NAME

       verifier - validates the J2EE Deployment Descriptors against application server DTDs

SYNOPSIS

       verifier [-v] [-d destination_directory] [-r [a|w|f]] jar_filename

       Use the verifier utility to validate the J2EE deployment descriptors and the Sun ONE Application Server specific deployment descriptors. If
       the application is not J2EE compliant, an error message is printed.

       When you run the verifier utility, two results files are created in XML and TXT format. The location where the files  are  created  can  be
       configured  using  the  -d  option.  The directory specified as the destination directory for result files should exist. If no directory is
       specified, the result files are created in the current directory. Result files are named as jar_filename_verified.xml and jar_filename_ver-
       ified.txt

       The  XML  file  has  various sections that are dynamically generated depending on what kind of application or module is being verified. The
       root tag is static-verification which may contain the tags application, ejb, web, appclient, connector, other, error and failure-count. The
       tags are self explanatory and are present depending on the type of module being verified. For example, an EAR file containing a web and EJB
       module will contain the tags application, ejb, web, other, and failure-count.

       If the verifier ran successfully, a result code of 0 is returned. A non-zero error code is returned if the verifier failed to run.

OPTIONS

       -v                       verbose debugging is turned on.

       -d                      identifies where the result files get placed.

       -r                      identifies the reporting level defined as one of the following:

                                 o  a sets output reporting level to display all results (default)

                                 o  w sets output reporting level to display warning and failure results

                                 o  f sets output reporting level to display only failure results

       jar_filename            name of the ear/war/jar file to perform static verification on. The results of verification are placed in two files
                               jar_filename_verified.xml and jar_filename_verified.txt in the destination directory.

       Example 1: Using verifier in the Verbose Mode

       example% verifier -v -d /verifier-results -rf sample.ear

       Where  -v  runs  the  verifier in verbose mode, -d specifies the destination directory, and -rf displays only the failures. The results are
       stored in /verifier-results/sample.ear_verified.xml and /verifier-results/sample.ear_verified.txt.

       asadmin(1M)

Sun Java System Application Server                                  March 2004                                                        verifier(1M)
All times are GMT -4. The time now is 07:12 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy