Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

How to read and Split a file?

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to read and Split a file?
# 22  
Old 01-29-2014
I am with Don here...

There is no way of knowing at any one point in time for any *.csv file that your last
split will always be 33. It surely must be the remainder.

There is the situation that you only have a few lines total and less than either 100 and/or
1000 also with the possibility of 0 remaining lines.

If however this is purely a one off then the command line is highly interactive and makes
it possible to do it manually.
This User Gave Thanks to wisecracker For This Post:
azherkn3
# 23  
Old 02-03-2014
Hi guys,

I have a requirement where i need to split a .csv file into multiple files.
Say for example i have data.csv file and i have splitted that into multiple files based on some conditions i.e first file should have 100, last file 50 and other files 1000 each. Am passing the values in command line arguments say ./samp.sh 100 50 1000..
I need to check the following conditions in which i got stuck

1) If the file has 1000 records in it will not split further
2) Any file greater than 1000 records will be split

how to achieve this, pls guide me through
Last edited by azherkn3; 02-03-2014 at 10:06 AM..
# 24  
Old 02-03-2014
That request will work only for files having exactly (n * 1000) + 150 records. Are you sure you can guarantee that condition? And, what if the file has 999 records?
# 25  
Old 02-03-2014
Quote:
Originally Posted by RudiC
That request will work only for files having exactly (n * 1000) + 150 records. Are you sure you can guarantee that condition? And, what if the file has 999 records?
Hi Rudi,
These questions have been asked before in this thread. The original poster hasn't supplied an answer yet even though this thread has been open for a week. The number of lines to be stored in the first, last, and other files keeps changing; but there is no explanation of why the last file shouldn't just contain what is left over after putting one requested number of lines in one file and splitting the remainder into another requested number of lines chunks.
# 26  
Old 02-03-2014
Hi Don,

thanks for pointing out. I asked as his last post was as vague as the others. And, in his other thread, I asked for the broad picture.
# 27  
Old 02-03-2014
@azherkn3.

Please:
  • Answer the questions put forward by various posters in this thread.
  • Comment on why the solutions given in this thread are not working for you.
  • Be very specific about what you want
  • Do not keep repeating what you wrote earlier.

Post a clear answer this time, or this thread will need to be closed.
This User Gave Thanks to Scrutinizer For This Post:
clx
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Read Table in file and split

HELLO I need your help please , i need to read a file that contain a table like : Name | Status ------------------ DB 1 | UP DB 2 | UP DB 3 | DOWN DB 4 | UP DB 5 | UP the objective to read each line and check if DB is UP or Down and give me the name of Down database.... (10 Replies)
Discussion started by: Abdellah
10 Replies

2. Shell Programming and Scripting

Read from file and split varialble

Hello Experts, Can anybody assist me in writing a code to do the following: I have a file present in the same directory from where this cod would run. The content of the file would be as below: Config Filename: config_details.txt Format: Server_prefix,IP_of_server,username, password,... (1 Reply)
Discussion started by: chetanojha
1 Replies

3. Shell Programming and Scripting

Read a File line by line and split into array word by word

Hi All, Hope you guys had a wonderful weekend I have a scenario where in which I have to read a file line by line and check for few words before redirecting to a file I have searched the forum but,either those answers dint work (perhaps because of my wrong under standing of how IFS... (6 Replies)
Discussion started by: Kingcobra
6 Replies

4. Shell Programming and Scripting

Read from file and execute the read command

Hi, I am facing issues with the below: I have a lookup file say lookup.lkp.This lookup.lkp file contains strings delimited by comma(,). Now i want to read this command from file and execute it. So my code below is : Contents in the lookup.lkp file is : c_e,m,a,`cd $BOX | ls cef_*|tail... (7 Replies)
Discussion started by: vital_parsley
7 Replies

5. Shell Programming and Scripting

Split File by Pattern with File Names in Source File... Awk?

Hi all, I'm pretty new to Shell scripting and I need some help to split a source text file into multiple files. The source has a row with pattern where the file needs to be split, and the pattern row also contains the file name of the destination for that specific piece. Here is an example: ... (2 Replies)
Discussion started by: cul8er
2 Replies

6. UNIX for Dummies Questions & Answers

When reading a csv file, counter to read 20 lines and wait for minute then read next 20 till end

Hello All, i am a newbie and need some help when reading a csv file in a bourne shell script. I want to read 10 lines, then wait for a minute and then do a reading of another 10 lines and so on in the same way. I want to do this till the end of file. Any inputs are appreciated ... (3 Replies)
Discussion started by: victor.s
3 Replies

7. UNIX for Dummies Questions & Answers

Writing awk script to read csv files and split them

Hi Here is my script that calls my awk script #!/bin/bash set -x dir="/var/local/dsx/csv" testfile="$testfile" while getopts " f: " option do case $option in f ) testfile="$OPTARG";; esac; done ./scriptFile --testfile=$testfile >> $dir/$testfile.csv It calls my awk... (1 Reply)
Discussion started by: ladyAnne
1 Replies

8. Shell Programming and Scripting

PHP read large string & split in multidimensional arrays & assign fieldnames & write into MYSQL

Hi, I hope the title does not scare people to look into this thread but it describes roughly what I'm trying to do. I need a solution in PHP. I'm a programming beginner, so it might be that the approach to solve this, might be easier to solve with an other approach of someone else, so if you... (0 Replies)
Discussion started by: lowmaster
0 Replies

9. Programming

Cannot read a file with read(fd, buffer, buffersize) function

# include <stdio.h> # include <fcntl.h> # include <stdlib.h> # include <sys/stat.h> int main(int argc, char *argv) { int fRead, fPadded, padVal; int btRead; int BUFFSIZE = 512; char buff; if (argc != 4) { printf ("Please provide all of the... (3 Replies)
Discussion started by: naranja18she
3 Replies

10. UNIX for Dummies Questions & Answers

Split a file with no pattern -- Split, Csplit, Awk

I have gone through all the threads in the forum and tested out different things. I am trying to split a 3GB file into multiple files. Some files are even larger than this. For example: split -l 3000000 filename.txt This is very slow and it splits the file with 3 million records in each... (10 Replies)
Discussion started by: madhunk
10 Replies
Login or Register to Ask a Question