Sponsored Content
Top Forums Shell Programming and Scripting Break one long string into multiple fixed length lines Post 302951249 by bubbawuzhere on Tuesday 4th of August 2015 10:11:05 AM
Old 08-04-2015
Code Break one long string into multiple fixed length lines

This is actually a KSH under Unix System Services (Z/OS), but hoping I can get a standard AIX/KSH solution to work...

I have a very large, single line file in Windows, that we download via FTP, with the "SITE WRAP" option, into a Z/OS file with an LRECL of 200. This essentially breaks the single long line down into multiple 200 byte records.

We are converting from FTP, to (OPENSSH) SFTP, which unfortunately does not include the "SITE WRAP" ability. Therefore, I'm attempting to come up with another means of accomplishing the task.

I have downloaded the file to USS, and have written a simple script to read in the record and split it out into multiple, 200 byte records, and write those out to a new file...

Code:
#!/bin/ksh                             
echo 'Starting break..'                
rm -f /homesh/ljamoo/SEQMAST2          
CPOS=1                                 
echo 'Loop..'                          
while read TLINE                       
 do                                    
 NLINE=`expr substr $TLINE $CPOS 200`  
 echo $NLINE >> /homesh/ljamoo/SEQMAST2
 CPOS=`expr $CPOS + 200`               
 done </homesh/ljamoo/SEQMAST          
echo 'Done.'                           
exit

However, this is not working as USS is apparently unable to read in the entire record into the TLINE variable...

Code:
Starting break..                                                                
Loop..                                                                          
read: /homesh/ljamoo/scripts/break.sh 6: FSUM9225 no memory: EDC5132I Not enough memory.
/homesh/ljamoo/scripts/break.sh 11: FSUM9225 no memory: EDC5132I Not enough memory.
/homesh/ljamoo/scripts/break.sh 11: FSUM9225 no memory: EDC5132I Not enough memory.
/homesh/ljamoo/scripts/break.sh 11: FSUM9225 no memory: EDC5132I Not enough memory.
....

So, does anyone have any suggestions on how else to break it down? Being a mainframe dinosaur, I have yet to wrap my head around the "sed" and "awk" commands, but hoping maybe there is something like that, which would accomplish this.

Thanks!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

creating a fixed length output from a variable length input

Is there a command that sets a variable length? I have a input of a variable length field but my output for that field needs to be set to 32 char. Is there such a command? I am on a sun box running ksh Thanks (2 Replies)
Discussion started by: r1500
2 Replies

2. Shell Programming and Scripting

How to print string on screen according the fixed length?

Problem: entry_name="joke:hello:yellow:blue:default" print("%d %-12s\t%-10s\t%-5s\n", $i, $entry_name....); I just want to print the output like this index entry value .... 1 joke:hello:y 0 123 567 ellow:blue:d ... (1 Reply)
Discussion started by: a2156z
1 Replies

3. UNIX for Dummies Questions & Answers

What the command to find out the record length of a fixed length file?

I want to find out the record length of a fixed length file? I forgot the command. Any body know? (9 Replies)
Discussion started by: tranq01
9 Replies

4. Shell Programming and Scripting

Awk to Break lines to multiple lines.

Input File: nawk -F "|" '{ for(i=1;i<=NF;i++) { if (i == 2) {gsub(",","#",$i);z=split($i,a,"")} else if (i == 3) {gsub(",","#",$i);z=split($i,b,"")} } if(z > 0) for(i=1;i<=z;i++) print $1,a,"Test"; if(w > 0) for(j=1;j<=w;j++) ... (1 Reply)
Discussion started by: pinnacle
1 Replies

5. Shell Programming and Scripting

Finding multiple column values and match in a fixed length file

Hi, I have a fixed length file where I need to verify the values of 3 different fields, where each field will have a different value. How can I do that in a single step. (6 Replies)
Discussion started by: naveen_sangam
6 Replies

6. Shell Programming and Scripting

Concatenating fixed length lines in shell script

I have a peculiar file with record format like given below. Each line is wrapped to next lines after certain number of characters. I want to concatenate all wrapped lines into 1. Input:(wrapped after 10 columns) This is li ne1 This is li ne2 and this line is too lo ng Shortline ... (8 Replies)
Discussion started by: kmanyam
8 Replies

7. Shell Programming and Scripting

Split a fixed length file bases on last occurence of string

Hi, I need to split a file based on last occurece of a string. PFB the explanation I have a file in following format aaaaaaaaaaaaaaaaaaaaaaaaaaa bbbbbbbbbbbbbbbbbbbbbbbbbbb ccccccccccccccccccccccccccc ddddddddddddddddddddddddddd 3186rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr... (4 Replies)
Discussion started by: Neelkanth
4 Replies

8. Shell Programming and Scripting

Deleting lines in a fixed length file where there is a word at specific location

I have a big file having 100 K lines. I have to read each line and see at 356 character position whethere there is a word "W" in it. If it is their then don't delete the line otherwise delete it. There are two lines as one Header and one trailer which should remain same. Can somebody... (5 Replies)
Discussion started by: mohit kanoongo
5 Replies

9. Shell Programming and Scripting

Break line content into multiple lines using delimiter

I need to break the line after every 3rd semi colon(;) using Unix shell scripting Input.txt ABC;DEF;JHY;LKU;QWE;BVF;RGHY; Output.txt ABC;DEF;JHY; LKU;QWE;BVF; RGHY; (1 Reply)
Discussion started by: meet_calramz
1 Replies

10. Shell Programming and Scripting

Convert variable length record to fixed length

Hi Team, I have an issue to split the file which is having special chracter(German Char) using awk command. I have a different length records in a file. I am separating the files based on the length using awk command. The command is working fine if the record is not having any... (7 Replies)
Discussion started by: Anthuvan
7 Replies
CURLOPT_MAXFILESIZE(3)					     curl_easy_setopt options					    CURLOPT_MAXFILESIZE(3)

NAME
CURLOPT_MAXFILESIZE - maximum file size allowed to download SYNOPSIS
#include <curl/curl.h> CURLcode curl_easy_setopt(CURL *handle, CURLOPT_MAXFILESIZE, long size); DESCRIPTION
Pass a long as parameter. This allows you to specify the maximum size (in bytes) of a file to download. If the file requested is found larger than this value, the transfer will not start and CURLE_FILESIZE_EXCEEDED will be returned. The file size is not always known prior to download, and for such files this option has no effect even if the file transfer ends up being larger than this given limit. This concerns both FTP and HTTP transfers. If you want a limit above 2GB, use CURLOPT_MAXFILESIZE_LARGE(3). DEFAULT
None PROTOCOLS
FTP and HTTP EXAMPLE
TODO AVAILABILITY
Always RETURN VALUE
Returns CURLE_OK SEE ALSO
CURLOPT_MAXFILESIZE_LARGE(3), CURLOPT_MAX_RECV_SPEED_LARGE(3), libcurl 7.54.0 February 03, 2016 CURLOPT_MAXFILESIZE(3)
All times are GMT -4. The time now is 08:45 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy