Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Split file using awk
Top Forums UNIX for Beginners Questions & Answers Split file using awk Post 303022127 by rosebud123 on Saturday 25th of August 2018 10:00:59 PM
Old 08-25-2018
Split file using awk
I need to split the incoming source file in to multiple files using awk.

Split position is (6,13) : 8 positions
  1. All the records that are greater than 20170101 and less than or equal to 20181231 should go in a split file with file name as source filename_greaterthan_20170101_lessthan_20181231 + yyyymmddhhmmss
  • All records that are less than 20170101 should go in a file with file name as source filename_lessthan_20170101 + yyyymmddhhmmss
  • All records that are greater than 20190101 should go in a file with file name as source filename_20190101 + yyyymmddhhmmss

Additionally instead of hard coding the condition in the script/command, can we pass it as a variable to the script , so the script remains dynamic.

Source File:

Code:
001  20991231
002  20190101
003  20231231
004  20231231
005  20261231
006  20271231
007  20281231
008  20301231
009  20161231
010  20161230
011  20161010
012  19880101
013  20000101
014  20110121
015  20130121
016  20170121
017  19870121

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split file using awk

I am trying to read a file and split the file into multiple files. I need to create new files with different set of lines from the original file. ie, the first output file may contain 10 lines and the second 100 lines and so on. The criteria is to get the lines between two lines starting with some... (8 Replies)
Discussion started by: pvar
8 Replies

2. UNIX for Dummies Questions & Answers

Split a file with no pattern -- Split, Csplit, Awk

I have gone through all the threads in the forum and tested out different things. I am trying to split a 3GB file into multiple files. Some files are even larger than this. For example: split -l 3000000 filename.txt This is very slow and it splits the file with 3 million records in each... (10 Replies)
Discussion started by: madhunk
10 Replies

3. Shell Programming and Scripting

split file with awk

I did a lot of search on this forum on spiting file; found a lot, but my requirement is a bit different, please guide. Master file: x:start:5 line1:23 line2:12 2:90 x:end:5 x:start:2 45:56 22:90 x:end:2 x:start:3 line1:23 line2:12 x:end:3 x:start:2 line5:23 (1 Reply)
Discussion started by: uwork72
1 Replies

4. Shell Programming and Scripting

awk - split file

How can I split a text file (in awk) in n others with number of record given in input? Thanks (6 Replies)
Discussion started by: pinguc
6 Replies

5. Shell Programming and Scripting

split a file using awk

Hi , I just need to split a file and outputfiles are redirected to gzip file need: Input file - A.gz content of A.gz is 100|sfdds|dffdds|200112|sdfdf 100|sfdds|dffdds|200112|sdfdf 100|sfdds|dffdds|200112|sdfdf 100|sfdds|dffdds|200212|sdfdf 100|sfdds|dffdds|200212|sdfdf... (3 Replies)
Discussion started by: mohan_xunil
3 Replies

6. Shell Programming and Scripting

How to split a file using AWK?

Hello, I have a file like the following: david,a,b,c,20,r thomas,a,b,c,30,r willaiam,a,b,c,80,r barbara,a,b,c,100,r I would like to split the file into other files using a condition for the contents of column 5. The condition should be a if the contents of column 5 is in a range... (4 Replies)
Discussion started by: keenboy100
4 Replies

7. Shell Programming and Scripting

AWK File Split

Hi All, Input.txt XYZONEABC　　　　　　　　　　　　　　　　　 CZXTWOJJJ KKKSIXOOO asdfhajlsdhfajs asdfasfasdf Output Files: ONE.txt XYZONEABC　　　　　　　　　　　　　　　　 TWO.txt CZXTWOJJJ SIX.txt KKKSIXOOO I had a script (2 Replies)
Discussion started by: kmsekhar
2 Replies

8. Shell Programming and Scripting

Split a file with awk

Hi! I have a file like this: a,b,c,12,d,e a,b,c,13,d,e a,b,c,14,d,e a,b,c,15,d,e a,b,c,16,d,e a,b,c,17,d,e I need to split that file in two: If field 4 is equal or higher than 14 that row goes to one file and if it is equal or higher than 15 to another. Can anyone point me in the... (2 Replies)
Discussion started by: Tr0cken
2 Replies

9. Shell Programming and Scripting

Split File by Pattern with File Names in Source File... Awk?

Hi all, I'm pretty new to Shell scripting and I need some help to split a source text file into multiple files. The source has a row with pattern where the file needs to be split, and the pattern row also contains the file name of the destination for that specific piece. Here is an example: ... (2 Replies)
Discussion started by: cul8er
2 Replies

10. Shell Programming and Scripting

awk file split

Hi all, First of all I' like to mention that I'm pretty new to unix scripting. :( I'm trying to split an large xml with awk and rename it based on the values of two attributes. Example XML <RECORD> <element1>11</element1> <element2>22</element2> <element3>33</element3>... (18 Replies)
Discussion started by: f0usk4s
18 Replies

LEARN ABOUT HPUX

ascii

ascii(5)							File Formats Manual							  ascii(5)

NAME

       ascii - map of ASCII character set

SYNOPSIS

DESCRIPTION

       The file provides a map of the ASCII character set, giving both octal and hexadecimal equivalents of each character.  The file contains the
       following text:

	      |000 nul|001 soh|002 stx|003 etx|004 eot|005 enq|006 ack|007 bel|
	      |010 bs |011 ht |012 nl |013 vt |014 np |015 cr |016 so |017 si |
	      |020 dle|021 dc1|022 dc2|023 dc3|024 dc4|025 nak|026 syn|027 etb|
	      |030 can|031 em |032 sub|033 esc|034 fs |035 gs |036 rs |037 us |
	      |040 sp |041  ! |042  " |043  # |044  $ |045  % |046  & |047  ' |
	      |050  ( |051  ) |052  * |053  + |054  , |055  - |056  . |057  / |
	      |060  0 |061  1 |062  2 |063  3 |064  4 |065  5 |066  6 |067  7 |
	      |070  8 |071  9 |072  : |073  ; |074  < |075  = |076  > |077  ? |
	      |100  @ |101  A |102  B |103  C |104  D |105  E |106  F |107  G |
	      |110  H |111  I |112  J |113  K |114  L |115  M |116  N |117  O |
	      |120  P |121  Q |122  R |123  S |124  T |125  U |126  V |127  W |
	      |130  X |131  Y |132  Z |133  [ |134   |135  ] |136  ^ |137  _ |
	      |140  ` |141  a |142  b |143  c |144  d |145  e |146  f |147  g |
	      |150  h |151  i |152  j |153  k |154  l |155  m |156  n |157  o |
	      |160  p |161  q |162  r |163  s |164  t |165  u |166  v |167  w |
	      |170  x |171  y |172  z |173  { |174  | |175  } |176  ~ |177 del|

	      | 00 nul| 01 soh| 02 stx| 03 etx| 04 eot| 05 enq| 06 ack| 07 bel|
	      | 08 bs | 09 ht | 0a nl | 0b vt | 0c np | 0d cr | 0e so | 0f si |
	      | 10 dle| 11 dc1| 12 dc2| 13 dc3| 14 dc4| 15 nak| 16 syn| 17 etb|
	      | 18 can| 19 em | 1a sub| 1b esc| 1c fs | 1d gs | 1e rs | 1f us |
	      | 20 sp | 21  ! | 22  " | 23  # | 24  $ | 25  % | 26  & | 27  ' |
	      | 28  ( | 29  ) | 2a  * | 2b  + | 2c  , | 2d  - | 2e  . | 2f  / |
	      | 30  0 | 31  1 | 32  2 | 33  3 | 34  4 | 35  5 | 36  6 | 37  7 |
	      | 38  8 | 39  9 | 3a  : | 3b  ; | 3c  < | 3d  = | 3e  > | 3f  ? |
	      | 40  @ | 41  A | 42  B | 43  C | 44  D | 45  E | 46  F | 47  G |
	      | 48  H | 49  I | 4a  J | 4b  K | 4c  L | 4d  M | 4e  N | 4f  O |
	      | 50  P | 51  Q | 52  R | 53  S | 54  T | 55  U | 56  V | 57  W |
	      | 58  X | 59  Y | 5a  Z | 5b  [ | 5c   | 5d  ] | 5e  ^ | 5f  _ |
	      | 60  ` | 61  a | 62  b | 63  c | 64  d | 65  e | 66  f | 67  g |
	      | 68  h | 69  i | 6a  j | 6b  k | 6c  l | 6d  m | 6e  n | 6f  o |
	      | 70  p | 71  q | 72  r | 73  s | 74  t | 75  u | 76  v | 77  w |
	      | 78  x | 79  y | 7a  z | 7b  { | 7c  | | 7d  } | 7e  ~ | 7f del|

   Control Characters
       The following table shows the set of ASCII control characters with their octal, decimal, and hexadecimal values.  To obtain the	respective
       characters from the keyboard, use the indicated keypress combinations.

       To place control characters in a file when using the or editor, type Ctrl-before typing the desired control character.

				      +----+-----+-----+---------+--------+------------------------+--------------+
				      |Oct | Dec | Hex | Display | Symbol |	  Char Name	   |   Keypress   |
				      +----+-----+-----+---------+--------+------------------------+--------------+
				      |000 | 000 | 00  |  none	 |  NUL   | Null		   | Ctrl-Shift-@ |
				      |001 | 001 | 01  |   ^A	 |  SOH   | Start of Header	   |	Ctrl-A	  |
				      |002 | 002 | 02  |   ^B	 |  STX   | Start of Text	   |	Ctrl-B	  |
				      |003 | 003 | 03  |   ^C	 |  ETX   | End of Text 	   |	Ctrl-C	  |
				      |004 | 004 | 04  |   ^D	 |  EOT   | End of Transmission    |	Ctrl-D	  |
				      |005 | 005 | 05  |   ^E	 |  ENQ   | Enquire		   |	Ctrl-E	  |
				      |006 | 006 | 06  |   ^F	 |  ACK   | Acknowledge 	   |	Ctrl-F	  |
				      |007 | 007 | 07  |   ^G	 |  BEL   | Bell		   |	Ctrl-G	  |
				      +----+-----+-----+---------+--------+------------------------+--------------+
				      |010 | 008 | 08  |   ^H	 |   BS   | Back Space		   |	Ctrl-H	  |
				      |011 | 009 | 09  |   ^I	 |   HT   | Horizontal Tab	   |	Ctrl-I	  |
				      |012 | 010 | 0A  |   ^J	 |   LF   | Line Feed		   |	Ctrl-J	  |
				      |013 | 011 | 0B  |   ^K	 |   VT   | Vertical Tab	   |	Ctrl-K	  |
				      |014 | 012 | 0C  |   ^L	 |   FF   | Form Feed		   |	Ctrl-L	  |
				      |015 | 013 | 0D  |   ^M	 |   CR   | Carriage Return	   |	Ctrl-M	  |
				      |016 | 014 | 0E  |   ^N	 |   SO   | Shift Out		   |	Ctrl-N	  |
				      |017 | 015 | 0F  |   ^O	 |   SI   | Shift In		   |	Ctrl-O	  |
				      +----+-----+-----+---------+--------+------------------------+--------------+
				      |020 | 016 | 10  |   ^P	 |  DLE   | Data Link Escape	   |	Ctrl-P	  |
				      |021 | 017 | 11  |   ^Q	 |  DC1   | Device Control 1	   |	Ctrl-Q	  |
				      |022 | 018 | 12  |   ^R	 |  DC2   | Device Control 2	   |	Ctrl-R	  |
				      |023 | 019 | 13  |   ^S	 |  DC3   | Device Control 3	   |	Ctrl-S	  |
				      |024 | 020 | 14  |   ^T	 |  DC4   | Device Control 4	   |	Ctrl-T	  |
				      |025 | 021 | 15  |   ^U	 |  NAK   | Negative Acknowledge   |	Ctrl-U	  |
				      |026 | 022 | 16  |   ^V	 |  SYN   | Synchronize 	   |	Ctrl-V	  |
				      |027 | 023 | 17  |   ^W	 |  ETB   | End Transmission Block |	Ctrl-W	  |
				      +----+-----+-----+---------+--------+------------------------+--------------+
				      |030 | 024 | 18  |   ^X	 |  CAN   | Cancel		   |	Ctrl-X	  |
				      |031 | 025 | 19  |   ^Y	 |   EM   | End of Medium	   |	Ctrl-Y	  |
				      |032 | 026 | 1A  |   ^Z	 |  SUB   | Substitute		   |	Ctrl-Z	  |
				      |033 | 027 | 1B  |   ^[	 |  ESC   | Escape		   |	Ctrl-[	  |
				      |034 | 028 | 1C  |   ^	 |   FS   | File Separator	   |	Ctrl-	  |
				      |035 | 029 | 1D  |   ^]	 |   GS   | Group Separator	   |	Ctrl-]	  |
				      |036 | 030 | 1E  |   ^^	 |   RS   | Record Separator	   | Ctrl-Shift-^ |
				      |037 | 031 | 1F  |   ^_	 |   US   | Unit Separator	   | Ctrl-Shift-_ |
				      +----+-----+-----+---------+--------+------------------------+--------------+
				      |177 | 127 | 7F  |   ^?	 |  DEL   | Delete		   |	 DEL	  |
				      +----+-----+-----+---------+--------+------------------------+--------------+
WARNINGS

       Note  that some HP-UX subsystems, such as the keyboard interface, window systems, and other system software, may use selected keyboard con-
       trol characters for special purposes, possibly causing unexpected results.

FILES

																	  ascii(5)
All times are GMT -4. The time now is 02:45 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy