On the command line using bash, how do you split a string by column?

Login or Register to Ask a Question and Join Our Community

On the command line using bash, how do you split a string by column?

Tags

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting On the command line using bash, how do you split a string by column?

09-12-2010

Registered User

15, 0

Join Date: Feb 2009

Last Activity: 12 September 2010, 11:24 PM EDT

Posts: 15

Thanks Given: 1

Thanked 0 Times in 0 Posts

On the command line using bash, how do you split a string by column?

Input:

Code:

MD5(secret.txt)= fe66cbf9d929934b09cc7e8be890522e
MD5(secret2.txt)= asd123qwlkjgre5ug8je7hlt488dkr0p

I want the results to look like these, respectively:

Code:

MD5(secret.txt)= fe66cbf9 d929934b 09cc7e8b e890522e
MD5(secret2.txt)= asd123qw lkjgre5u g8je7hlt 488dkr0p

Basically, keeping all the stuff on the left side if equal sign the same, while splitting the stuff after the equal sign into 4 columns of 8 char each. I'm fine with sed or awk.

Any help would be appreciated. Thanks.
.

Last edited by teiji; 09-12-2010 at 11:07 PM..

teiji

View Public Profile for teiji

Find all posts by teiji

09-12-2010

Registered User

2,759, 420

Join Date: Jun 2006

Last Activity: 13 September 2015, 8:58 PM EDT

Posts: 2,759

Thanks Given: 44

Thanked 420 Times in 408 Posts

Need gawk:

Code:

awk '$NF=gensub(/(........)/,"\\1 ","g",$NF)' infile
MD5(secret.txt)= fe66cbf9 d929934b 09cc7e8b e890522e
MD5(secret2.txt)= asd123qw lkjgre5u g8je7hlt 488dkr0p

These 2 Users Gave Thanks to rdcwayx For This Post:

rdcwayx

View Public Profile for rdcwayx

Find all posts by rdcwayx

09-13-2010

Registered User

15, 0

Join Date: Feb 2009

Last Activity: 12 September 2010, 11:24 PM EDT

Posts: 15

Thanks Given: 1

Thanked 0 Times in 0 Posts

Quote:

Originally Posted by rdcwayx

Need gawk:

Code:

awk '$NF=gensub(/(........)/,"\\1 ","g",$NF)' infile
MD5(secret.txt)= fe66cbf9 d929934b 09cc7e8b e890522e
MD5(secret2.txt)= asd123qw lkjgre5u g8je7hlt 488dkr0p

Thanks. Just like I wanted. If you don't mind, can you explain to me what the $NF stands for, and also the the gensub?

teiji

View Public Profile for teiji

Find all posts by teiji

09-13-2010

Registered User

2,759, 420

Join Date: Jun 2006

Last Activity: 13 September 2015, 8:58 PM EDT

Posts: 2,759

Thanks Given: 44

Thanked 420 Times in 408 Posts

$NF stands for the last column.

gensub () is gawk string function.

String Functions - The GNU Awk User's Guide

rdcwayx

View Public Profile for rdcwayx

Find all posts by rdcwayx

09-13-2010

Registered User

2,100, 402

Join Date: Apr 2009

Last Activity: 11 February 2020, 10:24 AM EST

Posts: 2,100

Thanks Given: 26

Thanked 402 Times in 360 Posts

Alternatively, using Perl:

Code:

$ 
$ 
$ cat f7
MD5(secret.txt)= fe66cbf9d929934b09cc7e8be890522e
MD5(secret2.txt)= asd123qwlkjgre5ug8je7hlt488dkr0p
$ 
$ perl -lne '/^(.*= )(.*)$/; @x=unpack("A8"x4,$2); print "$1@x"' f7
MD5(secret.txt)= fe66cbf9 d929934b 09cc7e8b e890522e
MD5(secret2.txt)= asd123qw lkjgre5u g8je7hlt 488dkr0p
$ 
$

tyler_durden

This User Gave Thanks to durden_tyler For This Post:

durden_tyler

View Public Profile for durden_tyler

Find all posts by durden_tyler

09-13-2010

Registered User

3,231, 978

Join Date: Dec 2009

Last Activity: 11 June 2014, 8:40 PM EDT

Posts: 3,231

Thanks Given: 179

Thanked 978 Times in 791 Posts

Or POSIX sed:

Code:

sed 'h; s/.* //; s/.\{8\}/& /g; x; s/[^ ]*$//; G; s/\n//'

This User Gave Thanks to alister For This Post:

alister

View Public Profile for alister

Find all posts by alister

09-13-2010

Registered User

18, 1

Join Date: Jul 2010

Last Activity: 10 November 2010, 6:26 AM EST

Posts: 18

Thanks Given: 6

Thanked 1 Time in 1 Post

Quote:

Originally Posted by alister

Or POSIX sed:

Code:

sed 'h; s/.* //; s/.\{8\}/& /g; x; s/[^ ]*$//; G; s/\n//'

can you explain me your code

thank's

saw7

View Public Profile for saw7

Find all posts by saw7

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Bash Command to Get Nth Line in a String?

hi i need to get the 3rd line in a string. actually, not sure if it's a string, list, array, or something else. I'm using grep to retrieve all the numbers in a string-- in the console, it displays as multiple lines: $ echo "Sink 0: reference = 0: 153% 1: 45%, real = 0: 62%" | grep -o * 0...

2. Shell Programming and Scripting

Split certain strings in a line for a specific column.

Hi, i need help to extract certain strings/words from lines with different length. I have 3 columns separated by tab delimiter. like below Probable arabinan endo-1,5-alpha-L-arabinosidase A (EC 3.2.1.99) (Endo-1,5-alpha-L-arabinanase A) (ABN A) abnA Ady3G14620 Probable arabinan...

3. Shell Programming and Scripting

A command to split a file into two based on a string

Hello What command can i use to split a tab delimited txt file into two files base on the occurrence of a string my file name is EDIT.txt The content of file is below XX 1234 PROCEDURES XY 1634 PROCEDURES XM 1245 CODES XZ 1256 CODES It has more than a million record If there is...

4. Shell Programming and Scripting

Split each column in TSV file to be new line?

My TSV looks like: Hello my name is John \t Hello world \t Have a good day! \t See you later! Is there a simple bash script that splits the tsv on tab to: Hello my name is John Hello world Have a good day! See you later! I'm really stuck, would appreciate any help!

5. Shell Programming and Scripting

Extract Line and Column from CSV Line in ksh or bash format

Hi, I was doing some research and can't seem to find anything. I'm trying to automate a process by creating a script to read a csv line and column and assigning that value to a variable for the script to process it. Also if you could tell me the line and column if it's on another work ...

6. Shell Programming and Scripting

Split a file into multiple files based on line numbers and first column value

Hi All I have one query,say i have a requirement like the below code should be move to diffent files whose maximum lines can be of 10 lines.Say in the below example,it consist of 14 lines. This should be moved logically using the data in the fisrt coloumn to file1 and file 2.The data of first...

7. Shell Programming and Scripting

search a string in a particular column of file and return the line number of the line

Hi All, Can you please guide me to search a string in a particular column of file and return the line number of the line where it was found using awk. As an example : abc.txt 7000,john,2,1,0,1,6 7001,elen,2,2,0,1,7 7002,sami,2,3,0,1,6 7003,mike,1,4,0,2,1 8001,nike,1,5,0,1,8...

8. Shell Programming and Scripting

SPLIT STRING in bash shell script

i need one help.... if i have a string like aaaaa,bbbbb,ccccc,aaaaa How to to split the string and check howmany times aaaaa will be in that string? Thanks

9. Shell Programming and Scripting

Bash:How to split one string variable in two variables?

Hello, I have a paramter $param consisting just of two literals and want to split it into two parameters, so I can combine it to a new parameter <char1><string><char2>, but the following code didn't work: tmp_PARAM_1=cut -c1 $PARAM tmp_PARAM_2=cut -c2 $PARAM...

10. Shell Programming and Scripting

split files by specifying a string (bash shell)

Hi all, I have a file of around 300 lines in which string "SERVER" occurs around 32 times. for eg. I need to split files like, for eg I am using this code awk '/SERVER/{n++}{print > f n}' f=/vikas/list /vikas/final But the problem is that it makes maximum of 10 files, but I...

Login or Register to Ask a Question