Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: A cleaner way to rearrange column
Top Forums Shell Programming and Scripting A cleaner way to rearrange column Post 302986628 by LMHmedchem on Monday 28th of November 2016 01:30:03 PM
Old 11-28-2016
Thank you for the suggestions.

I have tried the code posted by both RavinderSingh13 and Don Cragun and both work with the examples I have tested on openSuse 13.2 x86_64.

There doesn't seem to be any difference in performance.

I haven't been able to try the csvtool and recut suggestions posted by drl because I don't have either tool installed. Both of these tools appear to have an elegant and intuitive syntax for this kind of thing. It looks like csvtool is available in the default repositories but recut is not. I generally lean towards using awk and sed because they are always available. It looks like you need all of textlive to get csvtool, which is too bad because textlive is about 1500 packages.


---------- Post updated at 01:30 PM ---------- Previous update was at 12:23 PM ----------

It looks like I also need to add another column to the end of the file. The column would be named "target" and would have the same value for every row. The row values would be floating point numbers like 0.0 or 1.0.

For example, add a column "target" to the end
Code:
index   name    id      chg_p   chg_m
1       name,1  1       1       0
2       name,2  2       1       1
3       name,3  3       1       0
4       name,4  4       1       0
5       name,5  5       1       1

To look like this
Code:
index   name    id      chg_p   chg_m   target
1       name,1  1       1       0       1.0
2       name,2  2       1       1       1.0
3       name,3  3       1       0       1.0
4       name,4  4       1       0       1.0
5       name,5  5       1       1       1.0


The only way I can think of to do this is to generate a second file with the new column and then paste the files together.
Code:
# get the number of lines in file that column will be added to
lines_in_file=$(wc -l < "$temp_output")

# add header to new file
echo "target" > temp_output2

# add a dummy target value for each data row
for (( c=1; c<$lines_in_file; c++ ))
do
   echo "1.0" >> temp_output2
done
# add newline at end
echo >> temp_output2

# combine the files
paste  $temp_output  temp_output2 > output_file

This more or less works, but are there any suggestions for a better way?

LMHmedchem
Last edited by LMHmedchem; 11-28-2016 at 02:51 PM..
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

rearrange a file

hi! in awk, i have a file like this: Trace1: WRIT,Trace2: BLAN,Trace3: BLAN, -47.2120018005371,,,39815.4809027778 -46.3009986877441,,,39815.4809027778 -46.277000427246,,,39815.4809143519 -46.7389984130859,,,39815.4809259259 -46.3460006713867,,,39815.4809259259... (10 Replies)
Discussion started by: riderman
10 Replies

2. Shell Programming and Scripting

script to rearrange data.

Hello. I have data in the following format (the spaces at the beginning of lines are included): 1 2 2 0.39621 0.00000 1 2 2 0.00000+-0.0000 * 1 2 ... (5 Replies)
Discussion started by: andersgs
5 Replies

3. Shell Programming and Scripting

rearrange the column names with comma as column delimiter

Hi, I am new to shell scripting, i have requirement can any one help me out in this regrads, in directory i have file like invoice1.txt, invoice2.txt in each file i have fixed number of columns, 62 in number but they are randomly arranged.like for first file invoice1.txt can have columns... (5 Replies)
Discussion started by: madhav62
5 Replies

4. Programming

How to simplify this perl script to a cleaner simpler look?

my $branch_email_e = $FORM{r_Branch}; my $hostbranch_email_e = $FORM{r_Host_Branch}; my $branch_email_f = $FORM{r_Direction_generale}; my $hostbranch_email_f = $FORM{r_Direction_generale_daccueil}; my $branch_realname_e = ''; my $branch_realname_f = ''; ... (4 Replies)
Discussion started by: callyvan
4 Replies

5. Shell Programming and Scripting

Grabbing the newest file, cleaner method?

Greetings, I'm doing a process whereby I need to search for all filenames containing a given bit of text and grab the newest file from what may be 20 results. In a script I'm writing, i've got a monster line to do the sort as follows: find /opt/work/reports/input -name "*$searchtarget*" |... (4 Replies)
Discussion started by: Karunamon
4 Replies

6. Shell Programming and Scripting

Cleaner method for this if-then statement?

I have a script that runs once per month. It performs a certain task ONLY if the month is January, April, July, or October. MONTH=`date +%m` if || || || ; then do something else do a different thing fi Is there a neater way of doing it than my four separate "or" comparisons? That... (2 Replies)
Discussion started by: lupin..the..3rd
2 Replies

7. Shell Programming and Scripting

Cleaner way to use shell variable in awk /X/,/Y/ syntax?

$ cat data Do NOT print me START_MARKER Print Me END_MARKER Do NOT print me $ cat awk.sh start=START_MARKER end=END_MARKER echo; echo Is this ugly syntax the only way? awk '/'"$start"'/,/'"$end"'/ { print }' data echo; echo Is there some modification of this that would work? awk... (2 Replies)
Discussion started by: hanson44
2 Replies

8. Shell Programming and Scripting

Maybe a cleaner way to generate a file?

greetings, to be clear, i have a solution but i'm wondering if anyone has a cleaner way to accomplish the following: the variable: LSB_MCPU_HOSTS='t70c7n120 16 t70c7n121 16 t70c7n122 16 t70c7n123 16 t70c7n124 16 t70c7n125 16 t70c7n126 16 t70c7n127 16 t70c7n128 16 t70c7n129 16 t70c7n130 16... (2 Replies)
Discussion started by: crimso
2 Replies

9. War Stories

Data Centre meets Vacuum Cleaner

Hi Folks, I have just spent a couple of days resolving some problems at the remote DR data centre, sorting out the problems caused by the over zealous use of a Vacuum cleaner of all things. We have a backup server a SUN V480R with a Storedge 3510 and expansion attached which suffered a... (6 Replies)
Discussion started by: gull04
6 Replies

LEARN ABOUT CENTOS

grub2-mkrescue

GRUB-MKRESCUE(3)					     Library Functions Manual						  GRUB-MKRESCUE(3)

NAME

       grub-mkrescue -- Generate a GRUB rescue image using GNU Xorriso.

SYNOPSIS

       grub-mkrescue [-o | --output=FILE] [--modules=MODULES]
		      [--install-modules=MODULES] [--themes=THEMES]
		      [--fonts=FONTS] [--locales=LOCALES]
		      [--compress[=no,xz,gz,lzo]] [-d | --directory=DIR]
		      [--grub-mkimage=FILE] [--rom-directory=DIR]
		      [--xorriso=FILE] [--grub-glue-efi=FILE]
		      [--grub-render-label=FILE] [--label-font=FILE]
		      [--label-color=COLOR] [--label-bgcolor=FILE]
		      [--product-name=STRING] [--product-version=STRING]
		      [--sparc-boot] [--arcs-boot]

DESCRIPTION

       grub-mkrescue can be used to generate a rescue image with the GRUB bootloader.

OPTIONS

       --output=FILE
	      Write the generated file to FILE.  The default is to write to standard output.

       --modules=MODULES
	      Pre-load modules specified by MODULES.

       --install-modules=MODULES
	      Install only MODULES and their dependencies.  The default is to install all available modules.

       --themes=THEMES
	      Install THEMES.  The default is to install the starfield theme, if available.

       --fonts=FONTS
	      Install FONTS.  The default is to install the unicode font.

       --locales=LOCALES
	      Install only locales listed in LOCALES.  The default is to install all available locales.

       --compress[=no,xz,gz,lzo]
	      Compress GRUB files using the specified compression algorithm.

       --directory=DIR
	      Use images and modules in DIR.

       --grub-mkimage=FILE
	      Use FILE as grub-mkimage(1).  The default is /usr/bin/grub-mkimage.

       --rom-directory=DIR
	      Save ROM images in DIR.

       --xorriso=FILE
	      Use FILE as xorriso.

       --grub-glue-efi=FILE
	      Use FILE as grub-glue-efi(3).

       --grub-render-label=FILE
	      Use FILE as grub-render-label(3).

       --label-font=FILE
	      Use FILE as the font file for generated labels.

       --label-color=COLOR
	      Use COLOR as the color for generated labels.

       --label-bgcolor=COLOR
	      Use COLOR as the background color for generated labels.

       --product-name=STRING
	      Use STRING as the product name in generated labels.

       --product-version=STRING
	      Use STRING as the product version in generated labels.

       --sparc-boot
	      Enable booting the SPARC platform.  This disables HFS+, APM, ARCS, and "boot as disk image" on the i386-pc target platform.

       --arcs-boot
	      Enable  ARCS  booting.  This is typically for big-endian MIPS machines, and disables HFS+, APM, sparc64, and "boot as disk image" on
	      the i386-pc target platform.

       --     All options after a -- will be passed directly to xorriso's command line when generating the image.

SEE ALSO

       info grub

								  Wed Feb 26 2014						  GRUB-MKRESCUE(3)
All times are GMT -4. The time now is 02:34 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy