formatting data file with awk or sed Post: 302407778

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Clense Junk Data File - Using Shell or awk or sed

Hello Shell Gurus i need help in solving this puzzle. We have a junk data file that needs to be fed into the database. Need to clense the data file thru shell script. I am not a expert and so need help with Here is what i need to do on the input file -Step -1 Replace all pipes �|' within...

2. Shell Programming and Scripting

Big data file - sed/grep/awk?

Morning guys. Another day another question. :rolleyes: I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution: for results in `grep "^\ ... works, but takes ages (we're talking minutes) to run. The data is held...

3. Shell Programming and Scripting

Awk formatting of a data file - nested for loops?

Hello - is there any way in awk I can do... 4861 x(1) y(1) z(1) 4959 x(1) y(1) z(1) 5007 x(1) y(1) z(1) 4861 x(2) y(2) z(2) 4959 x(2) y(2) z(2) 5007 x(2) y(2) z(2) 4861 x(3) y(3) z(3) 4959 x(3) y(3) z(3) 5007 x(3) y(3) z(3) to become... 4861 x(1) y(1) z(1) 4861 x(2) y(2) z(2)...

4. Shell Programming and Scripting

sed or awk to extract data from Xml file

Hi, I want to get data from Xml file by using sed or awk command. I want to get the following result : mon titre 1;Createur1;Dossier1 mon titre 1;Createur1;Dossier1 and save it in cvs file (fichier.cvs). FROM this Xml file (test.xml): <playlist version="1"> <trackList> <track>...

5. Shell Programming and Scripting

Formatting help needed awk or sed maybe

6. Shell Programming and Scripting

how to get data from hex file using SED or AWK based on pattern sign

I have a binary (hex) file I need to parse to get some data which are encoded this way: .* b4 . . . 01 12 .* af .* 83 L1 x1 x2 xL 84 L2 y1 y2 yL By another words there is a stream of hexadecimal bytes (in my example separated by space for better readability). I need to get value stored in...

7. Shell Programming and Scripting

AWK/Shell script for formatting data in a file

Hi All, Need an urgent help to convert a unix file in to a particular format: **source file:** 1111111 2d2f2h2 3dfgsd3 ........... 1111111 <-- repeats in every nth line. remaining all lines will be different 123ss41 432ff45 ........... 1111111 <-- repetition qwe1234 123weq3...

8. Shell Programming and Scripting

awk - sed / reading from a data file and doing algebraic operations

Hi everyone, I am trying to write a bash script which reads a data file and does some algebraic operations. here is the structure of data.xml file that I have; 1 <data> 2 . 3 . 4 . 5 </data> 6 <data> 7 . 8 . 9 . 10</data> etc. Each data block contains same number of lines (say...

9. Shell Programming and Scripting

Data formatting using awk

Need assistance on the data extraction using awk Below is the format and would like to extract the data in another format ------------------------------------------------------------------------------------------------- Minimum Temperature (deg F ) DAY 1 2 3 4 5 6 7 8 9 10 11...

10. Shell Programming and Scripting

Problem in formatting output in sed / awk

I have a file like this : ! 1 ! 542255 ! 50,140.00 ! ! 2 ! 551717 ! 5,805.00 ! ! 3 ! 551763 ! 8,130.00 ! ! 4 ! 551779 ! 750.00 ! ! 5 ! 551810 ! 56,580.00 ! ! 6 ! 551816 ! 1,350.00 ! ! 7 ! 551876 ! 360.00 ! ! 8 ! 551898 ! ...

LEARN ABOUT HPUX

cksum

cksum(1)						      General Commands Manual							  cksum(1)

NAME

       cksum - print file checksum and sizes

SYNOPSIS

       [file ...]

DESCRIPTION

       The command calculates and prints to standard output a checksum for each named file, the number of octets in the file and the filename.

       uses  a	portable  algorithm  based on a 32-bit Cyclic Redundancy Check.  This algorithm finds a broader spectrum of errors than the 16-bit
       algorithms used by (see sum(1)).  The CRC is the sum of the following expressions, where x is each byte of the file.

	      + x^8 + x^7 + x^5 + x^4 + x^2 + x^1 + x^0 x26 + x23 + x22 + x16 + x12 + x11 + x10 + x7 + x5 + x4 + x2 + x1 + x0

       The results of the calculation are truncated to a 32-bit value.	The number of bytes in the file is also printed.

       Standard input is used if no file names are given.

       is typically used to verify data integrity when copying files between systems.

EXTERNAL INFLUENCES

   Environment Variables
       determines the locale to use for the locale categories when both and the corresponding environment variable (beginning with do not  specify
       a locale.  If is not set or is set to the empty string, a default of "C" (see lang(5)) is used.

       determines  the	locale	for  interpretation of sequences of bytes of text data as characters (e.g., single- verses multibyte characters in
       arguments and input files).

       determines the language in which messages are displayed.

       If any internationalization variable contains an invalid setting, behaves as if all internationalization variables are  set  to	"C".   See
       environ(5).

RETURN VALUE

       Upon completion, returns one of the following values:

	      All files were processed successfully.

	      One or more files could not be read or another error occurred.

       If an inaccessible file is encountered, continues processing any remaining files, but the final exit status is affected.

SEE ALSO

       sum(1), wc(1).

STANDARDS CONFORMANCE

																	  cksum(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Clense Junk Data File - Using Shell or awk or sed

Discussion started by: rimss

2. Shell Programming and Scripting

Big data file - sed/grep/awk?

Discussion started by: dlam

3. Shell Programming and Scripting

Awk formatting of a data file - nested for loops?

Discussion started by: catwoman

4. Shell Programming and Scripting

sed or awk to extract data from Xml file

Discussion started by: yeclota