Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help with a project. convert a txt to csv
Top Forums UNIX for Dummies Questions & Answers Help with a project. convert a txt to csv Post 302594186 by turk451 on Monday 30th of January 2012 07:12:22 PM
Old 01-30-2012
For more complex text processing, I like to use Perl. If you have it installed in your environment, I found this to work on your initial data file:
Code:
#!/usr/bin/perl -w

open (DATAFILE, $ARGV[0]) or die ("Could not open data file.");

foreach $line (<DATAFILE>){
        $line =~ s/\s+$//;
        if (length($line) > 0) {
                if ( $line =~ /^Study Week:/ ) {
                      @lineArray = split("\\*|\\-",$line);
                      $bdate = $lineArray[1];
                      $bdate =~ s/^\s+|\s+$//g;
                      $edate = $lineArray[2];
                      $edate =~ s/^\s+|\s+$//g;
                } elsif ( $line =~ /^Day:/ ) {
                      @lineArray = split("/",$line);
                      $bdate = $lineArray[1];
                } elsif ( $line =~ /^ ?[0-9]/ ) {
                      print(join(',',$bdate,$edate,substr($line,0,5),substr($line,7,5),substr($line,35,10),substr($line,46,25),substr($line,72)."\n"));
                }
        }
}

I am just assuming that the begin date and end date are in that first line "Study Week: 1 * 03.10.11 - 08.10.11 * ...", and that the begin date changes as the document progresses and the lines beginning with "Day" are encountered. Here is the program running on the text file provided:
Code:
./filter.pl ../dat.dat
03.10.11,08.10.11, 8:00,10:15,seminar   ,MCK16 Reproduct/Develop  ,821 Gynaecology
03.10.11,08.10.11, 8:00,10:15,seminar   ,MCC8 Dis.RenalFunc./Oedem,824 1stInternal Med
03.10.11,08.10.11,10:30,13:00,practice  ,MCK16 Reproduct/Develop  ,821 Gynaecology
03.10.11,08.10.11,10:30,13:00,seminar   ,MCC8 Dis.RenalFunc./Oedem,221 Seminar Room
03.10.11,08.10.11,14:30,17:00,elect.cour,Urgent proc. in burned   ,804 Burns Surgery
04.10.11,08.10.11, 8:00, 9:30,seminar   ,MCK16 Reproduct/Develop  ,821 Gynaecology
04.10.11,08.10.11, 8:00,10:15,seminar   ,MCC8 Dis.RenalFunc./Oedem,422 Seminar Room
04.10.11,08.10.11, 9:35,10:20,individ.st,MCK16 Reproduct/Develop  ,104 Individ.study
04.10.11,08.10.11,10:30,12:45,individ.st,MCK16 Reproduct/Develop  ,104 Individ.study
04.10.11,08.10.11,10:30,13:00,seminar   ,MCC8 Dis.RenalFunc./Oedem,422 Seminar Room
04.10.11,08.10.11,14:00,15:30,lecture   ,Psychology/pathopsychol. ,220 Seminar Room
04.10.11,08.10.11,15:45,17:15,practice  ,Psychology/pathopsychol. ,220 Seminar Room
05.10.11,08.10.11, 7:45,10:15,seminar   ,MCK16 Reproduct/Develop  ,821 Gynaecology
05.10.11,08.10.11, 8:00,10:15,seminar   ,MCC8 Dis.RenalFunc./Oedem,423 Seminar Room
05.10.11,08.10.11,10:30,13:00,practice  ,MCK16 Reproduct/Develop  ,821 Gynaecology
05.10.11,08.10.11,10:30,12:00,seminar   ,MCC8 Dis.RenalFunc./Oedem,423 Seminar Room
05.10.11,08.10.11,12:15,13:00,seminar   ,MCC8 Dis.RenalFunc./Oedem,423 Seminar Room
05.10.11,08.10.11,14:00,15:30,elect.cour,Advanced Czech communic. ,960 FNKV/pav.X/lang
06.10.11,08.10.11, 8:00,10:15,practice  ,MCK16 Reproduct/Develop  ,821 Gynaecology
06.10.11,08.10.11, 8:00,13:00,practice  ,MCC8 Dis.RenalFunc./Oedem,824 1stInternal Med
06.10.11,08.10.11,10:45,13:15,practice  ,MCK16 Reproduct/Develop  ,821 Gynaecology
06.10.11,08.10.11,14:30,16:00,elect.cour,Endoscopic/robotic urol. ,909 Thomayer Hosp.
06.10.11,08.10.11,14:30,15:15,elect.cour,Methods Nuclear Cardiol. ,838 Urolog/NuclMed.
07.10.11,08.10.11, 8:00,10:15,seminar   ,MCK16 Reproduct/Develop  ,906 ÚPMD
07.10.11,08.10.11, 8:00, 9:45,seminar   ,MCC8 Dis.RenalFunc./Oedem,422 Seminar Room
07.10.11,08.10.11,10:00,13:15,seminar   ,MCC8 Dis.RenalFunc./Oedem,422 Seminar Room
07.10.11,08.10.11,11:00,13:30,practice  ,MCK16 Reproduct/Develop  ,220 Seminar Room

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to convert PS files to txt file?

Hi, I need to convert PS files to txt file. I thought of using ps2ascii, but its not installed in my AIX box, any other option? (2 Replies)
Discussion started by: redlotus72
2 Replies

2. Shell Programming and Scripting

AWK CSV to TXT format, TXT file not in a correct column format

HI guys, I have created a script to read 1 column in a csv file and then place it in text file. However, when i checked out the text file, it is not in a column format... Example: CSV file contains name,age aa,11 bb,22 cc,33 After using awk to get first column TXT file... (1 Reply)
Discussion started by: mdap
1 Replies

3. Shell Programming and Scripting

how to convert XLS to CSV and DOC/RTF to TXT

Hi, i don't know anything about PERL. Can anyone help me providing PERL scripts for 1. converting XLS to CSV (and vice-versa) 2. converting DOC/RTF to TXT Thanks much Prvn (1 Reply)
Discussion started by: prvnrk
1 Replies

4. Shell Programming and Scripting

Txt to csv convert

Hi, I was trying some split command to pull out values like "uid=abc,ou=INTERNAL,ou=PEOPLE" into a csv file. However because of erratic nature of occurrance of rows made me stopped. Could someone help me in this? and if someone has a one liner for this? The text file contain pattern like this... (14 Replies)
Discussion started by: john_prince
14 Replies

5. Shell Programming and Scripting

Convert txt to csv

Hi - I am looking to convert the following text to csv. The columns may not always have data in them and they may have varying spaces but I still need to have a comma there anyway: Sample Data: ~~~~~~~ Name Email Location Phone Tom... (4 Replies)
Discussion started by: JPBovaird
4 Replies

6. Shell Programming and Scripting

txt file to CSV

hi.. I have a text file which looks likes this 2258 4569 1239 258 473 i need to convert it into comma seperated format eg:2258,4569,1239,258,437 pls help (8 Replies)
Discussion started by: born
8 Replies

7. Shell Programming and Scripting

Need script to convert TXT file into CSV

Hi Team, i have some script which give output in TXT format , need script to convert TXT file into CSV. Output.TXT 413. U-UU-LVDT-NOD-6002 macro_outcome_dist-8.0.0(v1_0_2) KK:1.2.494 (1234:333:aaa:2333:3:2:333:a) 414. U-UU-LVDT-NOD-6004 ... (10 Replies)
Discussion started by: Ganesh Mankar
10 Replies

8. Red Hat

How to convert TXT to PDF in RHEL 6?

Hello friends, I need to convert ASCII text to PDF on RHEL 6 so I did the below and could generate PDF but it has lot of junk/special characters. yum install enscript ghostscript enscript -p output.ps input.txt ps2pdf output.ps output.pdf So I download latest source of Ghostscript... (4 Replies)
Discussion started by: magnus29
4 Replies

9. Solaris

How to convert pdf file to txt?

Hello Unix gurus, I am learning unix. I have lots pdf data files. I need to convert them into txt files. Can you please guide me how to do that? Thanks in advance. Rao (1 Reply)
Discussion started by: raopatwari
1 Replies

10. UNIX for Beginners Questions & Answers

Convert a txt file to a CSV file

Hi , I have a Txt file which consist of 1000's of SOAP request and response and i want the file to be converted to a csv file like column a should have a soap request and column b should have the soap response . can someone assist me in achieving this please ? Thanks (2 Replies)
Discussion started by: kumarm8
2 Replies

LEARN ABOUT HPUX

fsck.cramfs

FSCK.CRAMFS(8)						       System Administration						    FSCK.CRAMFS(8)

NAME

       fsck.cramfs - fsck compressed ROM file system

SYNOPSIS

       fsck.cramfs [options] file

DESCRIPTION

       fsck.cramfs is used to check the cramfs file system.

OPTIONS

       -v, --verbose
	      Enable verbose messaging.

       -b, --blocksize blocksize
	      Use this blocksize, defaults to page size. Must be equal to what was set at creation time. Only used for --extract.

       --extract[=directory]
	      Test to uncompress the whole file system. Optionally extract contents of the file to directory.

       -a     This option is silently ignored.

       -y     This option is silently ignored.

       -V, --version
	      Display version information and exit.

       -h, --help
	      Display help text and exit.

EXIT STATUS

	      0      success
	      4      file system was left uncorrected
	      8      operation error, such as unable to allocate memory
	      16     usage information was printed

SEE ALSO

       mount(8), mkfs.cramfs(8)

AVAILABILITY

       The  example  command  is part of the util-linux package and is available from Linux Kernel Archive <https://www.kernel.org/pub/linux/utils
       /util-linux/>.

util-linux							    April 2013							    FSCK.CRAMFS(8)
All times are GMT -4. The time now is 05:39 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy