Sponsored Content
Top Forums Shell Programming and Scripting Help with datafile parsing and creating spreadsheet Post 302632079 by inditopgun on Sunday 29th of April 2012 03:10:17 AM
Old 04-29-2012
That was really helpful, however my requirement is slightly more complex :

Input Data file :

Code:
TEMP, STUDENT1 COURSE1,COURSE1_DETAILS,COURSE1_SCORE
TEMP, STUDENT1 COURSE1,COURSE1_MORE_DETAILS,COURSE1_COMMENTS
TEMP, STUDENT1 COURSE1,COURSE1_MORE_DETAILS1,COURSE1_COMMENTS1
TEMP, STUDENT1 COURSE1,COURSE1_MORE_DETAILS2,COURSE1_COMMENTS2
TEMP, STUDENT1, COURSE2,COURSE2_DETAILS,COURSE2_SCORE
TEMP, STUDENT1 COURSE2,COURSE2_MORE_DETAILS,COURSE2_COMMENTS
TEMP, STUDENT1 COURSE2,COURSE2_MORE_DETAILS1,COURSE2_COMMENTS1
TEMP, STUDENT1 COURSE2,COURSE2_MORE_DETAILS2,COURSE_COMMENTS2
..
..

TEMP, STUDENT2, COURSE1,COURSE1_DETAILS,COURSE1_SCORE
TEMP, STUDENT2, COURSE1,COURSE1_MORE_DETAILS,COURSE1_COMMENTS
..
TEMP, STUDENT2, COURSE2,COURSE2_DETAILS,COURSE2_SCORE
..
TEMP, STUDENT2, COURSE3,COURSE3_DETAILS,COURSE3_SCORE
..
..
PERM, STUDENT1 COURSE1,COURSE1_DETAILS,COURSE1_SCORE
PERM, STUDENT1 COURSE1,COURSE1_MORE_DETAILS,COURSE1_COMMENTS
PERM, STUDENT1 COURSE1,COURSE1_MORE_DETAILS1,COURSE1_COMMENTS1
PERM, STUDENT1 COURSE1,COURSE1_MORE_DETAILS2,COURSE1_COMMENTS2
PERM, STUDENT1, COURSE2,COURSE2_DETAILS,COURSE2_SCORE
PERM, STUDENT1 COURSE2,COURSE2_MORE_DETAILS,COURSE2_COMMENTS
PERM, STUDENT1 COURSE2,COURSE2_MORE_DETAILS1,COURSE2_COMMENTS1
PERM, STUDENT1 COURSE2,COURSE2_MORE_DETAILS2,COURSE_COMMENTS2
..
..

PERM, STUDENT2, COURSE1,COURSE1_DETAILS,COURSE1_SCORE
PERM, STUDENT2, COURSE1,COURSE1_MORE_DETAILS,COURSE1_COMMENTS
..
PERM, STUDENT2, COURSE2,COURSE2_DETAILS,COURSE2_SCORE
..
PERM, STUDENT2, COURSE3,COURSE3_DETAILS,COURSE3_SCORE
..
..

So there are 2 types of students, TEMP and PERM.
Each Student will have a variable number of courses. For each course, there are anywhere between 2-4 rows in the input file

I would like to create two output files one for TEMP students and another one for PERM students, with data for each student and all his/her various course details in a columnar format


Code:
  STUDENT1, STUDENT2, STUDENT3 ......STUDENTn
  COURSE1:COURSE1_DETAILS, COURSE1:COURSE1_DETAILS....
  COURSE1:COURSE1_MORE_DETAILS, COURSE1:COURSE1_MORE_DETAILS ...
  ..
  COURSE2:COURSE2_DETAILS, COURSE2:COURSE2_DETAILS....
  COURSE2:COURSE2_MORE_DETAILS, COURSE2:COURSE2_MORE_DETAILS ...
  ..
  COURSEn:COURSEn_DETAILS, COURSEn:COURSEn_DETAILS....
  COURSEn:COURSEn_MORE_DETAILS, COURSEn:COURSEn_MORE_DETAILS ...

So the goal is to have one column in Excel for each student, with details about each of his courses listed on various rows for that particular student's column in the spreadsheet

Moderator's Comments:
Mod Comment Welcome to the UNIX and Linux Forums. Please use [code][/code] tags. Video tutorial on how to use them

Last edited by Scrutinizer; 05-03-2012 at 03:14 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

replace one section in a datafile

Hi: First, this is not a homework problem. I just need enough of a hint to get this going... My datafile (dataf.in) is made up of 10 sections. Each section begins with & and with && So it looks like this:------------------------------------- &section1 ...etc... && &section2 ...etc...... (4 Replies)
Discussion started by: Paprika
4 Replies

2. Solaris

oracle datafile *dbf

Hi ,,,, I have move an oracle db from old server to a new server ( solaris 5.9 is the operating system ) my problem is that to new server the datafile ( *.dbf ) are in a different path ..... example old : /export/home/data/blobs ........... new /oracle/data/blobs....... how i can... (3 Replies)
Discussion started by: tt155
3 Replies

3. Shell Programming and Scripting

selective positions from a datafile

Hi dear friends, Im writing a shell script which has to select the strings based on the position. but the problem is there is no field seperator. Normally a datafile contains 2000 records (lines) and each line is of size 500 charecters. I want to select the fields from all the lines which... (10 Replies)
Discussion started by: ganapati
10 Replies

4. UNIX for Dummies Questions & Answers

Append filename to datafile

I am working on an shell script which checks for all the file starting with abc*.* and if file found then the filelines need to append the file name in begining can some one help with the filename appending... for i in `ls $filename*.csv` do echo $i --- NEED to append file name befor... (3 Replies)
Discussion started by: Satyagiri
3 Replies

5. Shell Programming and Scripting

Combine a datafile with Master datafile, emergent!

Hi guys, my supervisor has asked me to solve the problem in 7 days, I've taken 3 days to think about it but couldn't figure out any idea. Please give me some thoughts with the following problem, I have index.database that has only index date: 1994 1995 1996 1997 1998 1999 I have... (6 Replies)
Discussion started by: onthetopo
6 Replies

6. UNIX for Advanced & Expert Users

How do we know which processis creating a datafile

Hi, Is there any way we can find out which process is creating a partucular datafile.I know the user and group but i am just curios to know is there any way to find the process. Thanks (7 Replies)
Discussion started by: ukatru
7 Replies

7. Shell Programming and Scripting

sorting the datafile in an order given in second datafile

Hi, I have two files: first input file is having 7-8 columns, and second data file is like I want to arrange my datafile1 in the order given in second data file, by comparing the seconddatafile with the second column of first file and print the entire line....also if any... (2 Replies)
Discussion started by: CAch
2 Replies

8. Shell Programming and Scripting

Parsing with Name value pair and creating a normalized file

I have url string as follows and I need to parse the name value pair into fields /rows event_id date time payload 1329130951 20120214 22.30.40... (1 Reply)
Discussion started by: smee
1 Replies

9. Shell Programming and Scripting

Validating a datafile with the datatypes

I have two input files 1)datafile 2)metadata file. I have a metadata file like: field1datatypeformat1number2string3dateyy-mm-dd I have a data file like: 1234abc12-8-16 xyz234512-9-163456acd14-08-12 In the first row there is no correction as everything is inline with the metadata.... (3 Replies)
Discussion started by: bikky6
3 Replies

10. Shell Programming and Scripting

Parsing a log file and creating a report script

The log file is huge and lot of information, i would like to parse and make a report . below is the log file looks like: REPORT DATE: Mon Aug 10 04:16:17 CDT 2017 SYSTEN VER: v1.3.0.9 TERMINAL TYPE: prod SYSTEM: nb11cu51 UPTIME: 04:16AM up 182 days 57 mins min MODEL, TYPE, and SN:... (8 Replies)
Discussion started by: amir07
8 Replies
All times are GMT -4. The time now is 03:18 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy