Sponsored Content
Top Forums Shell Programming and Scripting Need help with extracting data to MySQL format Post 302575052 by Johanni on Sunday 20th of November 2011 05:28:22 AM
Old 11-20-2011
Need help with extracting data to MySQL format

Hi guys,

I'm doing a project now and extracting tables from a webpage to MySQL table format.

I dumped the webpage with lynx and it is like this

Code:
   
   id
   Spec
   524543
   Developed especially for seniors
   Spec
   No
   Java
   Spec
   Yes
   Java MIDP
   Spec
   Available using application
   Operating system
   Spec
   Android 2.3 (Gingerbread)
   Qwerty keyboard (buttons)
   Spec
   No
   Qwerty keyboard (screen)
   Spec
   Yes
   SAR
   Spec
    0.34 W/kg
   Stand by time
   Spec
    710 h
   Talk time
   Spec
    18.2 h
   Talk time (3G)
   Spec
    8.4 h
   Stand By-Time (3G)
   Spec
    610 h
   Audio features
   Built-in speakers
   Spec
   Mono
   Camera
   Built-in camera
   Spec
   Yes
   Auto focus
   Spec
   Yes
   Built-in flash
   Spec
   Yes
   Flash type
   Spec
   LED-flash

it is specification of a cellphone. And I got the line number of each 'Spec' word with grep cut and sed and it is like this:

Code:
2 
5 
8 
11
14
17
20
23
26
29
32
35
39
43
46
49
52

now I want to get just the lines after each 'Spec' word and put in the MySQL format like this:

Code:
INSERT INTO `specifications` VALUES (524543,'No','Yes','Available using application','Android 2.3 (Gingerbread)',...);

I know that I need to get the lines with number +1 and put them between ',' in one line, but this part was very hard for me could you please help me about that?

Cheers,
Johanni
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

converting a tabular format data to comma seperated data in KSH

Hi, Could anyone help me in changing a tabular format output to comma seperated file pls in K-sh. Its very urgent. E.g : username empid ------------------------ sri 123 to username,empid sri,123 Thanks, Hema:confused: (2 Replies)
Discussion started by: Hemamalini
2 Replies

2. Shell Programming and Scripting

convert date format to mysql date format in log file

I have a comma delimited log file which has the date as MM/DD/YY in the 2nd column, and HH:MM:SS in the 3rd column. I need to change the date format to YYYY-MM-DD and merge it with the the time HH:MM:SS. How will I got about this? Sample input 02/27/09,23:52:31 02/27/09,23:52:52... (3 Replies)
Discussion started by: hazno
3 Replies

3. UNIX for Dummies Questions & Answers

Changing from Excel date format to MySQL date format

I have a list of dates in the following format: mm/dd/yyyy and want to change these to the MySQL standard format: yyyy-mm-dd. The dates in the original file may or may not be zero padded, so April is sometimes "04" and other times simply "4". This is what I use to change the format: sed -i '' -e... (2 Replies)
Discussion started by: figaro
2 Replies

4. Shell Programming and Scripting

Help needed to format mysql output

Hi all, Does anyone know how to format the output from mysql from within a shell script? i.e. RESULT=`mysql command` echo ${RESULT} the ${RESULT} only displays the output on one line instead of how mysql would display it as columns etc (3 Replies)
Discussion started by: muay_tb
3 Replies

5. Shell Programming and Scripting

Using Awk for extracting data in specific format

please help me writing a awk script 001_r.pdb 0.0265185 001_r.pdb 0.0437049 001_r.pdb 0.0240642 001_r.pdb 0.0310264 001_r.pdb 0.0200482 001_r.pdb 0.0146746 001_r.pdb 0.0351344 001_r.pdb 0.0347856 001_r.pdb 0.036119 001_r.pdb 1.49 002_r.pdb 0.0281011 002_r.pdb 0.0319908 002_r.pdb... (5 Replies)
Discussion started by: phoenix_nebula
5 Replies

6. Shell Programming and Scripting

Extracting specific lines of data from a file and related lines of data based on a grep value range?

Hi, I have one file, say file 1, that has data like below where 19900107 is the date, 19900107 12 144 129 0.7380047 19900108 12 168 129 0.3149017 19900109 12 192 129 3.2766666E-02 ... (3 Replies)
Discussion started by: Wynner
3 Replies

7. UNIX for Dummies Questions & Answers

help in extracting logs in readable format

hello everyone. newbie here in unix. I am trying to extract the logs of a certain job and would like to output it in a readable format, see below the CAT part: cat /var/opt/ctma/ctm/sysout/idwesct_sh30_eng_r6_cdcs_sh.LOG_05l0du_000* | egrep -i 'orderid:|file_name=' | sed... (1 Reply)
Discussion started by: eanne_may
1 Replies

8. Shell Programming and Scripting

Need help getting my output from MYSQL query into right format

Good afternoon! I have been lurking in this forum for awhile now. I have just recently started posting. I think this is a really good site. With that being said, I don't like to just run and get an answer before I try my best first. I have poured some blood, sweat and tears into... (4 Replies)
Discussion started by: brianjb
4 Replies

9. Shell Programming and Scripting

Extracting content from a file in specific format

Hi All, I have the file in this format **** Results Data **** Time or Step 1 2 20 0.000000000e+00 0s 0s 0s 1.024000000e+00 Us 0s 0s 1.100000000e+00 1s 0s 0s 1.100000001e+00 1s 0s 1s 2.024000000e+00 Us Us 1s 2.024000001e+00 ... (7 Replies)
Discussion started by: diehard
7 Replies

10. Shell Programming and Scripting

Script to generate Excel file or to SQL output data to Excel format/tabular format

Hi , i am generating some data by firing sql query with connecting to the database by my solaris box. The below one should be the header line of my excel ,here its coming in separate row. TO_CHAR(C. CURR_EMP_NO ---------- --------------- LST_NM... (6 Replies)
Discussion started by: dani1234
6 Replies
File::Spec::Win32(3pm)					 Perl Programmers Reference Guide				    File::Spec::Win32(3pm)

NAME
File::Spec::Win32 - methods for Win32 file specs SYNOPSIS
require File::Spec::Win32; # Done internally by File::Spec if needed DESCRIPTION
See File::Spec::Unix for a documentation of the methods provided there. This package overrides the implementation of these methods, not the semantics. devnull Returns a string representation of the null device. tmpdir Returns a string representation of the first existing directory from the following list: $ENV{TMPDIR} $ENV{TEMP} $ENV{TMP} SYS:/temp C:/temp /tmp / The SYS:/temp is preferred in Novell NetWare. Since Perl 5.8.0, if running under taint mode, and if the environment variables are tainted, they are not used. catfile Concatenate one or more directory names and a filename to form a complete path ending with a filename canonpath No physical check on the filesystem, but a logical cleanup of a path. On UNIX eliminated successive slashes and successive "/.". On Win32 makes dir1dir2dir3....dir4 -> dirdir4 and even dir1dir2dir3...dir4 -> dirdir4 splitpath ($volume,$directories,$file) = File::Spec->splitpath( $path ); ($volume,$directories,$file) = File::Spec->splitpath( $path, $no_file ); Splits a path in to volume, directory, and filename portions. Assumes that the last file is a path unless the path ends in '\', '\.', '\..' or $no_file is true. On Win32 this means that $no_file true makes this return ( $volume, $path, undef ). Separators accepted are and /. Volumes can be drive letters or UNC sharenames (\servershare). The results can be passed to "catpath" to get back a path equivalent to (usually identical to) the original path. splitdir The opposite of catdir(). @dirs = File::Spec->splitdir( $directories ); $directories must be only the directory portion of the path on systems that have the concept of a volume or that have path syntax that differentiates files from directories. Unlike just splitting the directories on the separator, leading empty and trailing directory entries can be returned, because these are significant on some OSs. So, File::Spec->splitdir( "/a/b/c" ); Yields: ( '', 'a', 'b', '', 'c', '' ) catpath Takes volume, directory and file portions and returns an entire path. Under Unix, $volume is ignored, and this is just like catfile(). On other OSs, the $volume become significant. Note For File::Spec::Win32 Maintainers Novell NetWare inherits its File::Spec behaviour from File::Spec::Win32. SEE ALSO
File::Spec perl v5.8.0 2002-06-01 File::Spec::Win32(3pm)
All times are GMT -4. The time now is 12:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy