Data to import the database as snippets Post: 302983380

Sponsored Content

Top Forums Shell Programming and Scripting Data to import the database as snippets Post 302983380 by lxdorney on Tuesday 11th of October 2016 11:46:46 AM

10-11-2016

Registered User

I will try this and thanks again

---------- Post updated 10-11-16 at 10:46 AM ---------- Previous update was 10-10-16 at 05:53 PM ----------

Hi,

Here's the result after execute the script.

1. field ITEM - result looking good.

2. field DATE - Testing 100 text files and the result was 2 good out of 100. Maybe because not all content have "Month Year" in the first row.
I tried to replace from

Code:

NR==1 {DATE=$1 " " $2}

to this

Code:

NR==1 {DATE=system("egrep -R "^[a-zA-Z]{3,9} [0-9]{4} $" -m 1")}

to match date pattern, but no luck to make it work.

3. field TITLE - The length of title sometimes <=10 characters, maybe if we could add a conditions, for example First match of the title must be atlist minimum of 30 but not
exceeded to 100 characters and esc for not match and stop at first match.

4. filed SNIPPET - The length of snippet sometimes <=70 characters, maybe if we could add a conditions, for example First match of the snippet must be atlist minimum of 400
but not exceeded to 500 characters and esc for not match and stop at first match.

Also if you could explain the flow of the script much better, for not only me but for the benefit of other users.

Thank you for reading, effort and your patient.

Last edited by lxdorney; 10-11-2016 at 12:54 PM..

lxdorney

View Public Profile for lxdorney

Find all posts by lxdorney

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Import data from compressed file

HI I need to import data from a file which is in comressed format but system doesn't have enough space to uncompress file Is there any way so that i can do import from compressed file.

2. Programming

Code Snippets

Can Anyone give me an implimentation of virtual memory (simulation using paging only) .it should have the following algos for page replacement 1. LRU 2.FIFO 3.Clock references to web sites would be gr8 too it should have the code/algo no executables(in C only)

3. Windows & DOS: Issues & Discussions

import data files from Unix to Windows?

Hi, Is there any way to import data files from Unix system to Windows system? I have many data files on Unix machine generated every night. I need to pick certain data from each file and plug them into this windows file on the network share drive. Anyone has any idea? Thanks in advance!

4. UNIX for Dummies Questions & Answers

How can import data files to XL sheet.

Hi, I have the file(F1.XL) in Unix Box. it's updating every 1hr. I would like to import f1.xl to Windows excel sheet, when i need see the reports. can any one clarify, is there any VB script for importing data from UNIX, like sql connection.... thanks

5. Shell Programming and Scripting

Data Import perl script

Hi, I have a requirement for creating a Perl Script which will perform Data Import process in an automated way and I am elaborating herewith : Section 1 ) - use the following command line format : "./import.pl -h hostname -p port -f datafile.txt" Section 2) datafile.txt will...

6. Shell Programming and Scripting

Shell snip to import CSV data into BASH array

I have been trying to write a simple snip of bash shell code to import from 1 to 100 records into a BASH array. I have a CSV file that is structured like: record1,item1,item2,item3,item4,etc.,etc. .... (<= 100 items) record2,item1,item2,item3,item4,etc.,etc. .... (<= 100 items)...

7. UNIX for Dummies Questions & Answers

Import dump to database

Hi... I have dump in unix machine...How can I this import dump to Oracle database? Many thanks in advance.

8. Solaris

import lun data to mount point - Solaris 10

Hi Guys, I have EMC Storage and from this storage I have maped lun5 to Sun Solaris server and I have created on this lun mount point with name /application I have anothere Sun Solaris server and I'll colne lun5 to lun10 from storage level so the data of lun5 will be in lun10 how to...

9. Shell Programming and Scripting

shellscript to read data from txt file and import to oracle db

Hi all, Help needed urgently. I am currently writing a shellscript to read data/record from a flat file (.txt) file, and import/upload the data to oracle database. The script is working fine, but it takes too long time (for 18000 records, it takes around 90 mins). I guess it takes so long...

10. UNIX for Dummies Questions & Answers

SSH import mysql database

Hi all, I am trying to import a database in putty with the syntax: mysql –u database_username –p database_name < filename.mysql As you can see in the screenshot it asks me for the database password - which suggests that the syntax is correct - but then after I enter the password it gives...

LEARN ABOUT DEBIAN

dh_usrlocal

DH_USRLOCAL(1)							     Debhelper							    DH_USRLOCAL(1)

NAME

       dh_usrlocal - migrate usr/local directories to maintainer scripts

SYNOPSIS

       dh_usrlocal [debhelperoptions] [-n]

DESCRIPTION

       dh_usrlocal is a debhelper program that can be used for building packages that will provide a subdirectory in /usr/local when installed.

       It finds subdirectories of usr/local in the package build directory, and removes them, replacing them with maintainer script snippets
       (unless -n is used) to create the directories at install time, and remove them when the package is removed, in a manner compliant with
       Debian policy. These snippets are inserted into the maintainer scripts by dh_installdeb. See dh_installdeb(1) for an explanation of
       debhelper maintainer script snippets.

       If the directories found in the build tree have unusual owners, groups, or permissions, then those values will be preserved in the
       directories made by the postinst script. However, as a special exception, if a directory is owned by root.root, it will be treated as if it
       is owned by root.staff and is mode 2775. This is useful, since that is the group and mode policy recommends for directories in /usr/local.

OPTIONS

       -n, --noscripts
	   Do not modify postinst/prerm scripts.

NOTES

       Note that this command is not idempotent. dh_prep(1) should be called between invocations of this command. Otherwise, it may cause multiple
       instances of the same text to be added to maintainer scripts.

CONFORMS TO

       Debian policy, version 2.2

SEE ALSO

       debhelper(7)

       This program is a part of debhelper.

AUTHOR

       Andrew Stribblehill <ads@debian.org>

9.20120909							    2011-09-12							    DH_USRLOCAL(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Import data from compressed file

Discussion started by: ap_gore79

2. Programming

Code Snippets

Discussion started by: wojtyla

3. Windows & DOS: Issues & Discussions

import data files from Unix to Windows?

Discussion started by: whatisthis

4. UNIX for Dummies Questions & Answers

How can import data files to XL sheet.

Discussion started by: koti_rama