How to export data file from Unix


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers How to export data file from Unix
# 1  
Old 02-23-2005
Bug How to export data file from Unix

Hi,
I am searching a way to export data file on Unix to SQL server on a daily bases.
Any one has any ideas?

Thanks in advance!
# 2  
Old 02-23-2005
Quote:
Originally Posted by whatisthis
Hi,
I am searching a way to export data file on Unix to SQL server on a daily bases.
Any one has any ideas?
Without more specifics and in general terms:

1. Create a delimited flat file on UNIX
2. ftp or rcp the file to your SQL Server database server
3. Use bcp to load the data into SQL Server

Alternatively for a hands-free approach:

1. Create a delimited flat file on UNIX
2. Define a DTS jobs that ftps your data from UNIX and then loads your SQL Server database however often you wish

Thomas
# 3  
Old 02-23-2005
What I do at work

We have an application on the Unix side that has a job that creates a comma delimited file every night. That file gets written to a specific directory. I have that directory shared out using Samba. Our Microsoft SQL admin then has a daily job that imports the data file into the SQL tables using a UNC path to the Samba share on the Unix box. Works like a charm.

As the other comment noted, we need more specifics to really address your particular situation, but... the basics are:

1. Set up a script or use the functionality of your Unix application to generate a comma delimited data file
2. Use cron to schedule that job to happen at a specified interval (daily, hourly, etc...)
3. Use some kind of file transfer protocol (Samba, FTP, SCP, NFS) to allow your SQL server to grab that data file
4. Set up a script or use the functionality of your SQL application to import the comma delimited data file
# 4  
Old 02-23-2005
MySQL Thanks!

I will try it out!
# 5  
Old 02-24-2005
Power ftp authentication problem

Our Unix server is not configureed to allow ftp from SQL server side to Unix side.
But I can ftp files from Unix to Windows server.
I have a cron job to write pipe deliminated file on certain directory.
I am trying to write a script to ftp the log files to windows shared drive folder every night automatically.
It seemed like unless the server allows anonymous user, I can't pass auto authentication step.

Can I write script to ftp file automatically with correct user name and password?
# 6  
Old 02-24-2005
ftp -n hostName <<EOF
user userName userPasswd
.....ftp commands here.......
EOF
# 7  
Old 02-24-2005
MySQL it worked!

Thanks a lot!
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to Gather data from logs and export to a CSV file

Greetings, After a few hours of trial and error, I decide to ask for some help. I am new to AWK and shell script, so please don't laugh :p I made the below script, to gather data from some logs and have the output into a CSV file : #!/bin/sh #Script to collect Errors ... (9 Replies)
Discussion started by: Yagami_Sama
9 Replies

2. Linux

Parsing - export html table data as .csv file?

Hi all, Is there any out there have a brilliant idea on how to export html table data as .csv or write to txt file with separated comma and also get the filename of link from every table and put one line per rows each table. Please see the attached html and PNG of what it looks like. ... (7 Replies)
Discussion started by: lxdorney
7 Replies

3. Shell Programming and Scripting

How to export hive table data to a file on local UNIX?

Hi All , I am stuck on the below situation.I have a table called "test" which are created on hive.I need to export the data from hive to a file(test.txt) on local unix system.I have tried the below command ,but its giving the exception . hive -e "select * from test " > /home/user/test.txt ; ... (1 Reply)
Discussion started by: STCET22
1 Replies

4. Shell Programming and Scripting

Data export UNIX shell script

Hi, I want to write a shell script which connect to my database with the following credentials : User name : user PWD : rap_user_1 Hostname : app.Unix.Gsm1900.Org Port : 7862 SID : PTNC1 Once connected to DB i want to fetch data with the help of a SQL statement and expoet... (4 Replies)
Discussion started by: neeraj617
4 Replies

5. AIX

wtmp file - is there a patch to export the data another file each day?

sorry for being a noob, i am trying to find which user accessed the server at what time and there ip address at first i used who command but the output didn't contain the ip address then i used the last command which provided me with the ip of the users but when i searched i searched and found that... (1 Reply)
Discussion started by: hercules_1010
1 Replies

6. Shell Programming and Scripting

Run script to export the data to ixf file in loop

Hi, I am trying to export the data to an .ixf file. I have read the table names from a .dat file and those table name should be passed to the select * from schema.TABLENAME query . I am trying the below loop while read TABLE; do db2 EXPORT TO ~/data_export/$TABLE.ixf OF IXF MESSAGES... (5 Replies)
Discussion started by: vikyalex4
5 Replies

7. Shell Programming and Scripting

find string(s) in text file and nearby data, export to list help

Hi, So I'm kinda new to shell scripts and the like. I've picked up quite a bit of use from browsing the forums here but ran into a new one that I can't seem to find an answer for. I'm looking to parse/find a string AND the next 15 or so charachters that follow the string within a text file... (1 Reply)
Discussion started by: kar23me
1 Replies

8. Shell Programming and Scripting

How to export table data to xml file?

Hi , I would like to get some suggestion from the experts. My requirement is to export oracle table data as an xml file. Any unix/linux tools, scripts available? Regards, (2 Replies)
Discussion started by: LinuxLearner
2 Replies

9. Shell Programming and Scripting

Export data from DB2 table to .txt file(space delimited)

Hi I need help on this. Its very urgent for me.. please try to help me out.. I have data in tables in DB2 database. I would like to export the data from DB2 tables into a text file, which has to be space delimited. so that I can carry out awk, grep operations on that file. I tried to export... (2 Replies)
Discussion started by: ss3944
2 Replies

10. Shell Programming and Scripting

unix script to export data from csv file to oracle database

Hello people, Need favour. The problem I have is that, I need to develop a unix shell script that performs recurring exports of data from a csv file to an oracle database. Basically, the csv file contains just the first name and last name will be dumped to an Unix server. The data from these... (3 Replies)
Discussion started by: vinayagan
3 Replies
Login or Register to Ask a Question