Archive.org API or Script


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Archive.org API or Script
# 8  
Old 10-10-2016
I would suggest that you contact the administrators for archive.org and discuss this with them. If the transfer is supported outside of a web-session, then they will be in the best place to advise you.

I'm not trying to be unhelpful, but it would seem most practical. There will need to be an authentication process so you need to understand that and then how the transmission should work. After we have that and you can send a single file, we can work on options to collect all your data together and manage the process.


Kind regards,
Robin
# 9  
Old 10-10-2016
# 10  
Old 10-12-2016
Anybody can help with the above example?
# 11  
Old 10-13-2016
Quote:
Originally Posted by Abu Rayane
Anybody can help with the above example?
Yes. YOU can help with the above example. YOU can contact the administrators at archive.org and YOU can ask them how to upload files to their site without using their one-at-a-time website upload mechanism. YOU can ask them for the procedures and keys needed to access their site to upload one or more files directly to their site.

The UNIX & Linux Forums is not a hacking site. We will not help you hack the security keys that YOU will need to use to load files into their site. To get the keys to the Internet Archive: Digital Library of Free Books, Movies, Music & Wayback Machine web site, YOU need to contact the Internet Archive: Digital Library of Free Books, Movies, Music & Wayback Machine administrators.
# 12  
Old 10-13-2016
If you can get the key and process information that various people have suggested, then I'm sure we can help you find a working solution, but as this is your account and your data, we cannot get this information, nor would you want us to be able to.

Be careful and ensure that when you post the information given to you by archive.org that you do not post the actual credentials (user, password, key, target address, etc.) If you write your script something like this:-
Code:
# Define sensitive credentials
account="account_at_archive.org"
password="mysecretpassword"
target="http://archive.org/account_docs/817936"
key="ThisIsMySuperSensitiveKey"

# Actually send the data
for file in $(ls /my/stuff/to_archive)
do
   wget -user=${account} -password=${password} -key=${key} ${target}/${file}
done

...... then just share the section in the loop and tell us that the sensitive data is being set. They way I've written it is not exactly secure because anyone who is able to read your script as a whole can get at the data, but we can discuss that later.

I've no idea how it is supposed to work, but that is what you will need to tell us and then we can help you. In truth, wget may not be part of it even, it's just an example. You should get that information from archive.org administrators.

Remember that there may be firewall rules or proxy access to consider too, so this may not be straightforward. The administrators and archive.org would be best placed to tell you the sort of access you will need to ensure is in place on your network.


Kind regards,
Robin
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Web Development

Face-api.js — JavaScript API for Face Recognition in the Browser with tensorflow.js

Ref: https://itnext.io/face-api-js-javascript-api-for-face-recognition-in-the-browser-with-tensorflow-js-bcc2a6c4cf07 (0 Replies)
Discussion started by: Neo
0 Replies

2. Shell Programming and Scripting

Script to archive logs and sftp to another archive server

Requirement: Under fuse application we have placeholders called containers; Every container has their logs under: <container1>/data/log/fuse.log <container1>/data/log/fuse.log.1 <container1>/data/log/fuse.log.XX <container2>/data/log/fuse.log... (6 Replies)
Discussion started by: Arjun Goswami
6 Replies

3. Shell Programming and Scripting

Bash script - cygwin (powershell?) pull from GitHub API Parse JSON

All, Have a weird issue where i need to generate a report from GitHub monthly detailing user accounts and the last time they logged in. I'm using a windows box to do this (work issued) and would like to know if anyone has any experience scripting for GitAPI using windows / cygwin / powershell?... (9 Replies)
Discussion started by: ChocoTaco
9 Replies

4. Shell Programming and Scripting

Shell script to call Oracle archive backup script when file system reaches threshold value

Hello All, I need immediate help in creating shell script to call archivebkup.ksh script when archive file system capacity reaches threshold value or 60% Need to identify the unique file system that reaches threshold value. ex: capacity ... (4 Replies)
Discussion started by: sasikanthdba
4 Replies

5. Shell Programming and Scripting

Need to run an API from a script and extract fields from output of API

Hi, I need to call an API (GetUsageDetails)from inside a shell script which takes an input argument acct_nbr. The output of API will be like : <usageAccum accumId="450" accumCaptn="PM_125" inclUnits="1410.00" inclUnitsUsed="744.00" shared="true" pooled="false" prorated="false"... (1 Reply)
Discussion started by: rkrish
1 Replies

6. Shell Programming and Scripting

need help archive script

Hi all, I am new to linux and scripting so please forgive me. I need to create a script that will archive files but the max size of the archive need to be 500mb or under. I know about the archiving with parts but i want all the archives as individual archives. Can anyone point me in the correct... (7 Replies)
Discussion started by: craig0
7 Replies

7. Shell Programming and Scripting

Need some help with an archive script

I'm not sure how to solve the $month-1 thingy or the foreach sentence, so I need some help./* folders = folder1 folder2 folder3 folder4 folder5 */ month=`date +%m` if($month == 01) { prev_month = 12 } else { prev_month =... (7 Replies)
Discussion started by: JKMlol
7 Replies

8. Shell Programming and Scripting

script help .. archive

Hi All We have a landing directory where source system puts files.There are variable number of files and the file names are also varying.Each files successful transmission is identified by a .done file.If file name is xyz.dat then the confirmation file will be xyz.dat.done. I want to... (1 Reply)
Discussion started by: dr46014
1 Replies

9. Shell Programming and Scripting

Archive script

hi guru, can advise how to construct a housekeeping script using perl for the following ? find /var/tmp/logs -name "si*" -type f -exec gzip -f {} \; find /var/tmp/logs -name "*.gz" -type f -exec mv -f {} /var/tmp/log \; I found out those are not working in shell at when put them on... (1 Reply)
Discussion started by: rauphelhunter
1 Replies

10. Shell Programming and Scripting

shell / bash / script api ?

Hi is there a good dokumentation for shell scripting ? like the api in java ? didnt find a good one yet (5 Replies)
Discussion started by: Turrican
5 Replies
Login or Register to Ask a Question