I have a large CSV files (e.g. 2 million records) and am hoping to do one of two things. I have been trying to use awk and sed but am a newbie and can't figure out how to get it to work. Any help you could offer would be greatly appreciated - I'm stuck trying to remove the colon and wildcards in... (6 Replies)
I have an extremely large csv file that I need to search the second field, and upon matches update the last field...
I can pull the line with awk.. but apparently you cant use awk to directly update the file? So im curious if I can use sed to do this... The good news is the field I want to... (5 Replies)
Hi,
I have a filename.csv in which there are 3 colums, ie:
Name ; prefixnumber ; number
root ; 020 ; 1234567
user1,2,3 ; 070 ; 7654321
What I want is to merge colum 2 and 3 that it becomes 0201234567 or even better +31201234567 so the country number is used and drop the leading 0.... (9 Replies)
Hello experts,
I need to validate a csv file which contains data like this:
Sample.csv
"ABCD","I",23,0,9,,"23/12/2012","OK","Street,State, 91135",0
"ABCD","I",23,0,9,,"23/12/2012","OK","Street,State, 91135",0
I just need to check if all the records contain exactly the number of... (5 Replies)
Hello folks
I have a txt file of information about journal articles from different fields. I need to convert this information into a format that is easier for computers to manipulate for some research that I'm doing on how articles are cited. The file has some header information and then details... (8 Replies)
Hello,
Beginning with shell scipting, I'm trying to find in a csv file, the lines where the field related to hostname is displayed as an FQDN intead the hostname. (some lines are correct) and the to correct that inside the file:
Novell,11.0,UNIX Server,bscpsiws02,TxffnX1tX1HiDoyBerrzWA==... (2 Replies)
have written a combined sed+awk to perform a lookup operation which works but looking to enhance it.
looking to match a record using any of the comma separated values + return selected fields from the record - including the field header. so:
cat foo
make,model,engine,trim,value... (6 Replies)
I have a csv file formatted like this:
2014-08-21 18:06:26,A,B,12345,123,C,1232,26/08/14 18:07and I'm trying to change it to MM/DD/YYYY HH:MM for both occurances.
I have got this:
awk -F, 'NR <=1 {print;next}{"date +%d/%m/%Y\" \"%H:%m -d\""$1 "\""| getline dte;$1=dte}1' OFS="," test.csvThis... (6 Replies)
Hi All ,
I would require your help to generate one output file after post processing of one CSV file as stated below
This file is just a small cut from a big file . Big file is having 20000 lines
PATTERN,pat0,pat1,pat2,pat3,pat4,pat5,pat6,pat7,pat8,pat9... (2 Replies)
Discussion started by: kshitij
2 Replies
LEARN ABOUT DEBIAN
portabase
PORTABASE(1) General Commands Manual PORTABASE(1)NAME
portabase - an easy-to-use personal database application
SYNOPSIS
portabase [ -h | --help | <file> ]
portabase command [ -p password ] [ options ] <fromfile> <tofile>
DESCRIPTION
PortaBase (portable database) is a personal database application that is available for many platforms, including Linux, Mac OS X, Windows,
and Maemo.
PortaBase's features include:
- One data table per file
- String, Integer, Decimal, Boolean, Note (multi-line text), Date,
Time, Calculation, Sequence, Image, and Enum column types
- Add, edit, and delete rows of data
- Custom data views (subsets of the columns in any order)
- Filter the displayed rows using sets of conditions
- Sort the rows by any combination of columns, each in ascending or
descending order
- Optional page navigation buttons, with a custom number of rows per page
- Add, delete, rearrange, and rename columns at any time
- Specify default values for columns
- View summary statistics for columns (total, average, min, max, etc.)
- Import data from CSV, XML, and MobileDB files
- Export data to CSV and XML files
- Command-line format conversions (to and from XML, from MobileDB)
- Data file encryption
- Unicode support
- Pick any available font to use throughout the application
COMMANDS
PortaBase uses the following commands to indicate a command-line file conversion:
fromxml
Create a new PortaBase file from the input XML file.
frommobiledb
Create a new PortaBase file from the input MobileDB file.
fromcsv
Add rows to an existing PortaBase file from the input CSV file.
toxml Create a new XML file from the input PortaBase file.
tocsv Create a new CSV file from the input PortaBase file.
If an encrypted PortaBase file is to be read or created, the following option can be used immediately after the command:
-p <password>
Open or create the encrypted PortaBase file using the given password
The toxml and tocsv commands accept the following options:
-v <view>
Apply the named view before exporting.
-s <sorting>
Apply the named sorting before exporting.
-f <filter>
Apply the named filter before exporting.
The fromcsv command supports one option:
-e <encoding>
Specifies the text encoding of the imported CSV file; options are UTF-8 (the default) and Latin-1.
OPTIONS
PortaBase accepts the following options:
-h, --help
Display usage instructions.
FILES
$HOME/.qt/portabaserc - user-specific settings. Stores information on font, checkbox editing, delete confirmations, etc.
AUTHOR
This manual page was written by Jeremy Bowman <jmbowman@alum.mit.edu>, for the Debian GNU/Linux system (but may be used by others).
April 16, 2010 PORTABASE(1)