Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract hive table structure
Top Forums Shell Programming and Scripting Extract hive table structure Post 303011388 by rohit_shinez on Wednesday 17th of January 2018 09:20:09 PM
Old 01-17-2018
Hi,

Thanks for the suggestion, but still i am unable to achive, this is by show create table structure

Code:
CREATE TABLE `test`(
  `id` string COMMENT '',
  `age` string COMMENT '',
  `city` string COMMENT '')
ROW FORMAT SERDE
  'org.apache.hadoop.hive.ql.io.orc.OrcSerde'
WITH SERDEPROPERTIES (
  'path'='hdfs://local/')
STORED AS INPUTFORMAT
  'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat'
OUTPUTFORMAT
  'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat'
LOCATION
  'hdfs://local/'
TBLPROPERTIES (
  'COLUMN_STATS_ACCURATE'='false',
  'EXTERNAL'='FALSE',
  'numFiles'='14',
  'numRows'='-1',
  'rawDataSize'='-1',
  'spark.sql.sources.provider'='orc',
  'spark.sql.sources.schema.numParts'='9',
'spark.sql.sources.schema.part.8'='....":{}}]}',
  'totalSize'='12',
  'transient_lastDdlTime'='12')

i would need
Code:
CREATE TABLE `test`(
  `id` string COMMENT '',
  `age` string COMMENT '',
  `city` string COMMENT '')

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract Table from PDF

Hi Guys! I want to extract table from PDF in HTML. Can we do this using Shell script....??. Please provide me your suggestions. Any help will be highly appreciated. Thanks! (2 Replies)
Discussion started by: parshant_bvcoe
2 Replies

2. Shell Programming and Scripting

How to create a C structure using table description.

There is table 'DEPT' in the database with the following desciption: Name Null? Type ------- -------- ------------------------ DEPTNO NOT NULL NUMBER(2) DNAME NULL VARCHAR2(14) LOC NULL VARCHAR2(13) Using shell script, I need to create a structure for the... (2 Replies)
Discussion started by: ehari
2 Replies

3. Shell Programming and Scripting

Extract table name from DDL

How can I extract table name from the different DDL statement like ALTER TABLE CREATE TABLE etc Basically I have to parse thr the any of the DDL statement and verify if that DDL statement is implemented by DBA or not. how can i do this efficiently in Kornshell scripting. (2 Replies)
Discussion started by: gayathree
2 Replies

4. Shell Programming and Scripting

Extract files from tar ball without directory structure

Hi, I have tar filw which has multiple directories which contain files. When i extract using tar -xf the directory structure also get extracted. I require only files and not directory structures as there will be overhead of moving the files again. So i searched here and got a solution but... (4 Replies)
Discussion started by: chetan.c
4 Replies

5. UNIX and Linux Applications

Help in copying table structure to another table with constraints in Oracle

hi, i need to copy one table with data into another table, right now am using create table table1 as select * from table2 i want the constraints of table1 to be copied to table2 also , can anyone give me some solution to copy the constraints also, now am using oracle 10.2.0.3.0... (1 Reply)
Discussion started by: senkerth
1 Replies

6. UNIX for Dummies Questions & Answers

Extract table from an HTML file

I want to extract a table from an HTML file. the table starts with <table class="tableinfo" and ends with next closing table tag </table> how can I do this with awk/sed... ---------- Post updated at 04:34 PM ---------- Previous update was at 04:28 PM ---------- also I want to... (4 Replies)
Discussion started by: koutroul
4 Replies

7. Shell Programming and Scripting

How to export hive table data to a file on local UNIX?

Hi All , I am stuck on the below situation.I have a table called "test" which are created on hive.I need to export the data from hive to a file(test.txt) on local unix system.I have tried the below command ,but its giving the exception . hive -e "select * from test " > /home/user/test.txt ; ... (1 Reply)
Discussion started by: STCET22
1 Replies

8. Shell Programming and Scripting

Extract table from file

I need to sort out table in a file to a format below: Input: this is a test example Cat Bee Dat 1 2 3 more Example date data Bet Cla Blaa Dat A 6 T data.. Output: this is a test (10 Replies)
Discussion started by: aydj
10 Replies

9. Shell Programming and Scripting

JSON structure to table form in awk, bash

Hello guys, I want to parse a JSON file in order to get the data in a table form. My JSON file is like this: { "document":{ "page": }, { "column": } ] }, { ... (6 Replies)
Discussion started by: Gescad
6 Replies

10. UNIX for Beginners Questions & Answers

Shell Script to read hive table and send email

HI Team, I am working on reading hive table and send email in email body using shell script, can you please help on fixing the errors: I have 6 columns in my hive table and trying to send the email in the mail body. below script: #!/bin/bash hive -e 'SELECT count(*) from db.table' >... (4 Replies)
Discussion started by: Mi4304
4 Replies

LEARN ABOUT DEBIAN

pdf2txt

PDF2TXT(1)							  PDFMiner Manual							PDF2TXT(1)

NAME

       pdf2txt - extracts text contents of PDF files

SYNOPSIS

       pdf2txt [option...] file...

DESCRIPTION

       pdf2txt extracts text contents from a PDF file. It extracts all the text that is to be rendered programmatically, i.e. text represented as
       ASCII or Unicode strings. It cannot recognize text drawn as images that would require optical character recognition. It also extracts the
       corresponding locations, font names, font sizes, writing direction (horizontal or vertical) for each text portion. You need to provide a
       password for protected PDF documents when its access is restricted. You cannot extract any text from a PDF document which does not have
       extraction permission.

OPTIONS

       -o file
	   Specifies the output file name. The default is to print the extracted contents to standand output in text format.

       -p pageno[,pageno,...]
	   Specifies the comma-separated list of the page numbers to be extracted. Page numbers start at one. By default, it extracts text from
	   all the pages.

       -c codec
	   Specifies the output codec.

       -t type
	   Specifies the output format. The following formats are currently supported:

	   text
	       Text format. This is the default.

	   html
	       HTML format. It is not recommended.

	   xml
	       XML format. It provides the most information.

	   tag
	       "Tagged PDF" format. A tagged PDF has its own contents annotated with HTML-like tags.  pdf2txt tries to extract its content streams
	       rather than inferring its text locations. Tags used here are defined in the PDF Reference, Sixth Edition[1] (S10.7 "Tagged PDF").

       -D writing-mode
	   Specifies the writing mode of text outputs:

	   lr-tb
	       Left-to-right, top-to-bottom.

	   tb-rl
	       Top-to-bottom, right-to-left.

	   auto
	       Determine writing mode automatically

       -M char-margin, -L line-margin, -W word-margin
	   These are the parameters used for layout analysis. In an actual PDF file, text portions might be split into several chunks in the
	   middle of its running, depending on the authoring software. Therefore, text extraction needs to splice text chunks. In the figure
	   below, two text chunks whose distance is closer than the char-margin is considered continuous and get grouped into one. Also, two lines
	   whose distance is closer than the line-margin is grouped as a text box, which is a rectangular area that contains a "cluster" of text
	   portions. Furthermore, it may be required to insert blank characters (spaces) as necessary if the distance between two words is greater
	   than the word-margin, as a blank between words might not be represented as a space, but indicated by the positioning of each word.

	   Each value is specified not as an actual length, but as a proportion of the length to the size of each character in question. The
	   default values are char-margin = 1.0, line-margin = 0.3, and W = 0.2, respectively.

       -n
	   Suppress layout analysis.

       -A
	   Force layout analysis for all the text strings, including text contained in figures.

       -V
	   Enable detection of vertical writing.

       -s scale
	   Specifies the output scale. This option can be used in HTML format only.

       -m n
	   Specifies the maximum number of pages to extract. By default, all the pages in a document are extracted.

       -P password
	   Provides the user password to access PDF contents.

       -d
	   Increase the debug level.

EXAMPLES

       Extract text as an HTML file whose filename is output.html:

	   $ pdf2txt -o output.html samples/naacl06-shinyama.pdf

       Extract a Japanese HTML file in vertical writing:

	   $ pdf2txt -c euc-jp -D tb-rl -o output.html samples/jo.pdf

       Extract text from an encrypted PDF file:

	   $ pdf2txt -P mypassword -o output.txt secret.pdf

SEE ALSO

       dumppdf(1)

AUTHORS

       Jakub Wilk <jwilk@debian.org>
	   Wrote this manual page for the Debian system.

       Yusuke Shinyama <yusuke@cs.nyu.edu>
	   Author of PDFMiner and its original HTML documentation.

NOTES

	1. PDF Reference, Sixth Edition
	   http://www.adobe.com/devnet/acrobat/pdfs/pdf_reference_1-7.pdf

pdf2txt 							    08/24/2011								PDF2TXT(1)
All times are GMT -4. The time now is 10:22 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy