Generally, you don't specify token lengths.... yacc sees tokens, not strings. F/Lex sees strings and outputs tokens. So if you want tokens of specified length, do (in flex):
(Pardon, but I forgot actual flex syntax)
What's wrong with this part of my script?
I just want to put each column from a fixed length file into a variable so I can validate each field later in the script.
exec< myfile.dat
while read afile; do
a=`echo $(echo $afile |cut -c1-10)`
echo "$a"
b=`echo $(echo $afile |cut -c11-20)`... (12 Replies)
Is there a command that sets a variable length?
I have a input of a variable length field but my output for that field needs to be set to 32 char.
Is there such a command?
I am on a sun box running ksh
Thanks (2 Replies)
Hi ,
We have developed a grammer for our domain language using lex n yacc.
I want to know is there any pre defined lex-yacc function which gets call before executing any rule (or rules).
Oue requirement is, before processing any rule ,we want to perform some specific actions ?
is there... (0 Replies)
Hi, all.
I need to convert a file tab delimited/variable length file in AIX to a fixed lenght file delimited by spaces. This is the input file:
10200002<tab>US$ COM<tab>16/12/2008<tab>2,3775<tab>2,3783
19300978<tab>EURO<tab>16/12/2008<tab>3,28523<tab>3,28657
And this is the expected... (2 Replies)
Very, very new to unix scripting and have a unique situation. I have a file of records that contain 3 records types:
(H)eader Records
(D)etail Records
(T)railer Records
The Detail records are 82 bytes in length which is perfect. The Header and Trailer records sometimes are 82 bytes in... (3 Replies)
Hi,
Can anyone help with a effective solution ?
I need to change a variable length text field (between 1 - 18 characters) to a fixed length text of 18 characters with the unused portion, at the end, filled with spaces.
The text field is actually field 10 of a .csv file however I could cut... (7 Replies)
HPUX and posix shell
Hi all.
I have a record with fixed length fields....I would like to reorder the fields and preserver the fixed lengths....
cat test
4 960025460 Dept of Music
8 960025248 Dept of Music 12-08
cat... (3 Replies)
Hello Everyone,
I am stuck with one issue while working on abstract flat file which i have to use as input and load data to table.
Input Data-
------ ------------------------ ---- -----------------
WFI001 Xxxxxx Control Work Item A Number of Records
------ ------------------------... (5 Replies)
Hi Team,
I have an issue to split the file which is having special chracter(German Char) using awk command.
I have a different length records in a file. I am separating the files based on the length using awk command.
The command is working fine if the record is not having any... (7 Replies)
Discussion started by: Anthuvan
7 Replies
LEARN ABOUT DEBIAN
xtokid
XTOKID(1) User Commands XTOKID(1)NAME
xtokid - Print all tokens found in a source file
SYNOPSIS
xtokid [OPTION]... [FILE]...
DESCRIPTION
Print all tokens found in a source file.
-i, --include=LANGS
include languages in LANGS (default: "C C++ asm")
-x, --exclude=LANGS
exclude languages in LANGS
-l, --lang-option=L:OPT pass OPT as a default for language L (see below)
-m, --lang-map=MAPFILE
use MAPFILE to map file names onto source language
-d, --default-lang=LANG
make LANG the default source language
-p, --prune=NAMES
exclude the named files and/or directories
--files0-from=F
tokenize only the files specified by NUL-terminated names in file F
--help display this help and exit --version output version information and exit
The following arguments apply to the language-specific scanners:
C language:
-k,--keep=CHARS
Allow CHARS in single-token strings, keep the result
-i,--ignore=CHARS
Allow CHARS in single-token strings, toss the result
-u,--strip-underscore
Strip a leading underscore from single-token strings
C++ language:
-k,--keep=CHARS
Allow CHARS in single-token strings, keep the result
-i,--ignore=CHARS
Allow CHARS in single-token strings, toss the result
-u,--strip-underscore
Strip a leading underscore from single-token strings
Java language:
-k,--keep=CHARS
Allow CHARS in single-token strings, keep the result
-i,--ignore=CHARS
Allow CHARS in single-token strings, toss the result
-u,--strip-underscore
Strip a leading underscore from single-token strings
Assembly language:
-c,--comment=CHARS
Any of CHARS starts a comment until end-of-line
-k,--keep=CHARS
Allow CHARS in tokens, and keep the result
-i,--ignore=CHARS
Allow CHARS in tokens, and toss the result
-u,--strip-underscore
Strip a leading underscore from tokens
-n,--no-cpp
Don't handle C pre-processor directives
Text language:
-i,--include=CHAR-CLASS
Treat characters of CHAR-CLASS as token constituents
-x,--exclude=CHAR-CLASS
Treat characters of CHAR-CLASS as token delimiters
Perl language:
-i,--include=CHAR-CLASS
Treat characters of CHAR-CLASS as token constituents
-x,--exclude=CHAR-CLASS
Treat characters of CHAR-CLASS as token delimiters
-d,--dtags
Include documentation tags
Lisp language:
REPORTING BUGS
Report bugs to bug-idutils@gnu.org
xtokid - 4.5 August 2012 XTOKID(1)