Pairing the nth elements on multiple lines iteratively Post: 302951107

Sponsored Content

Top Forums Shell Programming and Scripting Pairing the nth elements on multiple lines iteratively Post 302951107 by John Lyon on Sunday 2nd of August 2015 01:17:15 PM

08-02-2015

Registered User

Thanks to you both for your replies. I was trying to keep it simple, but I should've added more information, I think. Here goes:

The data come from a LaTeX file, which uses a package called "Expex" which formats interlinear analyses of a non-English language.

The following two examples show how the data is laid out. The first line "\gla" is the object language, the second line "\glb" is the underlying form, the third line "\glc" is the morpheme gloss, the fourth line "\glc" is the word translation (the package doesn't allow "\gld" for whatever reason), and the last line "\glft" is the sentence translation. As you see, the number of words varies from example to example, just as natural language sentences may be shorter, or longer.

Each "word" is enclosed in curly brackets in the first two lines (though other sets of curly brackets may be nested within words), but only separated by spaces in the second two lines. The curly brackets are necessary to delimit words in the first two lines since some latex commands (e.g. "\ts" below) require blank spaces after them.

Code:

\gla {itl\'i\textglotstop } {k\textsuperscript{w}uk\textsuperscript{w}} {t\textschwa cx\textsuperscript{w}\'u\texthalflength\texthalflength y.}// 
\glb {itl\'i\textglotstop } {k\textsuperscript{w}uk\textsuperscript{w}} {tc+\ts x\textsuperscript{w}\'uy}//
\glc \textsc{dem} \textsc{rep} \textsc{loc}+go //
\glc from.there they.say came.over.this.way //
\glft `They said he was coming along.' //

\gla {u\textbeltl } {cut} {k\textsuperscript{w}uk\textsuperscript{w}} {al\'a\textglotstop } {lut} {i\textglotstop } {q\'aqx\textsuperscript{w}\textschwa lx} {ka\textglotstop} {cx\textsuperscript{w}uys} {i\textglotstop } {l} {siw\textbeltl k\textsuperscript{w}.} //
\glb {u\textbeltl } {cut} {k\textsuperscript{w}uk\textsuperscript{w}} {al\'a\textglotstop } {lut} {i\textglotstop } {q\'a(\tb)\ts qx\textsuperscript{w}lx} {ki\textglotstop} {c\textendash \ts x\textsuperscript{w}uy\textendash s} {i\textglotstop } {l} {siw\textbeltl k\textsuperscript{w}} //
\glc \textsc{conj} say \textsc{rep} \textsc{dem} \textsc{neg} \textsc{det} fish \textsc{comp.obl} \textsc{cust}\textendash go\textendash \textsc{3sg.poss} \textsc{det} \textsc{loc} water //
\glc and he.said they.say here no the fish where.that they.come the through water //
\glft `Coyote said there will be no fish going through the water here.' //

The \glft line may be ignored, but what I'd like exactly is the following, where "&" denotes a column separator in LaTeX and "\\" indicates a newline. Each line has 4 "words", i.e. the nth word in each of the first four lines in the examples above.

Code:

{itl\'i\textglotstop } & {itl\'i\textglotstop } & \textsc{dem} & from.there \\
{k\textsuperscript{w}uk\textsuperscript{w}} & {k\textsuperscript{w}uk\textsuperscript{w}} &  \textsc{rep} & they.say \\

Etcetera. Once the first example is done, the second example would be appended to the above list. Eventually each line will be sorted alphabetically by the first "column". It'd also be nice to be able to choose which input lines to include in the output, though I'd greatly appreciate any more assistance you could give in obtaining the basic result just outlined. Thanks again.

John Lyon

View Public Profile for John Lyon

Find all posts by John Lyon

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Average of elements throught multiple files

Hi, I got a lot of files looking like this: 1 0.5 6 All together there are ard 1'000'000 lines in each of the ard 100 files. I want to build the average for every line, and write the result to a new file. The averaging should start at a specific line, here for example at line...

2. UNIX for Dummies Questions & Answers

Getting number of lines of nth occurrency

Hi all, I would like to extract the line number of the n-th occurrency of a given string in a file. e.g. xxx yyy xxx zzz xxx the second occurrency of xxx is at line 3. What is the fastest way to do it in bash? Thank you,

3. UNIX for Dummies Questions & Answers

Finding nth line across multiple files

I have several files (around 50) that have the similar format. I need to extract the 5th line from every file and output that into a text file. So far, I have been able to figure out how to do it for a single file: $ awk 'NR==5' text1.txt > results.txt OR $ sed -n '5p' text1.txt > results.txt...

4. Shell Programming and Scripting

Array output through a for loop problematic with multiple elements.

This code works perfect when using a machine with only one interface online. (Excluding the loopback of course) But when I have other interface up for vmware or a vpn the output gets mixed up. I know I had this working when I was just reading ip's from files so I know it is not a problem with...

5. Shell Programming and Scripting

How to output all lines following Nth occurrence of string

Greetings experts. Searched the forums (perhaps not hard enough?) - Am searching for a method to capture all output from a log file following the nth occurrence of a known string. Background: Using bash, I want to monitor my Oracle DB alert log file. The script will count the total # of...

6. Shell Programming and Scripting

Extracting lines after nth LINE from an output

Hi all, Here is my problem for which i am breaking my head for past three days.. I have parted command output as follows.. Model: ATA WDC WD5000AAKS-0 (scsi) Disk /dev/sdb: 500GB Sector size (logical/physical): 512B/512B Partition Table: msdos Number Start End Size Type ...

7. UNIX for Dummies Questions & Answers

Rename multiple files in shell bash, changing elements order.

Hi, I want to rename several files like this: example: A0805120817.BHN A0805120818.BHN ..... to: 20120817.0805.N 20120818.0805.N ...... How can i do this via terminal or in shell bash script ? thanks,

8. Shell Programming and Scripting

Removing multiple lines from input file, if multiple lines match a pattern.

GM, I have an issue at work, which requires a simple solution. But, after multiple attempts, I have not been able to hit on the code needed. I am assuming that sed, awk or even perl could do what I need. I have an application that adds extra blank page feeds, for multiple reports, when...

9. UNIX for Dummies Questions & Answers

Getting the lines with nth column non-null

Hi, I have a huge list of archives (.gz). Each archive is about 40MB. A file is generated every minute so if I want to analyze the data for 1 hour I get already 60 files for example. These are text files, ';' separated, each line having about 300 fields (columns). What I need to do is to...

10. Shell Programming and Scripting

Compare multiple arrays elements using awk

I need your help to discover missing elements for each box. In theory each box should have 4 items: ITEM01, ITEM02, ITEM08, and ITEM10. Some boxes either have a missing item (BOX02 ITEM08) or might have da duplicate item (BOX03 ITEM02) and missing another one (BOX03 ITEM01). file01.txt ...

LEARN ABOUT DEBIAN

cmafihe

cmafihe(1L)															       cmafihe(1L)

NAME

       cmafihe - Lojban word glosser

SYNOPSIS

       cmafihe [ -l ] [ -b ] [ -w width ] [ -p ] [ -v ] [filename]

DESCRIPTION

       cmafihe	is  a  program that reads a piece of Lojban text.  It writes out the text, showing the rough English translation of each word.	It
       also shows the selma'o (category) to which each cmavo (grammar word) belongs.

OPTIONS

       -v     Show the program version and exit.

       -l     Produce output for typesetting with LaTeX.  The Lojban, selma'o and English translation are shown on separate lines  for	each  word
	      (or closely related group of words).

       -p     Output GNUStep property list containing vocabulary.  (Only available if cmafihe was compiled with the PLIST option).

       -b     Produce plain text output in 'block' format.

       -w width
	      Set the line width for the -b option (default 80).

       The  default  is to write text to stdout.  The Lojban words are shown without brackets.	The selma'o information is in angle brackets.  The
       English translation is in square brackets.

       filename
	      The name of the file containing text to be parsed.  If omitted, the text is read from standard input.

SEE ALSO

       jbofihe
	      A much more sophisticated program which includes grammar checking.

       smujajgau
	      A program for compiling binary dictionaries for use by jbofihe

FILES

       /usr/local/lib/jbofihe/smujmaji.dat
	      This file contains all the dictionary data compiled (using smujajgau ) into a binary format to facilitate lookup and search.

       /usr/local/bin/cmafihe
	      The executable.

ENVIRONMENT

       JBOFIHE_DICTIONARY
	      This should point to the name of the file containing the dictionary.  The default is /usr/local/lib/jbofihe/smujmaji.dat

BUGS

       ju'oru'e so'imei (Surely there are many)

REFERENCES

       http://go.to/jbofihe
	      Home page for the jbofihe project (of which cmafihe is part)

       http://www.lojban.org/
	      Home page of the Lojban community

       http://www.rrbcurnow.freeuk.com/lojban/
	      My Lojban page.

AUTHOR

       Richard Curnow <rpc@myself.com>

								    April 2000							       cmafihe(1L)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Average of elements throught multiple files

Discussion started by: chillmaster

2. UNIX for Dummies Questions & Answers

Getting number of lines of nth occurrency

Discussion started by: f_o_555

3. UNIX for Dummies Questions & Answers

Finding nth line across multiple files

Discussion started by: oriqin

4. Shell Programming and Scripting

Array output through a for loop problematic with multiple elements.

Discussion started by: Azrael