What it does
Tobar na Gaedhilge is a searchable textbase of high-quality 20th-century Gaelic texts (mostly Irish, with some Scottish), best described as "continuity Gaelic" in its several naturally-occurring varieties. The textbase contains over 5.9 million tokens of Gaelic text, and is freely downloadable for installation on a personal computer under MS Windows. After the software is installed, a form may be requested, and examples of its use may be viewed. The purpose of Tobar na Gaedhilge is to allow the texts to be used as a lexical and grammatical resource. To protect the rights of the authors and publishers, the texts are not made available in continuously readable form.
A summary of some of the user-friendly features of the system: • texts are grouped into collections, each for a particular naturally-occurring variety of Gaelic • a complete pick-list of the forms in the chosen collection is presented on-screen • forms are listed with initial mutations removed, eg. fear, fhear, bhfear are all grouped under fear; while athair, h-athair, n-athair, t-athair are all grouped under athair • forms are listed with enclitics separated, eg. d'ith is listed under d' and ith; agamsa is listed under agam and sa • apostrophes are distinguished from quotation marks and are retained in forms, eg. 'ach is not conflated with ach • forms split at end-of-line in the original text are rejoined in the list, where appropriate • collocations of forms may be found, either in immediate sequence, or within a sentence-like unit • an analytic approach is taken to compound forms, eg. sean-amhrán is treated as a sequence of sean, -, and amhrán • accents may optionally be discounted for searching, eg. comhartha may be made to retrieve both comhartha and cómhartha • an asterisk may be used as a wild-card to match all or part of a form, eg. beir* or *stin These features were designed into the program from the beginning, and the texts were prepared with the markup necessary to support them. Tobar na Gaedhilge is completely free of adware, spyware or other harmful inclusions. |
In addition, the textbase contains translations of some of the Gaelic texts into or from English, French, German and Russian. These will be collectively referred to as other languages. Retrieved segments of Gaelic text may be displayed in other languages, if the translations are stored; and further, the forms occurring in the stored texts in other languages may be used to search the textbase.
• What the results may look like
We begin by showing the results of some typical searches, and how to explore those results. We will later show how to request a search.
We may show sentences containing a selected Gaelic form, taking one example each from the Munster, Connacht and Scottish texts. Thereafter, we will draw our examples from the Ulster texts, which form by far the largest part of the material stored. (Contributions of Munster, Connacht or Scottish texts are most welcome.)
Figure 1: We looked in the Munster texts for examples of the form cábóg (a country person). We found two examples in Pádraig Ua Maoileoin, Na hAird Ó Thuaidh, and we show the second example here. Page and line reference is given to the published book.
In passing, a small thing to notice in this example is the hyphen in "shráid-eanna". This shows that the token was hyphenated (at the end of a line) in the original book. But the hyphen does not interfere with indexing the sentence, as use of the Innéacsáilte display will confirm.
The navigation panel (at upper right) allows us to move around the retrieved examples. The display panel (at lower right) allows the form in which the sentence is displayed to be controlled. These are described following Figure 6 below.
Figure 2: We looked in the Connacht texts for examples of the sequence of forms lúb gaoil (blood relationship), and we found two examples, both in Séamus Mag Uidhir, Fánaidheacht i gConndae Mhuigheo. We show the first sentence here.
Figure 3: We looked in the Scottish texts for examples of forms beginning with càr. With a request like this for forms matching a general pattern, clearly more than one form may match — we refer to this situation as matching a disjunction of forms. The sentences for each matching form are presented (over all the relevant books) before presenting the sentences for the next matching form. Here, we show a sentence containing the matching form càraich (fix).
Besides viewing complete sentences as above (View: Abairteacha (il-teangthach)), three other ways of viewing results are provided, which are more compact for large quantities of text. (The view can be chosen at the same time as the search forms are chosen.) Output from these views is shown in the next two figures.
Figure 4: The frequency (Minicidheacht) view of the form saoghal (life) in the texts of the current collection.
Scrolling may be necessary to reveal the information for all the texts. If the request matched a disjunction of forms, a navigation option AthFhocal (next form) will proceed to the next matching form. A navigation option Réidh (finished) leaves the results and returns to the search screen.
Figure 5: A keyword-in-context view (KWIC) of the form athair (father) in Séamus 'ac Grianna, Thiar i dTír Chonaill. The first batch of occurrences is shown.
For the KWIC view, the navigation panel at the upper right allows us to move down a screenful (Síos), up a screenful (Suas), to start of text (Suas go bárr), to end of text (Síos go bun). These options allow us to move around move only within the current text, and (for a disjunction of matching forms) only for the current form.
To move to the next book of the collection, we use AthLeabhar. If the request matched several forms in disjunction, AthFhocal will take us to the first book for next matching form. The Réidh (finished) option leaves the results and returns to the search screen. Some of the navigation options are provided with keyboard shortcuts, which may prove convenient for frequent use. (The AthThlámán option is equivalent to Síos.)
It is not currently possible to move to the previous book or to a previous matching form. But we can get back to the start of the retrieved results by choosing Réidh and returning to the results without altering the previous search request.
Figure 5a: A monolingual by sentence view (Abairteacha (aon-teangthach)) of the form athair (father) in Séamus 'ac Grianna, Thiar i dTír Chonaill. The first batch of occurrences is shown.
In the Abairteacha (aon-teangthach) view, whole sentences are shown, rather than single lines as in the KWIC view. The first batch of sentences is shown, and the navigation panel allows us to move down a batch (Síos) or move to the start of text (Suas go bárr). The further options move up a batch (Suas) and move to end of text (Síos go bun) are not yet properly programmed. These options allow us to move around move only within the current text, and (for a disjunction of matching forms) only for the current form.
The monolingual option differs from the multilingual by sentence (Abairteacha (il-teangthach)) view which we have seen in earlier by-sentence figures, and which is the default option. The multilingual view shows only one sentence at a time, but it offers other option for the display of that sentence.
Figure 6: A multilingual by sentence view (Abairteacha (il-teangthach)) of the form oidhreógach (ice) in Seosamh 'ac Grianna, Pádraic Ó Conaire agus Aistí Eile. The first (and, as it happens, only) such sentence in this text is displayed.
Here, the navigation panel allows us to move to the next retrieved sentence (Síos), to the previous retrieved sentence (Suas), to the first retrieved sentence of the text (Suas go bárr), or to the last retrieved sentence of the text (Síos go bun). These options allow us to move around move only within the current text, and (for a disjunction of matching forms) only for the current form.
In either of the by sentence views, we use AthLeabhar to move to the next book of the collection. If the request matched several forms in disjunction, AthFhocal will take us to the first book for next matching form. The Réidh (finished) option leaves the results and returns to the search screen. Some of the navigation options are provided with keyboard shortcuts, which may prove convenient for frequent use. (The AthAbairt option is equivalent to Síos.)
It is not currently possible, in either of the by sentence views, to move to the previous book or to a previous matching form. But we can get back to the start of the retrieved results by choosing Réidh and returning to the results without altering the previous search request.
The extra facilities available in the multilingual by-sentence option are activated by the display panel at the lower right. Firstly, it allows the text of the sentence in the main language (ie. the language of the index in use) to be shown in a choice of ways: plain and uncorrected (Foillsighthe); plain but corrected (Lom); including mark-up (Marcáilte); or as a list of the tokens by which it is indexed (Innéacsáilte). The Innéacsáilte option allows you to see which index terms will fetch this sentence. This will allow you to see how the text has been tokenized and indexed.
To explain what is meant by "correction": this is limited to obvious errors. An isolated spelling variant which is at odds with consistent usage in the rest of the same book may also be corrected; but beyond this, we make no attempt at normalization of forms which are not clearly in error. Corrections to Gaelic text may also include restoring the wording of the manuscript where known. And correction of a text in a language other than Gaelic may be used to bring that text closer to the edition used by the Gaelic translater. None of these correction processes can be guaranteed to have been applied exhaustively. The corrections are applied to the indexes; and to the displayed sentences under the Lom option. The uncorrected book text will always be displayed under the Foillsighthe option.
As an example, the misprint cómhhartha occurs in Ben-Hur on page 337, and should clearly be corrected and indexed as cómhartha. So if we search for cómhartha, we will find the relevant sentence, and if we view it under the default Lom option, we will see the token as cómhartha. But if viewed under the Foillsighthe option, we will see it, uncorrected, as cómhhartha. Under the Marcáilte option, we will see the complete markup as cómh[h]artha. And under the Innéacsáilte option, we will see it confirmed that the token is indexed as cómhartha.
Secondly, in the multilingual by-sentence option, the display panel allows the translation of the sentence into other languages to be shown, if stored. To do this, tick the names of the desired languages, visible on the sentence-level displays above, labelled Béarla (English) and Fraincis (French) and Gearmáinis (German) and Rúisis (Russian). If the name of the language is italicised, this means that a translation in that language is not available for the sentence to be displayed. At present, translations or originals are held only for texts in the Ulaidh collection, and only for a proportion of this: English, 2.39M tokens; French, 0.90M tokens; German, 0.92M tokens; Russian, 0.14M tokens. In these other languages, the sentence is always shown plain and corrected.
Figure 7: Sentences containing the form creafadaigh (shaking); the first of two examples found in Seosamh 'ac Grianna, Seideán Bruithne/Amy Foster. English and French translations are available and are shown.
When a sentence is shown in several languages, the choice of display between plain (Lom); including mark-up (Marcáilte); as a list of the tokens by which it is indexed (Innéacsáilte); or plain and uncorrected exactly as printed (Foillsighte) applies only to the language of the index used. In other languages the sentence is shown plain.
The page and line number is shown for the displayed sentence. The page and line number are taken from the edition used, and they can be displayed only if the computer-readable version of the text is paginated — see the list of texts below for this information. All the Gaelic texts are paginated, but some in other languages, texts which have been obtained from various sources may not be paginated.
Several other options on the navigation panel are common to the KWIC and both by-sentence views.
Cóipeáil (copy) copies the current display to a textfile, which by default, is called samplaí.txt and is placed in the My Documents folder, and the copied material is appended to it. Comhad Cóipeála (copy file) allows the name and location of the file to be changed, and also the mode from append to overwrite (but it will revert to appending after the first copy). The darker elongated panel shown in Figure 6 is the result of clicking Comhad Cóipeála.
Retrieval of a collocation may require the creation of workfiles. These will be placed in the temporary workspace folder, if possible. In the unlikely event that this is not possible, you will be prompted for the name of a folder to hold workfiles; you could, for example, place them on a memory stick.
• What Gaelic texts can be searched
Gaelic is found in several slightly different forms, and the texts are organized into collections to reflect this and to keep each collection fairly homogeneous in language. The five collections supplied are (as of 2023/10/04):
- Ulaidh (Ulster) Index: Gaedhilg. 17 authors; 74 books; 57,012 forms; 5,132,477 tokens
- Connachta Index: Gaedhilge. 8 authors; 10 books; 22,982 forms; 406,316 tokens
- Mumhain (Munster) Index: Gaolainn. 6 authors; 6 books; 13,375 forms; 226,404 tokens
- Alba (Scotland) Index: Gàidhlig. 4 authors; 5 books; 8,021 forms; 115,996 tokens
- Oirthear (Eastern) Index: Gaodhlag. 2 regions; 3 books; 8,700 forms; 104,842 tokens
At the present stage of development, the Ulaidh collection is much larger than any of the others.
The identities of the texts in all collections are listed in full below.
Searching may be restricted to any chosen subset of the texts of a collection, by deselecting temporarily individual texts or authors.
Each collection has a pre-compiled index associated with it, made from the forms found in the relevant books, and in which requests for forms are looked up. The statistics just given for the collections refer to these indexes — indexes of forms found in the Gaelic texts. This does not mean that the forms in the index are exclusively Gaelic forms; rather they will reflect whatever the Gaelic texts contain, including borrowings, phrases and quotations in other languages.
Much more detail will be given later about what forms may be found in the indexes.
Figure 8: This is the program's opening screen, and the first task is to choose the desired collection and index.
The program should show a list of the available collections, as in blue above — together with some statistics of the highlighted collection (below) and a pick list of its index (on the right). If there are no collections listed, you may be in the wrong folder, and you can browse (using Cuirtear Lorg) to a different folder. The indexes available to the highlighted collection are shown in brown. When you have marked the desired collection and chosen your index to it, click on Isteach to enter the collection/index.
Amach is to exit the program.
Treoir is for help.
• Requesting Gaelic forms
When a collection has been selected, and Isteach clicked, the display changes to that shown in the next figure, which allows you to type forms and to choose a view, among other things.
Figure 9: Requesting Gaelic forms.
Before entering our own forms, however, first notice that this screen allows you to go back and change to a different collection and index, by using the Athruigh button on the Cnuasacht panel. And also, that you may see which authors and books are included in the current collection and index by using the Athruigh button on the Leabharthaí panel, and you may choose to select temporarily a subset of those books. (Note that selecting a subset of a collection is not reflected in the pick-list of forms, which remains that for the whole collection.)
From the Radharc (views) panel, you may choose your view of the results: frequencies (Minicidheacht); a keyword-in-context concordance (KWIC); batched sentences (Abairteacha (aon-teangthach)); or single sentences with extra display options (Abairteacha (il-teangthach)). Samples of each view have already been shown above.
And now we come to the Focal panel, where the desired form or forms may be typed into the box provided, or may be inserted there by double-clicking them on the pick list, which is a displayed segment of the collection's index. The pick list accommodates itself to the existing contents of the box, as a guide to what words are available.
If typing into the box, any accented character should be pre-composed, not a combination — e.g. type á as normal, NOT a followed by a combining acute accent.
As an alternative to typing it into the box, a search form may also be chosen by double-clicking it on the pick list, or it may be pasted from the Windows clipboard (Ctrl/V). The new form will be appended to anything already in the box (and which is not selected); if the existing material in the box is already selected — which is the default — the new search form will replace it. TIP: when working between the box and the picklist, you can cycle the focus around these and the other screen items by repeatedly pressing the TAB key. While an item has focus, any content which is selected will be visibly highlighted.
In the box you may put:
• a form, such as oidhreógach or saoghal or athair, as used in our
previous examples
• two or more forms occurring together (eg. lúb gaoil)
• any form may contain a wild-card (*), that is,
an asterisk which matches any number of letters, including none. For example,
all forms with a particular stem may be sought (eg. beir*), or all forms with a particular termination (eg.
*stin).
If the box contains more than one form (ie. there is a space within it), you are asked to choose between seeking the forms directly adjacent and in the given order; or within the same sentence in any order. (Note however that the KWIC display mode is unsuitable when asking for consecutive forms; in this case, the monolingual by sentence mode is substituted.)
It is even possible to give one or more of the forms as simply the asterisk (*), which matches any form; the search is then assumed to be a consecutive one. (But avoid giving * as the final form, as the search will be unnecessarily slow.) As we will see below (under demutation) a hyphen is, in most circumstances, counted as a separate form, so search for sean-bhean as three forms: sean - bean (as well as sean bean and seanbhean to cover any unhyphenated instances).
You may tick the Gan beinn ar an tsíneadh fhada
checkbox if you want to include forms which differ from that requested
only by the presence or absence of an accent, eg. comhradh with this checkbox ticked will match comhrádh, cómhradh and cómhrádh as well. Actually, ticking this
box also includes forms which differ from that requested:
• by the presence of ANY accent;
• by a difference of CASE, though this affects only lemma indexes and the German form index,
as case differences are already neutralized in other form indexes;
• by the intrusion of certain non-alphanumeric characters, such as £, %, period (indicating abbreviation),
apostrophe (indicating elision), hyphen (indicating anonymisation), etc. For example, 2
will retrieve also £2 or 2% or 2° or
2½; but note that many Gaelic forms containing apostrophes or hyphens are already
treated as compounds and indexed as two or more separate parts, as explained under decompounding below.
To type accented vowels, use your normal method of doing this under Windows. For information about keying accented letters under Windows, look here, or see the section "Keyboards layouts" near the end of this file. (But you will not require the support for dotted consonants offered by these keyboards, as lenition is always indicated by suffixing the letter h in Tobar na Gaedhilge.) Your method of typing accented characters should result in precomposed characters, as most methods do, rather than in separate combining accents.
When all this is complete, you may click the OK button to produce the results.
Further hints on the choice of forms for searching will come in the next section of this document.
• More about what to expect in a Gaelic index
Here are some pointers regarding what kinds of forms are worth requesting.
When a form is requested, it is matched against a pre-compiled index of forms from the chosen collection. A scrolling alphabetic listing of the current index is shown, and will indicate what forms are available. For Gaelic, this index consists of forms which are aggregated in a number of ways to increase coverage:
• lowercased: the forms in a Gaelic index have been converted to lowercase by replacing any capital letters by small letters; this even applies to proper names. Any capital letters you include in your request will also be so converted.
• decliticised: common enclitics, such as d' in d'ól, or 's in 'seadh, or -sa in agam-sa, are treated as separate forms in the index (d' + ól; 's + eadh; agam + - + sa), and should also be detached in your request. Enclitics are normally signalled in running text by a hyphen or an apostrophe. But when there is no overt signal in similar cases (eg. agamsa, seadh), the splitting in the index will have been performed manually and is unlikely to have been exhaustive.
A number of common contracted forms have been indexed under their parts, e.g. 'na (from ina) under ' and a; 'na (from chun an) under 'n and a'; 'na (from chun na) under ' and na; ab (from a ba) under a and b, or under a and b'; gurab under gur and a and b; and many other similar cases. This aspect is to be made more rigorous.
• decompounded: very few forms containing a hyphen have been admitted to the indexes — a list of these can be obtained by searching for *-*. Rather, most hyphenated forms have been treated atomistically in the indexes, and are found by seeking their parts, including the hyphen, eg. leith-phighinn by seeking the three items leith and - and pighinn, with checking of the "consecutive" option ("Díreach i ndiaidh a chéile").
• demutated: initial mutations are removed from forms in the index; so, for example, fear, fhear and bhfear are all indexed as fear, while t-olc, n-olc and holc are all indexed as olc — but, where the mutation is permanent, it is retained, e.g. chugam, thart (in one of its senses), (go) dtí. You may have noticed the benefits of demutation and decliticisation in our athair example above. An initial mutation does not leave any trace in the index; and this is also true of any hyphen which is only part of an initial mutation. When typing Gaelic forms to be searched for, remember to remove initial mutations, unless they are a permanent part of the form. Removal of initial mutations may seem counter-intuitive when requesting a sequence of forms (eg. ár athair), but it is nonetheless required.
The forms in the Gaelic forms index are not lemmatized, ie. terminally inflected forms, such as fear, fir, feara, must be searched for separately — although the wild card may often be used to advantage to retrieve the several related forms in disjunction.
Finally, note that the index is based on the forms of the text after they have been subjected to a limited and controlled degree of correction, as explained just below Figure 6 above.
• Searching in other languages
As well as searching the textbase for Gaelic words, indexes have been created in four additional languages, based on the forms found in translations or originals in these languages of some of the Gaelic texts. As stated earlier, these translations/originals are at present confined to the Ulaidh collection, and cover only a proportion of it: Béarla (English), 2.37M tokens; Fraincis (French), 0.87M tokens; Gearmáinis (German), 0.74M tokens. There is also a tiny amount of Russian, 0.09M tokens.
Generally, such texts have been independently translated into Gaelic and into the other non-original languages; the original language in most such cases has been English, but there are examples of French (La Terre qui Meurt; Pêcheur d'Islande) and of Russian (Записки охотника). Translation of a Gaelic original is found only into Russian (extracts from Ó Neamh go h-Árainn and from Fallaing Shíoda).
Note that the Gaelic version of the text is considered pivotal. Consequently, substantial amounts of material absent from a Gaelic text will not be included in other language versions of that text either. For example, the Gaelic translation of Turgenev's Записки охотника contains only about half the stories in the original, and only these stories will be included in other languages. Also, in the other language collections, texts are grouped according to the author or translater of the Gaelic version.
Figure 10: Search of the English index of the Ulaidh collection for the form bunch. An example is shown from Ben-Hur, and the English and Gaelic and French and German of the sentence is displayed.
Figure 11: Search of the French index of the Ulaidh collection for the form accroché. An example is shown from Iascaire Inse Tuile, and the French and Gaelic and English and German of the sentence is displayed.
Figure 12: Search of the German index of the Ulaidh collection for the form Knurren. An example is shown from Scairt an Dúthchais, and the German and Gaelic and English and French and Russian of the sentence is displayed.
Figure 12a: Search of the Russian index of the Ulaidh collection for the form лошадь. An example is shown from Scéalta Sealgaire, and the Russian and Gaelic and English of the sentence is displayed.
To search using another language, select the Ulaidh collection, and then the appropriate language. You will then have a further choice between Foirmeacha (forms) and Lemmata (lemmas), because a rough and ready lemmatization has been applied to the English, French, German and Russian texts, resulting in two indexes for each of these languages. The statistics for these indexes are, at 2023/10/04:
- Ulaidh (Ulster) Index: Béarla (foirmeacha). 7 Gaelic writers; 23 books; 46,928 forms; 2,375,425 tokens
- Index: Béarla (lemmata). 7 Gaelic writers; 23 books; 36,319 lemmas; 2,366,875 tokens
- Index: Fraincis (foirmeacha). 3 Gaelic writers; 9 books; 34,709 forms; 869,635 tokens
- Index: Fraincis (lemmata). 3 Gaelic writers; 9 books; 16,468 lemmas; 867,783 tokens
- Index: Gearmáinis (foirmeacha). 4 Gaelic writers; 10 books; 52,982 forms; 847,353 tokens
- Index: Gearmáinis (lemmata). 4 Gaelic writers; 10 books; 32,170 lemmas; 851,994 tokens
- Index: Rúisis (foirmeacha). 3 Gaelic writers; 4 parts of books; 21,544 forms; 92,991 tokens
- Index: Rúisis (lemmata). 3 Gaelic writers; 4 parts of books; 11,350 lemmas; 92,908 tokens
The form indexes for all languages except German are lowercased, even for proper names, and when typing a request, any uppercase letters are automatically converted to lowercase.
In the German form index, the initial letter of a noun (or a name) retains its case — actually, the initial letter takes its case from the lemma assigned to it, which is usually the same thing (lemmatization is discussed below); and when typing a request, case remains as typed. Only forms matching the case of the request are retrieved, unless the option Gan beinn ar an tsíneadh fhada is active, when forms which differ only in case will also be found.
In form indexes, enclitics are separated (eg. English 's, 've, n't, French l', m', German 's (gibt's), 'n (so'n)). Hyphenated words are generally decomponded, eg. French garde-robe; but this policy has not been consistently applied to English, where eg. decompounded water-tight is found as well as unitary water-tight and watertight. In the German index, decompounding of (hyphenless) words, eg. weitergehen, has not been attempted.
Besides a forms index, for additional languages there are also lemma indexes. Using the English lemmas index, a request for man will match the forms man or men; while, using the French lemmas index, a request for homme will match the forms homme or hommes; or using the German lemmas index, a request for Mann will match forms Mann, Mannes, Manne, Männer, Männern. (A Gaelic lemmas index is under construction.)
When discussing a lemmatized index, the form vs token distinction is still relevant, but should be understood as referring to lemma(-form) vs (lemma-)token. The token count for a lemma index will differ slightly from the token count for a form index of the same texts. Among the reasons for this, a form token may give rise to two lemma tokens, eg. the English form "cannot" gives lemmas "can" and "not"; or the German form "im" gives lemmas "in" and "die". Conversely, lemma indexes exclude "foreign" items, which also makes them more "mono-lingual" than form indexes.
Figure 13: A KWIC view of the lemma listen in Gadaidheacht le Láimh Láidir, according to our English lemma index. The corresponding material, in Gaelic and any other languages in which it is available, may be inspected, one example at a time, in the sentence view.
Figure 14: A KWIC view of the lemma abandonner (to abandon) in Ben-Hur, according to our French lemma index. The corresponding material, in Gaelic and any other languages in which it is available, may be inspected, one example at a time, in the sentence view.
Figure 15: A KWIC view of the lemma Baum (tree) in Scairt an Dúthchais, according to our German lemma index. The corresponding material, in Gaelic and any other languages in which it is available, may be inspected, one example at a time, in the sentence view.
Figure 15a: A KWIC view of the lemma тёмный (dark) in Scéalta Sealgaire, according to our Russian lemma index. The corresponding material, in Gaelic and any other languages in which it is available, may be inspected, one example at a time, in the sentence view.
It is important to understand that our lemmatization of English and French and German and Russian has been performed automatically, using the Tree Tagger. This software is among the best of its kind, and lemmatization would have been impractical without it, but, as with all statistical operations, a percentage of errors is inevitable, and some remain despite much manual post-checking. The Russian lemma index has further benefitted from the use of Sharoff's lemmatisation tool, and of Usachev's morphology file and of the morfer.ru site, as described here.
In our lemma indexes, an initial capital has been retained in appropriate lemmas, mostly names (as well as for nouns in the German lemma index); and when typing a request into a lemma index, no changes are made to the case typed. Therefore it matters whether the letters you type in your request to a lemma index are small letters or capitals. Keep an eye on the scrolling alphabetic list for guidance on what lemmas are available and when you should use a capital letter. If you wish to retrieve both upper- and lowercase lemmas matching your request, use the option Gan beinn ar an tsíneadh fhada
When displaying a sentence found through a lemma index, the Innéacsáilte display option shows the sentence in the first language as a list of the lemmas with which it is indexed.
Many lemmas are ambiguous, e.g. in English: pack or stamp or well or lie or bound or back; or in French: pas or tendre or vague or fin. Ideally, we would like to retrieve only the desired sense of an ambiguous lemma, and, since version 1.5, we have tried to separate the senses by part of speech, using four broad categories of N (noun), V (verb), J (adjective) and Z (other). Thus for example a request for English lemma well will be asked to choose between N, V and Z; a request for French lemma vague will be asked to choose between J and N. This may help in many cases, but not in others; for the English lemma lie, for example, a more useful division would be into recline and untruth, rather then into noun and verb. Further development in this area may be expected in future versions.
• Translation equivalents
A related innovation is the calculation of translation equivalents. Ideally, given a lemma in the source language, this would produce a listing of the relatively most common lemmas in the corresponding sentences of the target language (lemma to lemma). For the present, however, the Gaelic lemmas index is small, and none of the texts contributing to it have translations stored, so this facility is not of use when Gaelic is the source language. But it would still be useful with Gaelic as the target language, and to enable this in the short term, we modify the ideal procedure to use instead the forms of the target language (lemma to form).
This technique has potential, but is limited at present by the amount of parallel text available for each language pair (the numbers below are the numbers of Gaelic form tokens in the shared texts):
English | French | German | Russian | |
Gaelic | 2,850,000 | 903,000 | 919,000 | 142,000 |
English | 903,000 | 919,000 | 128,000 | |
French | 590,000 | 45,000 | ||
German | 45,000 |
This facility is offered — where the source language is other than Gaelic — by means of a fifth output view, named Freagar-fhocla. Any of the supported languages, including Gaelic, may be used as the target language. The calculation may take a few moments. The resulting display is a list of target-language forms, each accompanied by a score, and sorted on these scores (the user may have it re-sorted alphabetically on the forms themselves). The scores — which are not raw token counts — may range from 99,999,999 down to 100,000, and measure how common the target-language form is in the neighbourhood of the source-language lemma in comparison with the whole of the target language corpus.
Note: if a subset of source-language texts is selected, only that subset contributes to the calculation.
From v1.14 (2023), this facility is also offered with Gaelic as the source language. However at this stage the results will be disappointing, because none of the Gaelic texts which have been completely lemmatized has a translation into any other language. The only results, therefore, come from lightly-lemmatized texts, and are unlikely to be meaningful. Among the words which may be tested with this facility is dá. Gaelic may of course be used as the target language.
Figure 15: Search for Gaelic forms collocating with the English lemma child, in the Ulster texts.
The chosen source-language lemma defines a set of sentences in the source-language corpus — those sentences in which it occurs — and a corresponding set of sentences in the target-language corpus — those sentences which translate them. This "select part" of the target-language corpus is studied, looking for forms (freagar-fhocla, word-equivalents) which are more frequent there than in the target-language corpus on average.
If the source-language lemma is uncommon (read: selects less than one-thousandth part of the source language corpus), a warning is issued that the results may not be statistically useful, but no impediment is placed on calculating them.
Each target-language form is given a score by comparing its (relative) frequency in the select part with its (relative) frequency in the whole corpus. If a form turns out to be equally frequent in the select part as in the whole corpus, it is given a score of 100,000; if it turns out to be twice as frequent in the select part as in the whole corpus, it is assigned 200,000; and so on. Forms less frequent in the select part than in the whole corpus are discarded as uninteresting, so that 100,000 is the minimum score among those retained. At the other end of the range, the score 99,999,999 is assigned to any form which is 100 times or more as common in the select part as in the whole corpus.
Even if a target-language form scores within the range 100000..99999999, it is still omitted from the displayed list if its (absolute) frequency is small. This is intended to overcome random collocations, which would decline naturally as more text is added, but may mask more significant data while they remain. An empirical lower cutoff for a form is applied when its (absolute) frequency in the select part is less than the square root of one-tenth of its (absolute) frequency in the whole corpus.
Results are still poor enough with the amount of text available, but will improve as the quantity increases. Even at the present time, however, it may be of interest to input English lemmas from the following list, and to compare the results with the content of existing English–Irish dictionaries, noting what is found in the dictionaries but absent in the corpus, as well as what relevant equivalents are found in the corpus but not in the dictionaries: smoke, minute, also, yet, dog, ice, bee, garden, help, interest, gravel, cave, busy, cell, kitchen, open.
Here, for comparison, are the forms in French, German and Russian which correlate
most strongly with the English lemma child, showing also which books
contribute to the figures, and the frequency of the lemma child in
the English version of each book: