Thank you so much for this detailed response. I have two follow up questions:
The language i am working with is based on Latin with the addition of an extra character (superscript u). With this in mind, could I use the Latin script on the tesseract github repo? Would i have to modify it, or is specifying the characters by hand in the *unicharset *all i need to do? Secondly, my training data are all in image files already. These images were taken from handwritten texts submitted by the communities that speaks the Innu-aimun language. Is it necessary to run the text2image script as the data is already in image form. Or would I have to go through the process of converting these images files to text first and then running the text2script script on the resulting lines of text. Thank you On Thursday, November 16, 2023 at 2:45:18 p.m. UTC-3:30 desal...@gmail.com wrote: > Once you have the starter model, you can produce training materials such > the ground truth sentences. You need at least 100,000 lines of text since > you are going to train from scratch. Once you have those lines of texts, > you will run the text2image script to produce the tif images and box files > which tesseract will use for the training. > > On Thursday, November 16, 2023 at 9:10:52 PM UTC+3 Des Bw wrote: > >> Hi Jephthah, >> >> >> *Creating a starter traineddata: * >> >> >> >> You need: >> >> 1. *unicharset*: you can prepare it by hand. You can take the English >> sample and modify it. >> >> 2. *script*: if the language is written in Latin, you can download the >> latin script from the tesseract GitHub repo ( >> https://github.com/tesseract-ocr/langdata_lstm). If the language uses >> Cyrillic >> <https://github.com/tesseract-ocr/langdata_lstm/blob/main/Cyrillic.unicharset>, >> >> you download the respective script. >> >> *The following are optional: * >> >> >> *3. word*: if you want add word list, you can create a word list. >> >> *4. number*: if you have patterns where numbers appear >> >> *5. punc*: if you have pattern where punctuations appear. >> >> (a 6th one is the redical stroke file. You can download it from the above >> repot. But, my experience is that tesseract creates it automatically.) >> >> >> Assume the name of your language is *Jephthah*: you are going to >> organize those files as: >> >> jep.unicharset >> >> jep.word >> >> jep.pun >> >> jep.num >> >> >> You put these files together in one folder (call it *langModel* for >> simplicity). You create other folders such as *script* and myOutput >> inside *langModel* folder . And, then point your terminal to the >> langModel folder and run *combine_lang_model --input_unicharset >> jep.unicharset --script_dir script --output_dir myOutput --lang jep --words >> jep.word --puncs jep.punc --numbers jep.number* >> >> >> That will produce a traineddata file:* jep.traineddata *inside myOutput >> folder. That is your starter traineddata. >> >> On Thursday, November 16, 2023 at 6:39:28 PM UTC+3 israel...@gmail.com >> wrote: >> >>> Hi Des, >>> >>> I am attempting to walk the same path you just walked and was hoping you >>> could provide me with information on where to start. I want to train / >>> create a new language in tesseract that would recognize texts of that >>> language. How do i create the files you mentioned above? Is there a central >>> wiki with all the info i need to get started? What were the biggest >>> challenges you faced and in your opinion is it feasible to attempt to >>> create a new language? >>> >>> Thank you for your help >>> >>> On Sunday, September 10, 2023 at 2:49:15 p.m. UTC-2:30 >>> desal...@gmail.com wrote: >>> >>>> I am trying to train a new language. I have prepared the all the >>>> necessary files as per the manual. I have also combined them to a trained >>>> data file using the *combine_lang_model command. * >>>> >>>> - I also have my training files such as the text files, box files and >>>> .lsmf files inside oro-ground-truth folder. >>>> >>>> >>>> But, I am having trouble to proceed from there. All the instructions >>>> for training from scratch talk about using tesstrain.sh., which the manual >>>> calls unsupported and outdated. >>>> >>>> - What should I do? Can you guys help me please? >>>> >>> -- You received this message because you are subscribed to the Google Groups "tesseract-ocr" group. To unsubscribe from this group and stop receiving emails from it, send an email to tesseract-ocr+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/tesseract-ocr/dbefcf0c-4239-4531-a075-160350df0098n%40googlegroups.com.
