Re: [sword-devel] Text preparation for searching in SWORD [was: Soft hyphens]

2017-11-03 Thread DM Smith
The purpose of Feature is not to provide info to the user, but rather the engine or front-end. It’s incidental that it is informational to the user. > On Nov 3, 2017, at 3:18 PM, David Haslam wrote: > >> Nothing needs to be specified in the conf to note that a module has soft > hyphens. > >

Re: [sword-devel] Text preparation for searching in SWORD [was: Soft hyphens]

2017-11-03 Thread David Haslam
> Nothing needs to be specified in the conf to note that a module has soft hyphens. Not for functionality, but to inform the module user, it would be sensible to announce: Feature=SoftHyphens Some front-ends list the module's features. cf. Copying from the displayed text might still include th

Re: [sword-devel] Text preparation for searching in SWORD [was: Soft hyphens]

2017-11-03 Thread DM Smith
David, When Troy changed the subject line, he detailed the new strip filter for soft-hyphens and hooked it up to the normalizer for search requests. It will be part of the upcoming release. Nothing needs to be specified in the conf to note that a module has soft hyphens. It was to this thread t

Re: [sword-devel] Text preparation for searching in SWORD [was: Soft hyphens]

2017-11-03 Thread David Haslam
> Do keep up! :-) I'm not a person that watches what's going on in our SVN. It would be mostly "over my head", so I have to rely upon people being kind enough to answer my questions. My programming area of expertise is in a different sphere. Apart from that, it would take up valuable time in

Re: [sword-devel] Text preparation for searching in SWORD [was: Soft hyphens]

2017-11-03 Thread Peter von Kaehne
On Fri, 2017-11-03 at 07:16 -0700, David Haslam wrote: > > And as Troy has noted, the strip filter is yet to be written, though > it's > probably not a mammoth programming task. There is a soft hyphen strip now happening. It was added a few days ago. Do keep up! :-) Peter __

Re: [sword-devel] Soft hyphens

2017-11-03 Thread Michael H
Hi Cyrille, I am preparing to study breakpoints for Cebuano to produce a hunspell hyphenation list, but haven't completed the process of implementing it. I am working from 3 paper Cebuano bibles typeset at different times, and manually copying the existing hyphenated words into a list. Here's my

Re: [sword-devel] Soft hyphens

2017-11-03 Thread Cyrille
It becomes a bit difficult for me to follow this post with all these technical terms in another language :-) :-( But what I can tell you is that I am very interested in a hyphenation dictionary. I have already created a spelling dictionary for kikongo , an

Re: [sword-devel] Text preparation for searching in SWORD [was: Soft hyphens]

2017-11-03 Thread David Haslam
Thinking further in the context of small screens... If in future we were to build a module that included soft hyphens by design, then we really would need to specify two things in the .conf file: 1. Feature=SoftHyphens 2. LocalStripFilter=RemoveSoftHyphens We do need to say something to ensure t

Re: [sword-devel] RC - odd bug, diatheke, lookup, probably engine rather than utilities.

2017-11-03 Thread David Haslam
> There is no way to check automatically for correct references. But any systematic errors which lead to working but incorrect references will likely produce in other places non-working ones. And that is what we need to rely upon. That's a very good point, Peter. David -- Sent from: http://sw

Re: [sword-devel] RC - odd bug, diatheke, lookup, probably engine rather than utilities.

2017-11-03 Thread Peter Von Kaehne
> Von: "David Haslam" > Of course, those references that "work" might not necessarily be correct. There is no way to check automatically for correct references. But any systematic errors which lead to working but incorrect references will likely produce in other places non-working ones. And th

Re: [sword-devel] RC - odd bug, diatheke, lookup, probably engine rather than utilities.

2017-11-03 Thread David Haslam
Of course, those references that "work" might not necessarily be correct. Parsing native references in a cross-reference note is a very challenging programming task. Just because a reference lands somewhere valid within the v11n doesn't mean it's the place the translator intended. But I agree wi

Re: [sword-devel] SWORD 1.8.0RC4

2017-11-03 Thread David Haslam
Thanks Peter, That's good news indeed. David -- Sent from: http://sword-dev.350566.n4.nabble.com/ ___ sword-devel mailing list: sword-devel@crosswire.org http://www.crosswire.org/mailman/listinfo/sword-devel Instructions to unsubscribe/change your s

Re: [sword-devel] Soft hyphens

2017-11-03 Thread David Haslam
I had similar thoughts as Michael outlined. This morning, I compiled an Excel workbook tabulating the Lingala words found to contain a soft hyphen. It has been attached to the issue in the GitLab repo. https://gitlab.com/lafricain79/LinVB/issues/10 And - yes - it's not only incomplete as a dict

Re: [sword-devel] SWORD 1.8.0RC4

2017-11-03 Thread Peter Von Kaehne
> Von: "David Haslam" > Is anyone visiting the CrossWire tracker to update the SWORD API issues that > will be fixed by this release? All bugs I sorted in svn-head I have also marked down as resolved. I can not speak for others. > Does the RC4 include a fix to the UTF8GreekAccents filter?

Re: [sword-devel] SWORD 1.8.0RC4

2017-11-03 Thread David Haslam
Is anyone visiting the CrossWire tracker to update the SWORD API issues that will be fixed by this release? Does the RC4 include a fix to the UTF8GreekAccents filter? cf. That filter was seriously at fault in that it removes characters from non-Greek text too! Best regards, David -- Sent

Re: [sword-devel] RC - odd bug, diatheke, lookup, probably engine rather than utilities.

2017-11-03 Thread Peter Von Kaehne
> Von: "Peter von Kaehne" > . I fixed one and now I am down to > one error message. Fixing the last one made it all go away. Thanks, Troy - this is really helpful. This is of course right now mostly about paths and file loading. Would you think that we could expand generally the debug logging?

Re: [sword-devel] RC - odd bug, diatheke, lookup, probably engine rather than utilities.

2017-11-03 Thread Peter von Kaehne
On Thu, 2017-11-02 at 19:40 -0700, Troy A. Griffitts wrote: > So, Peter, if you'd like to see which files SWORD can't find, you can > try: > SWORD_LOGLEVEL=DEBUG ./lookup KJV Gen.1.1 Thanks - this is actually very illuminating now. This is part of my debug output now on Diatheke: [..] LOOKING UP