RE: [dspace-tech] Re: ssh command with docker dspace-dependencies image

2022-08-03 Thread dcook via DSpace Technical Support
Hi Stefan, No worries. Thanks for the explanation. I think using a different image makes sense for that deployment stage too. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 -Original

RE: [dspace-tech] Installing DSpace on Windows server without internet

2022-07-28 Thread dcook via DSpace Technical Support
I don’t work on DSpace much and I’ve never run it on Windows, but… I think the easiest path would be building DSpace on a Windows server that has an Internet connect, and then zipping DSpace and copying that ZIP to the Windows server without the Internet. In that case, you should only need

RE: [dspace-tech] Re: ssh command with docker dspace-dependencies image

2022-07-27 Thread dcook via DSpace Technical Support
Hi Stefan, As an aside, I’d be curious to hear how you’re using the Gitlab CI/CD tools with DSpace. Are you using “dspace/dspace-dependencies:dspace-7_x” image for the Gitlab Runner container and then SSHing to your target Docker host server to do your Docker deployment? David Cook

Re: [Koha-devel] Loosing owner permissions under koha-testing-docker (solution)

2022-01-26 Thread dcook
I’ve commented on the Gitlab issue but I think what Tomas suggests is a good way to go. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf Of Tomas

Re: [Koha] How to measure and improve Koha performance for our

2022-01-16 Thread dcook
Hi Mike, Great to see another Australian library using Koha! Regarding performance, I'd say the answer is "it depends". It looks like you're running Debian Buster (based on your Apache response), so I'm guessing you used the Debian packages to install Koha? I thought that new instances create

Re: [Koha-devel] Resultsets vs. list context

2022-01-09 Thread dcook
That was really interesting. Sounds like a good call to me. I’ve never really been a fan of ‘wantarray’ black magic anyway. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 F

Re: [Koha-devel] Relooking staff interface (BibLibre sponsoring)

2021-12-15 Thread dcook
This sounds awesome. I don't think that I'll be able to join the group due to timezone issues at a minimum, but happy to offer ideas/feedback or test things from time to time. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office:

Re: [Koha-devel] [Changed topic] Action hooks

2021-12-08 Thread dcook
I’ve been thinking about this more today, and I think that I’m coming around to the plugin idea. I still think it would be a good idea to have an event-driven messaging system, but it seems to me that adding that system will take a lot more work/discussion/thinking/experimenting than just i

Re: [Koha-devel] My dev list for 22.05

2021-12-08 Thread dcook
Hey Nick, What do you mean by a more generic OAuth connector? I’ve already done a lot of authentication work locally and hopefully will do more in the community in the time to come, so happy to collaborate more on that. (I find the hardest part of authentication work is not the code, but

Re: [Koha-devel] [Changed topic] Action hooks

2021-12-02 Thread dcook
That’s cool to hear, Marcel! Happy to share my thoughts. A couple reasons I don’t want to use plugins: 1. I don’t want to turn on Koha plugins for 100+ different Koha instances around the world. a. Overall, I think the Koha plugin system is insecure, and allows library staff too mu

Re: [Koha-devel] My dev list for 22.05

2021-12-01 Thread dcook
Hey Jonathan, Thanks for reaching out. We recently did a phpBB to Discourse move that's been live about a week now, so I'm happy to share my recent knowledge and experience for the "mailman2discourse" task. Other than that, I'm not sure how much help I have to give. I have a small interest i

Re: [Koha] Koha with Centos7

2021-11-22 Thread dcook
Hey Russel, If you have to use Centos7, you might consider using Docker to run Koha in a Debian or Ubuntu container, since Docker should be available in Centos7. While running Koha in Docker isn't officially supported by the community, it is a potential solution. You would need to be skilled wi

Re: [Koha-devel] Discourse forum / mailing list

2021-11-21 Thread dcook
In the end, I didn't write my own auth plugin. I could get Discourse to recognize it, but didn't seem to register it as an auth provider. I went with a third-party plugin which achieved the same goal though, so I was happy enough. Wasn't worth spending more time on it at the time. We've just ab

Re: [Koha-devel] Fwd: Rabbitmq

2021-11-16 Thread dcook
For what it’s worth, I have other projects where I run RabbitMQ in a separate container, and it’s so nice having that separation. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595

Re: [Koha-devel] Fwd: Rabbitmq

2021-11-16 Thread dcook
You always say what I want to hear… heh. Yeah, I like the idea of ktd using an external rabbitmq container. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel

Re: [Koha-devel] Discourse forum / mailing list

2021-11-16 Thread dcook
Thanks, Frido. Oh I'm just writing a custom auth plugin as we have some software that integrates a particular way with our existing mail/forum software (ie phpBB). A friend of mine asked me abut a coding bootcamp that uses Ruby and I said that Ruby isn't used that much these days (Perl develop

Re: [Koha-devel] Discourse forum / mailing list

2021-11-16 Thread dcook
The Discourse installer is very opinionated but feel free to give it a go! David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf Of Tomas Cohen Arazi Se

[Koha-devel] Discourse forum / mailing list

2021-11-15 Thread dcook
Hi folks, I'm still working on using Discourse locally so I figured I'd share my experiences. Overall, I like the functionality well enough so far, although it can be annoying to setup and develop against (ie for plugins). We should feel good about koha-testing-docker, because it works very

Re: [Koha-devel] custom core patches management

2021-11-03 Thread dcook
I would actually be a bit more interested in git based deployments if we fixed up the directory layout for the Koha codebase. One downside to the git approach is that you’ll also need to manually update generated configuration files. Not a big problem for small scale deployments, but not so

Re: [Koha-devel] custom core patches management

2021-11-02 Thread dcook
Hi David, I won’t make a comment on good vs bad strategies, as those are just subjective judgements, and ultimately it really all depends on your context. However, it sounds like you’re making a lot of work for yourself with those files. Using git commands, you could extract equivalents o

Re: [Koha-devel] Replacement of mailman (mailing lists)

2021-11-01 Thread dcook
Did we have any further discussion about Discourse? I’ve decided to use it for a different project, so I’ve looked at setting it up today. The installation instructions aren’t perfect, so I had to do some of my own troubleshooting, and they use custom scripts to orchestrate instead of using

[Koha-devel] Automatic Renewal Digests not working in 21.05.03

2021-10-21 Thread dcook
Hi all, Has anyone got Automatic Renewal Digests to work? I've looked at the code and at a glance it looks fine in 21.05.03, but emails aren't going out when Digests are selected. Emails go out fine without the Digests selected. Before I dig into the guts of it, I figured I'd ask if anyone

Re: [Koha-devel] Built-in offline circulation interface

2021-10-17 Thread dcook
Does that mean that you actually have a lot of people using the desktop application? Interesting! David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf

[Koha-devel] Issues fetching from Koha Git due to Let's Encrypt root certificate expiry

2021-10-05 Thread dcook
Hi all, Some people might have found they aren't able to fetch from the Koha Git (in koha-testing-docker for instance). They might be getting the following error: fatal: unable to access 'https://git.koha-community.org/Koha-community/Koha.git/': server certificate verification failed. CAfil

[Koha-devel] More handy fixes in Zebra 2.2.3

2021-10-04 Thread dcook
Hi all, Does it ever drive you crazy that you can't see what Zebra has indexed when using ICU (whereas you can with CHR)? I raised an issue via Github, and it looks like Adam has fixed the issue in Zebra 2.2.3 (released yesterday). https://github.com/indexdata/idzebra/commit/6fb12448757

[Koha-devel] Klaro

2021-09-27 Thread dcook
Hi all, Does anyone have any experience with Klaro? https://heyklaro.com/ I've noticed that DSpace uses it, and I think that I've noticed other projects using it in the past for things like cookie consent. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen S

Re: [Koha-devel] Listing Zebra (and Elasticsearch) indexes for end-users' benefit

2021-09-08 Thread dcook
Hi Andrew, Thanks for sharing that manual page. It actually reminds me that there’s a difference too between Zebra indexes and CCL qualifiers. For instance 030 is indexed into CODEN, but CODEN isn’t a CCL qualifier, so you can’t use it for searching. That certainly adds an extra wrinkle…

Re: [Koha-devel] Listing Zebra (and Elasticsearch) indexes for end-users' benefit

2021-09-08 Thread dcook
Thanks for sharing that. I look forward to looking at it more if/when I make that plugin. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 -Original Message- From: Fridolin SOMERS S

[Koha-devel] REST API + DataTables

2021-09-06 Thread dcook
Thanks, Mark. That would be great! David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 -Original Message- From: Koha-devel On Behalf Of Mark Hofstetter Sent: Monday, 6 September 2021 9:

Re: [Koha-devel] Immediate logout in Koha 21.05.02 (03?)

2021-09-05 Thread dcook
What's your base URL system preferences? If they're HTTPS, then a Secure Cookie should be set I think, which won't be sent over a HTTP connection. That kind of sounds like what is going on. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Aust

[Koha-devel] REST API + DataTables

2021-09-02 Thread dcook
Hi all, Do we have any examples of using the Mojolicious REST API to provide data for DataTables in Koha? I think the answer is probably no since the DataTables calls aren't really RESTful. Yet, we have this growing API, and we want to use that API to make more efficient user interface

Re: [Koha-devel] Replacement of mailman (mailing lists)

2021-08-18 Thread dcook
It does seem like Discourse is reasonably popular although I’ve only engaged with it from the forum perspective. It looks like it does have mailing list support but I don’t know what that means exactly. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons

[Koha-devel] Listing Zebra (and Elasticsearch) indexes for end-users' benefit

2021-08-18 Thread dcook
Hi all, As always, a new day brings a new Zebra idea. One of my librarians asked me if there was any way to get a list of Zebra indexes (particularly for Record Matching Rules), and I was all prepared to say no. when I remembered something I read the other day. It turns out you can sen

Re: [Koha-devel] Improvement of our upgrade process

2021-08-17 Thread dcook
Sounds good to me. Is there a time when older versions will be taken out of updatedatabase.pl? At the moment, updatedatabase.pl is over 20,000 lines long. Maybe we could move the old entries into a 3to2105.pl script? David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6

Re: [Koha-devel] systemd version of koha-plack-ctl.sh ?

2021-08-16 Thread dcook
I don’t know of any file called “koha-plack-ctl.sh”? As for systemd, while I’ve previously used systemd with Koha, I try to avoid it these days, since different environments will have different init systems. For example, your average Docker container doesn’t have an init system running. Rece

[Koha-devel] Previewing editor content in "News"

2021-08-11 Thread dcook
Hi all, Lately, I've been thinking that it would be great if we could preview content from WYSIWYG editors in context before saving and showing it live. Content Management Systems and Wikis usually let you do that, and I think it would be really useful. I know that I've had at least a few l

Re: [Koha-devel] Replacing jQueryUI autocomplete

2021-08-11 Thread dcook
Sadly, I don't have anything useful to add about autocomplete libraries, but you've sent me down an interesting rabbit hole about jQuery UI! I won't bore you with my journey, but after reading through a few big conversations I wound up at the jQuery UI Github and I was surprised that there's b

Re: [Koha-devel] Zebra Trivia

2021-08-10 Thread dcook
Hahaha. That made my morning, Frido. I have no idea why Identifier-standard is set up that way. It might be worth doing a git-blame at some point. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005

Re: [Koha-devel] Check of syspref editor with DB columns

2021-08-10 Thread dcook
Good questions, Fridolin. I ended up adding sort1 and sort2 locally to borrowers.json. I've been so busy I hadn't even thought of upstreaming yet I think. David Cook Senior Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Onlin

[Koha-devel] Advanced Editor for Authority Records

2021-08-03 Thread dcook
Hi all, Does anyone know why the Advanced Editor in cataloguing is only for bibliographic records and not for authority records as well? Does anyone know if there is work to add an Advanced Editor for the authority records too? Thanks, David Cook Senior Software Engineer Prosentie

[Koha-devel] mysqldump: Error: 'Access denied; you need (at least one of) the PROCESS privilege(s) for this operation' when trying to dump tablespaces

2021-07-29 Thread dcook
Hi all (especially Jonathan), I was looking at https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=23329#c85 where Jonathan points out under MySQL 8 that we’re now getting this error with dumping the database: “mysqldump: Error: 'Access denied; you need (at least one of) the PROCES

Re: [Koha] Searching databases from the Koha Library Catalogue

2021-07-22 Thread dcook
Hi Lizelle, Thanks for reaching out. That's a big question, and there are a lot of different answers, depending on your situation. One option is to get your database vendor to supply you with MARC records that you can import into your Koha. Depending on who provides your database content, t

[Koha-devel] Zebra Trivia

2021-07-21 Thread dcook
Hi all, Today I learned (or maybe re-learned) something about Zebra CCL syntax: "Identifier-standard,phr" does not do a phrase search. It does a word list search. Now you might this this is impossible, but it's not, because Identifier-standard is hard-coded with 4=6 in ccl.properties: Ident

Re: [Koha-devel] Helper/Static methods for objects

2021-07-18 Thread dcook
Thanks, Nick. I added a comment on 20817 about why I think static/class methods are preferable to a Util module. Cheers, David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From

Re: [Koha] Koha Concurrent and Simultaneous Use of Records

2021-07-08 Thread dcook
Hi Charles, No worries. I wish you well with your cloud migration. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Charles Kelley Sent: Friday, 9 July 2021 11:33 AM To: d

Re: [Koha] Koha Concurrent and Simultaneous Use of Records

2021-07-08 Thread dcook
Hi Charles, Koha uses the "The ever popular do-nothing-approach". In theory, this is problematic and certainly bothers me, but in practice I think it's fairly rare that two staff members are working on the same record at the same time. Locking and lock timeouts come with a lot of complexity, an

Re: [Koha] Authority records vie OAI-PMH

2021-06-28 Thread dcook
Hi Michal, At the moment, Koha only provides MARC bibliographic records via OAI-PMH, but I am intrigued by the prospect of providing authority records. I think we'd probably have to provide a new endpoint for that though, as I don't think we could make the current endpoint backwards compatible

Re: [Koha-devel] Add multi-branch support to AutoSelfCheckAllowed

2021-06-27 Thread dcook
Actually, what I was thinking was possibly adding a field to the “branches” table to specify a user to use, and not requiring a password. Of course, if you don’t require a password, someone could specify any user they want, so that won’t work either. David Cook Software Engineer Prosentie

Re: [Koha-devel] Add multi-branch support to AutoSelfCheckAllowed

2021-06-27 Thread dcook
Tomas: I knew you were going to say that heh. Does the configurations table have a password field type available? Katrin: I hadn’t seen that one, but I’ll comment there. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office

[Koha-devel] Add multi-branch support to AutoSelfCheckAllowed

2021-06-22 Thread dcook
AutoSelfCheckAllowed is a useful system preference, but it really only works if you have 1 branch. Lots of libraries have multiple branches. We have a local customization to get around this but I don't love it. How do people think Koha could have multi-branch support for AutoSelfCheckAllowed?

Re: [Koha-devel] some thoughts on #28519 regarding lib

2021-06-15 Thread dcook
Speaking of benefits, I have a different Perl project I support and develop, and it stores all its Perl modules in a "./lib" directory, and I'm able to easily run my app from a git checkout or a package deployment. The only difference is path configuration. Also, while I have provided dependen

Re: [Koha-devel] some thoughts on #28519 regarding lib

2021-06-15 Thread dcook
Ditto what Jonathan said. CGI::Session::Serializer::yamlxs is 100% a Koha module at this point. Doesn't exist on CPAN. In this case, I created #28519 to make it easier to use additional namespaces beyond C4 and Koha (and historically OpenILS) without having to update Makefile.PL. Of course, I

Re: [Koha-devel] Sharing installation method with Hea

2021-06-14 Thread dcook
I was wondering if Koha already had that data, but I'm not so sure. I am thinking that "make install" would perhaps create a file containing the index method, and the Debian package build could overwrite that. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point

[Koha-devel] Sharing installation method with Hea

2021-06-14 Thread dcook
Hi all, I was looking at https://hea.koha-community.org/systempreferences to view the different versions of Koha out there, and it got me thinking how it would be nice to know how people install Koha. I imagine that we all think that the majority of people use the Debian packages, but it wo

Re: [Koha-devel] Notes about Docker Swarm / Portainer and Koha

2021-06-14 Thread dcook
Sounds like a plan to me. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 From: Koha-devel On Behalf Of Tomas Cohen Arazi Sent: Saturday, 12 June 2021 1:05 AM To: koha-devel Subje

Re: [Koha] Identifying Records with Non-Roman Characters

2021-06-07 Thread dcook
Hi Charles, I'm not 100% sure what you're asking here. Are you asking to find all records where there is a 245 title that isn't Romanized? You could try something like this: SELECT * FROM biblio WHERE title <> CONVERT(title USING latin1); I've tried that out on one of my multilingual librar

Re: [Koha-devel] Increasing Debian Package Compatibility Levels

2021-06-06 Thread dcook
Note that those warnings are from Debian Stretch. Since it's oldstable, it's probably still OK to be building on it. What OS do the Koha CI servers use? David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 O

[Koha-devel] Increasing Debian Package Compatibility Levels

2021-06-06 Thread dcook
Hi all, I've been noticing lately some of the following warnings when I'm building Koha Debian packages: dh_install: Compatibility levels before 9 are deprecated (level 7 in use) dh_installdocs dh_installdocs: Compatibility levels before 9 are deprecated (level 7 in use) dh_installchang

Re: [Koha-devel] Question about Koha Session

2021-06-01 Thread dcook
Glancing at https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=27113, I don’t know why a person would need to use a session object. Happy for that to be explained. (Technically, it doesn’t look like it’s actually doing anything useful with CGI::Session, since it looks like it’s just throw

[Koha-devel] Looking for feedback on approach to Bug 28457 cleanup_database.pl

2021-05-26 Thread dcook
Hi all, I was wondering if someone could give me some feedback on "Bug 28457 - cleanup_database.pl self-registration options are not configurable" (https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=28457) I like the patch I wrote there, but I wanted to see what other people thought

Re: [Koha-devel] Thoughts on reloading Koha plugins

2021-05-26 Thread dcook
That’s interesting, Galen. If I recall correctly, loading libraries in PHP doesn’t load them into PHP per se but rather inserts the code into the PHP script itself. I suppose in that way maybe you could cache and invalidate individual scripts and not have to worry about “unloading modules”.

Re: [Koha-devel] Thoughts on reloading Koha plugins

2021-05-25 Thread dcook
Hmm interesting. I see instructions on setting up Wordpress with FastCGI but no comments about any impact that would have on plugins. Maybe they just don't worry about it the same way most Koha folk don't worry about it hehe. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Gl

[Koha-devel] Thoughts on reloading Koha plugins

2021-05-25 Thread dcook
Hi all, It seems to me that installing Koha plugins is easy enough. Each Starman process will load the plugin into memory because it hasn't seen it before. However, if you're updating/upgrading a plugin, each Starman process has already loaded it, so it won't know that it needs to reload i

Bug#988750: YAML dependencies should be optional/suggested

2021-05-23 Thread dcook
Thanks for looking into this, gregor. I'm looking forward to Tina's response as well. David Cook -Original Message- From: gregor herrmann Sent: Saturday, 22 May 2021 3:35 AM To: dc...@prosentient.com.au; 988...@bugs.debian.org Subject: Re: Bug#988750: YAML dependencies should be optiona

Re: [Koha] Koha API - Authentication Failure

2021-05-19 Thread dcook
That KohaRest driver looks interesting! I haven't dug into it too deeply, but how do you handle the user/patron authentication? Do you have the user log into VuFind and at that point you use the backend confidential client user to validate it via your plugin API endpoint? Have you thought about

Re: [Koha-devel] Koha logging out staff users

2021-05-19 Thread dcook
SessionStorage is MySQL. It's random, and after review it seems like it's just happening for one library. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 0595 -Original Message- From: Koha-de

[Koha-devel] Koha logging out staff users

2021-05-19 Thread dcook
Hi all, Does anyone have an issue where staff users are being logged out of Koha? The session timeout threshold is 1d, and AutoLocation and SessionRestrictionByIP are both disabled. I can't think of any reason why they're getting logged out. I also cannot reproduce the problem on m

Bug#988750: YAML dependencies should be optional/suggested

2021-05-18 Thread dcook
Package: libcgi-session-serialize-yaml-perl Version: 4.26-2 The Debian package requires that libyaml-perl or libyaml-syck-perl be installed, but it is possible to use this package without either of those YAML modules. You can specify your own YAML parser (like YAML::XS). There is some discussion

Re: [Koha-devel] PUT /holds/:hold_id

2021-05-17 Thread dcook
I’m not sure that I have much to contribute. One comment I would have is… what is the threshold for creating a V2 of the REST API? And maybe a breaking change for the API is OK for a major version change in Koha but just not a minor version change? (That said, I’ve encountered breaking

[Koha-devel] master not handling errors correctly

2021-05-12 Thread dcook
Hi all, I was working on https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=28325, when I noticed some really weird things going on with Koha's HTTP errors. Look at http://localhost:8081/mojo. While Koha will say it's a 404, it's actually sending back a 200 response. That's not good

Re: [Koha-devel] Build a roadmap for 21.11

2021-05-11 Thread dcook
I've been struggling with energy/motivation for Koha outside of work hours, but I am still interested in working on "Replace CGI scripts with Mojolicious controllers" and to a lesser extent "Task Scheduler Needs Re-write". I'll put aside an hour tonight after work to try to get back into "Repla

Re: [Koha-devel] TT loop count VS size

2021-05-09 Thread dcook
I know that .count is an object method, but I don’t understand the problem that Fridolin is having. I don’t see any problem at this point. David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online: 02 8005 05

Re: [Koha-devel] TT loop count VS size

2021-05-09 Thread dcook
I was going to say… I’d never even heard of the “count” call in TT. Looking at http://template-toolkit.org/docs/manual/VMethods.html, it’s not a method for a data structure. Looking at http://template-toolkit.org/docs/manual/Directives.html#section_FOREACH, it’s only a method of the “loop” vari

[Koha-devel] Embedding JSON data in HTML

2021-05-04 Thread dcook
Hi all, I was just reflecting on bugs like https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=26942 and reviewing https://developer.mozilla.org/en-US/docs/Web/HTML/Element/script when I saw the following method for embedding JSON in HTML: {"userId":1234,"userName":"John Doe","membe

Re: [Koha-devel] Why is config ($KOHA_CONF) stored in memcached ?

2021-05-03 Thread dcook
Oh I am very interested. I've been wanting to get rid of XML::Simple for many years, and this would be a huge step forward. I'll have to review this sometime... David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW 2061 Australia Office: 02 9212 0899 Online:

[Koha-devel] HTTP/HTTPS cheme in Base Path in API documentation

2021-05-02 Thread dcook
Hi all, I just noticed on a HTTPS site that the Base URL at /api/v1/.html was listed as HTTP rather than HTTPS. Looking at Mojolicious::Plugin::OpenAPI, it seems that it's hard-coded to HTTP *if* a scheme isn't specified in the spec: https://github.com/jhthorsen/mojolicious-plugin-openapi/blob/ma

Re: [Koha-devel] Why is config ($KOHA_CONF) stored in memcached ?

2021-05-02 Thread dcook
Sounds good to me. I don’t recall how long the Koha conf has been stored in Memcached, but it would have benefited CGI Koha since every HTTP request would’ve done a disk read. But I think we’ve pretty much moved on from CGI now, so +1 to only reading koha-conf.xml once at startup. This c

Re: [Koha-devel] Optimizing Starman startup

2021-04-28 Thread dcook
There's a number of things that are improved. I should say this testing was done with a custom Koha 19.11. First is speed, so 20 seconds to (re)start 120 workers with 20 CPUs without validation instead of taking 2 min 45 seconds w/o 24700 patch and 1 min 30 seconds w/ 24700 patch with 10 CPUs.

Re: [Koha-devel] Template::Toolkit and Translations

2021-04-27 Thread dcook
I think I'll leave the internationalization to folk who can remember it better than me. As for lists... the key thing is supplying the full ISO 639-2 (or MARC Code List for Languages) to Koha, since that's what is being used to populate the bibliographic records. David Cook Software Engineer P

Re: [Koha-devel] Optimizing Starman startup

2021-04-27 Thread dcook
But now that I think about it again... Jan's change is actually all we need. Within Koha, we could do the checksum calculation, and then skip the validation if we have a local record that our schema has already been validated. (I guess we'd set the cache after Mojoliciou::Plugin::OpenAPI success

Re: [Koha-devel] Optimizing Starman startup

2021-04-27 Thread dcook
Based on my request, Jan has added an option to skip validation (https://github.com/jhthorsen/mojolicious-plugin-openapi/commit/673079d19f827ce8c8ab3a2943a4abc798fa1e18). However, he doesn't seem to want to implement my cache idea. He has said that he's willing to consider a PR, so I'll look a

Re: [Koha-devel] Optimizing Starman startup

2021-04-26 Thread dcook
After more experimenting, I have concluded that JSON::Validator->validate() is the culprit in terms of CPU time and memory usage. Fortunately, I’ve determined that Mojo::JSON and Digest::MD5 can be used together to create consistent reproducible checksums, which could be used for caching va

Re: [Koha-devel] Template::Toolkit and Translations

2021-04-26 Thread dcook
Hi Julian, I like part of what you've suggested here. I still think that putting languages (with codes and name in native text) in the database is a good idea, as it allows the ability to add languages to Koha without a code change. Unless Koha is going to be perfectly comprehensive with langua

Re: [Koha-devel] Optimizing Starman startup

2021-04-26 Thread dcook
After some more experimenting, it’s clear that the problem isn’t JSON::Validator::OpenAPI::Mojolicious or Koha::REST::Plugin::PluginRoutes. If you exclude Mojolicious::Plugin::OpenAPI, the startup is very fast. It’s 30 seconds start to finish to restart 60 instances and each instance restarts ve

Re: [Koha-devel] Optimizing Starman startup

2021-04-26 Thread dcook
So I just tried the following… -- root@kohadevbox:koha(master)$ npm install -g swagger-cli /usr/bin/swagger-cli -> /usr/lib/node_modules/swagger-cli/swagger-cli.js npm WARN @apidevtools/swagger-parser@10.0.2 requires a peer of openapi-types@>=7 but none is installed. You must install pee

Re: [Koha-devel] Optimizing Starman startup

2021-04-25 Thread dcook
I think that I accidentally offended him, as he hasn’t responded to me since his initial response. I do wonder if reducing the number of references would help, although I wonder how easy that would be to do in practice. It looks like we have about 5767 lines of JSON all up as is… so it woul

[Koha-devel] Template::Toolkit and Translations

2021-04-25 Thread dcook
Hi all, While I mostly work in English, I occasionally do support libraries in other languages like French, Arabic, and Chinese. And more recently I’ve been looking at the Languages dropdown in the OPAC advanced search. In the templates, I notice that we often translate HTML, but what if we

Re: [Koha-devel] Deleting entries from language_descriptions

2021-04-25 Thread dcook
Hi Katrin, I was thinking it would be good to change the structure to make it easier for translators, although that could also make it significantly harder for libraries to add missing languages too. I have a library that wanted to add Bosnian and Maltese, so I was able to just give the

[Koha-devel] Deleting entries from language_descriptions

2021-04-22 Thread dcook
Hi all, I was looking at how to add languages to the Languages drop down in the OPAC advanced search and went down an unpleasant C4::Languages rabbithole… But looking at language_descriptions, I’m wondering if perhaps we could delete the following data, as I imagine it’s very outdated and u

Re: [Koha-devel] Optimizing Starman startup

2021-04-21 Thread dcook
Hi Ere, I think you're right about the refs. While they get resolved by the OpenAPI plugin, you probably have to resolve them before trying to dynamically inject the routes from plugins. Jan Thorsen (the author of Mojolicious::Plugin::OpenAPI and JSON::Validator) thinks that the ref resolutio

Re: [Koha-devel] Optimizing Starman startup

2021-04-21 Thread dcook
It's too bad that we're not using Unix sockets out of the box (like we do with Starman) as that would make Bug 26625 less pressing but maybe I'll look more at that... The only downside with starting Koha as a Mojolicious application at the moment seems to be the experimentalness of it. I'm wond

Re: [Koha-devel] Packaging idea (for decoupling systems, Docker, etc)

2021-04-21 Thread dcook
I like to think that we’re two peas in a pod. (I don’t know why I use so many English idioms on the listserv. I swear that I don’t actually use them in my every day life.) I’m not sure how easy it is to split a package up with DEB packages but it’s so easy with RPM packages. I feel like ther

Re: [Koha-devel] Optimizing Starman startup

2021-04-21 Thread dcook
He did answer back fairly quickly but not a very helpful way. Maybe I just wasn’t asking the right questions. Agreed. I wish that we kept up better with Mojolicious. I was actually wondering why we don’t use Hypnotoad for the REST API. Is it just because of the extra process management?

Re: [Koha-devel] Optimizing Starman startup

2021-04-20 Thread dcook
It looks like newer version of the plugin might have cached spec/schema functionality, but I'm not finding the plugin author very helpful so far. My guess is that maybe... maybe... Mojolicious::Plugin::OpenAPI 3.41+ with JSON::Validator 4.10+ might perform better. But it's just a guess at this

Re: [Koha-devel] Optimizing Starman startup

2021-04-20 Thread dcook
Looking at newer versions of Mojolicious::Plugin::OpenAPI and the coding choices are... interesting. I opened a ticket against JSON::Validator (https://github.com/jhthorsen/json-validator/issues/246), but maybe I should open it against Mojolicious::Plugin::OpenAPI. We'll see how responsive the

Re: [Koha-devel] Optimizing Starman startup

2021-04-20 Thread dcook
That was an interesting experience. When you run koha-plack --start, it spins through a long list of instances quickly, because it returns immediately after starting the Starman master, which doesn't really do much, but fork off worker processes, which then consume a huge amount of resources co

Re: [Koha-devel] Optimizing Starman startup

2021-04-20 Thread dcook
Thanks for that optimization. My restart time has gone from 2 minutes 45 seconds to 1 minute 30 seconds. Much better. Now I'm going to try the preload and see if I can get it down to 45 seconds or better... David Cook Software Engineer Prosentient Systems Suite 7.03 6a Glen St Milsons Point NSW

Re: [Koha-devel] Optimizing Starman startup

2021-04-20 Thread dcook
Hi Ere, Thanks for your reply. 24700 looks much better. I'll look at backporting it locally. Although I'm looking at JSON::Validator::OpenAPI::Mojolicious at https://metacpan.org/pod/release/JHTHORSEN/Mojolicious-Plugin-OpenAPI-2.19/lib/JSON/Validator/OpenAPI/Mojolicious.pm and it says "Do not

[Koha-devel] Optimizing Starman startup

2021-04-19 Thread dcook
Hi all, Do you despair when you see the following periodically in "top" when a starman worker is recreated ? PID USER PR NIVIRTRESSHR S %CPU %MEM TIME+ COMMAND 9529 my-koha 20 0 460108 197212 17172 R 100.0 0.4 0:03.41 /usr/share/koha/api/v1/app.pl Or th

Re: [Koha-devel] Packaging idea (for decoupling systems, Docker, etc)

2021-04-19 Thread dcook
Hi Mason, [FYI this started as a response and turned into a stream-of-consciousness.][Also really keen to hear from Tomas and Agustin about their work with Docker/Kubernetes/Helm/etc.] The idea with "koha-core" was to separate out the third-party systems away from the core application. In this

  1   2   3   4   5   >