Re: #2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-27 Thread Ihor Radchenko
Ihor Radchenko writes: >> The time will be the same: 9pm SG time (4pm Moscow; 8am New York; 1pm >> London). Sat, Mar 26 >> >> I will post the link to the meeting one hour before the meeting start. > > Here is the link https://teamjoin.de/Org-dev-profiling-20220326-d708k The recording is availabl

Re: #2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-26 Thread Ihor Radchenko
Ihor Radchenko writes: > The time will be the same: 9pm SG time (4pm Moscow; 8am New York; 1pm > London). Sat, Mar 26 > > I will post the link to the meeting one hour before the meeting start. Here is the link https://teamjoin.de/Org-dev-profiling-20220326-d708k Best, Ihor

Re: #2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-24 Thread Ihor Radchenko
"Bruce D'Arcus" writes: >> I plan to try once more providing a more general introduction to Org >> (and Emacs) debugging. Tentatively, I plan to talk about: >> 1. Running Emacs with clean configuration + latest version of Org >> 2. Bisecting config to find configuration-related issues >> 3. Using

Re: #2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-24 Thread Matt Price
On Thu, Mar 24, 2022 at 7:28 AM Bruce D'Arcus wrote: > On Wed, Mar 23, 2022 at 7:10 AM Ihor Radchenko wrote: > > > > Dear all, > > > > There were several people who came to the last meetup looking for > > information about debugging Org mode. The last meetup was rather > > unhelpful in this rega

Re: #2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-24 Thread Bruce D'Arcus
On Wed, Mar 23, 2022 at 7:10 AM Ihor Radchenko wrote: > > Dear all, > > There were several people who came to the last meetup looking for > information about debugging Org mode. The last meetup was rather > unhelpful in this regard since we dove into a specific use-case. > > I plan to try once mor

Re: #2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-24 Thread Ihor Radchenko
Ihor Radchenko writes: > The time will be the same: 9pm SG time (4pm Moscow; 8am New York; 1pm > London). Sat, Mar 26 **8am New York -> 9am I missed the day saving time compared to the last meeting. Best, Ihor

#2 Org mode profiling meetup on Sat, Mar 26 (was: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature)))

2022-03-23 Thread Ihor Radchenko
Dear all, There were several people who came to the last meetup looking for information about debugging Org mode. The last meetup was rather unhelpful in this regard since we dove into a specific use-case. I plan to try once more providing a more general introduction to Org (and Emacs) debugging.

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-03-19 Thread Ihor Radchenko
Max Nikulin writes: > It is up to you to choose at which level your prefer to optimize the > code. And it is only my opinion (I do not insist) that benefits from > changes in low level code might be much more significant. I like the > idea of markers, but their current implementation is a sour

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-03-03 Thread Max Nikulin
On 02/03/2022 22:12, Ihor Radchenko wrote: Max Nikulin writes: I tend to agree after reading the code again. I tried to play around with that marker loop. It seems that the loop should not be mindlessly disabled, but it can be sufficient to check only a small number of markers in front of the ma

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-03-02 Thread Ihor Radchenko
Max Nikulin writes: > On 27/02/2022 13:43, Ihor Radchenko wrote: >> >> Now, I did an extended profiling of what is happening using perf: >> >> 6.20% [.] buf_bytepos_to_charpos > > Maybe I am interpreting such results wrongly, but it does not look like > a bottleneck. Anyway thank you v

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-03-02 Thread Max Nikulin
On 27/02/2022 13:43, Ihor Radchenko wrote: Now, I did an extended profiling of what is happening using perf: 6.20% [.] buf_bytepos_to_charpos Maybe I am interpreting such results wrongly, but it does not look like a bottleneck. Anyway thank you very much for such efforts, however it

Re: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-26 Thread Ihor Radchenko
Ihor Radchenko writes: > Ihor Radchenko writes: > >> Ihor Radchenko writes: >> >>> Ihor Radchenko writes: >>> Dear all, Since there is at least a couple of people who might be interested, lets try to meet online on jitsi and debug performance issues you experience beca

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-26 Thread Ihor Radchenko
Max Nikulin writes: >> Max Nikulin writes: >>> Actually I suspect that markers may have a similar problem during regexp >>> searches. I am curious if it is possible to invoke a kind of "vacuum" >>> (in SQL parlance). Folding all headings and resetting refile cache does >>> not restore performance

Re: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-26 Thread Quiliro Ordóñez
I am not sure if I am helpful. But I am an org user. I am not a developer. I would like to contribute any testing. Currently I use version 9.3. I do not want to install anything which is outside my operating system distribution software versions (Hyperbola GNU 0.4). I am also unable to use m

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-26 Thread Jean Louis
Open up XMPP group for Org mode, that Jabber chat is lightweight and accessible through Emacs jabber.el and plethora of other applications. Don't forget to include Org links to XMPP groups. On February 22, 2022 5:33:13 AM UTC, Ihor Radchenko wrote: >Samuel Wales writes: > >> i have been deal

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-26 Thread Max Nikulin
On 26/02/2022 14:45, Ihor Radchenko wrote: I think we have a misunderstanding here. That page does not contain much of technical details. Rather a history. Thank you for clarification. Certainly originally I had a hope to get some explanation why it was not implemented in a more efficient way

Re: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-26 Thread Ihor Radchenko
Ihor Radchenko writes: > Ihor Radchenko writes: > >> Ihor Radchenko writes: >> >>> Dear all, >>> >>> Since there is at least a couple of people who might be interested, lets >>> try to meet online on jitsi and debug performance issues you experience >>> because of Org mode. Probably some time t

Re: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-26 Thread Ihor Radchenko
Ihor Radchenko writes: > Ihor Radchenko writes: > >> Dear all, >> >> Since there is at least a couple of people who might be interested, lets >> try to meet online on jitsi and debug performance issues you experience >> because of Org mode. Probably some time this Saturday (Feb 26). I am >> thin

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-25 Thread Ihor Radchenko
Max Nikulin writes: > Thank you, Ihor. I am still not motivated enough to read whole page but > searching for "interval" (earlier I tried "overlay") resulted in the > following message: > > Message-ID: <9206230917.aa16...@mole.gnu.ai.mit.edu> > Date: Tue, 23 Jun 92 05:17:33 -0

Re: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-25 Thread Ihor Radchenko
Ihor Radchenko writes: > Dear all, > > Since there is at least a couple of people who might be interested, lets > try to meet online on jitsi and debug performance issues you experience > because of Org mode. Probably some time this Saturday (Feb 26). I am > thinking about 9pm SG time (4pm Moscow

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-25 Thread Max Nikulin
On 23/02/2022 23:35, Ihor Radchenko wrote: Max Nikulin writes: +;; the same purpose. Overlays are implemented with O(n) complexity in +;; Emacs (as for 2021-03-11). It means that any attempt to move +;; through hidden text in a file with many invisible overlays will +;; require time scaling w

Re: Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-23 Thread Kaushal Modi
On Wed, Feb 23, 2022 at 7:37 AM Ihor Radchenko wrote: > > Dear all, > > Since there is at least a couple of people who might be interested, lets > try to meet online on jitsi and debug performance issues you experience > because of Org mode. Probably some time this Saturday (Feb 26). I am > thinki

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-23 Thread Ihor Radchenko
Max Nikulin writes: >> +;; the same purpose. Overlays are implemented with O(n) complexity in >> +;; Emacs (as for 2021-03-11). It means that any attempt to move >> +;; through hidden text in a file with many invisible overlays will >> +;; require time scaling with the number of folded regions

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-23 Thread Max Nikulin
On 22/02/2022 12:33, Ihor Radchenko wrote: I am wondering if many people in the list experience latency issues. Ihor, it is unlikely the feedback that you would like to get concerning the following patch: Ihor Radchenko. [PATCH 01/35] Add org-fold-core: new folding engine. Sat, 29 Jan 2022

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-23 Thread Ihor Radchenko
Matt Price writes: >> Note that org-context is an obsolete function. Do you directly call it >> in your config? Or do you use a third-party package calling org-context? >> > > Hmm. I don't see it anywhere in my ~.emacs.d/elpa~ directory or in my > config file. I also went through ORG-NEWS and wh

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-23 Thread Matt Price
On Wed, Feb 23, 2022 at 12:22 AM Ihor Radchenko wrote: > Matt Price writes: > > >>20128 80% - redisplay_internal (C function) > >> 7142 28% - assq > >> 908 3% - org-context > > Note that org-context is an obsolete function. Do you directly call it > in your config

Org mode profiling meetup on Sat, Feb 26 (was: profiling latency in large org-mode buffers (under both main & org-fold feature))

2022-02-23 Thread Ihor Radchenko
Dear all, Since there is at least a couple of people who might be interested, lets try to meet online on jitsi and debug performance issues you experience because of Org mode. Probably some time this Saturday (Feb 26). I am thinking about 9pm SG time (4pm Moscow; 8am New York; 1pm London). WDYT?

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-22 Thread Ihor Radchenko
Matt Price writes: > Yes, it definitely seems to be related tofile size, which makes me think > that some kind of buffer parsing is the cause of the problem. Parsing would show up in the profiler report in such scenario. It is not the case though. The problem might be invisible text (it would ca

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-22 Thread Ihor Radchenko
Matt Price writes: >>20128 80% - redisplay_internal (C function) >> 7142 28% - assq >> 908 3% - org-context Note that org-context is an obsolete function. Do you directly call it in your config? Or do you use a third-party package calling org-context? Best, Ihor

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-22 Thread Matt Price
sorry everyone, I accidentally sent this to Kaushal this morning, and then took quite a while to get back to a computer after he let me know my mistake! On Tue, Feb 22, 2022 at 10:12 AM Matt Price wrote: > > On Tue, Feb 22, 2022 at 12:45 AM Kaushal Modi > wrote: > >> >> >> On Tue, Feb 22, 2022

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-22 Thread Matt Price
Yes, it definitely seems to be related tofile size, which makes me think that some kind of buffer parsing is the cause of the problem. I'll replay in more detail to Ihor, down below! On Mon, Feb 21, 2022 at 5:22 PM Samuel Wales wrote: > i have been dealing with latency also, often in undo-tree.

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-22 Thread Rudolf Adamkovič
Ihor Radchenko writes: > Samuel Wales writes: > >> i have been dealing with latency also, often in undo-tree. this might >> be a dumb suggestion, but is it related to org file size? my files >> have not really grown /that/ much but maybe you could bisect one. as >> opposed to config. > > I am

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-21 Thread Kaushal Modi
On Tue, Feb 22, 2022, 12:34 AM Ihor Radchenko wrote: > > I am wondering if many people in the list experience latency issues. > Maybe we can organise an online meeting (jitsi or BBB) and collect the > common causes/ do online interactive debugging? > +1 I have seen few people see this issue on

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-21 Thread Ihor Radchenko
Samuel Wales writes: > i have been dealing with latency also, often in undo-tree. this might > be a dumb suggestion, but is it related to org file size? my files > have not really grown /that/ much but maybe you could bisect one. as > opposed to config. I am wondering if many people in the li

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-21 Thread Ihor Radchenko
Matt Price writes: > However, if I instead use my fairly extensive main config, latency is high > enough that there's a noticeable delay while typing ordinary words. I see > this regardless of whether I build from main or from Ihor's org-fold > feature branch on github. The profiler overview her

Re: profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-21 Thread Samuel Wales
i have been dealing with latency also, often in undo-tree. this might be a dumb suggestion, but is it related to org file size? my files have not really grown /that/ much but maybe you could bisect one. as opposed to config. i am not saying that your org files are too big. just that maybe it c

profiling latency in large org-mode buffers (under both main & org-fold feature)

2022-02-21 Thread Matt Price
I'm trying to figure out what causes high latency while typing in large org-mode files. The issue is very clearly a result of my large config file, but I'm not sure how to track it down with any precision. My main literate config file is ~/.emacs.d/emacs-init.org, currently 15000 lines, 260 src b