Re: conversion of pdfs in OM 4.9 error - fixed

[Maxim Solodovnik]

Hello Peter,

Thanks for the video :)
As I wrote before *progress bar should show "per file" progress*
This mean: IF you will choose more than one file, you will see percentage
of processed files
In case there is only one file: initially the progress is 0%, then it is
100% and dialog is auto-closed 

On Wed, 5 Jun 2019 at 14:24, Peter Dähn  wrote:

> Hi Maxim,
>
> here is what i did... The same in FF...
>
> Made it on Demo right now, maybe there is something in the logs...
>
> Greetings Peter
>
> Am 05.06.19 um 06:01 schrieb Maxim Solodovnik:
>
> Hello Peter,
>
> yes, upload to WB was recently fixed
> According to progress bar, it should show "per file" progress
> And it works for me
>
> may you can provide some repo steps?
>
> On Tue, 4 Jun 2019 at 18:21, Peter Dähn  wrote:
>
>> Hi there,
>>
>> lately we encounter that upload fails, if "load on whiteboard" is
>> selected. This is not reproducible on Demo. Is it fixed with by JIRA
>> OPENMEETINGS-2055? And progressbar is not working (on demo too).
>>
>> Greetings Peter
>>
>> Am 03.06.19 um 18:27 schrieb Maxim Solodovnik:
>>
>> That's OK
>>
>> recently I modified upload dialog behavior (JIRA OPENMEETINGS-2055, both
>> branches),
>> This is why I'm asking to check upload dialog on our demo
>>
>>
>> On Mon, 3 Jun 2019 at 19:56, Denis Noctor  wrote:
>>
>>> Apologies Maxim, I will open my query on a new thread as I am running
>>> 5.0.0-M2-SNAPSHOT.
>>>
>>>
>>> 
>>>  Virus-free.
>>> www.avg.com
>>> 
>>>
>>> On Mon, Jun 3, 2019 at 12:10 AM Maxim Solodovnik 
>>> wrote:
>>>
 Hello Denis,

 Are you sure you are having 4.9?
 If so why do you have Kurento?

 Is this issue reproducible on our demo server?


 On Sun, 2 Jun 2019 at 15:06, Denis Noctor 
 wrote:

> Hi there Maxim,
>
> I am torn between whether to write to this reply or a reply you sent
> me regarding my last email about conversion. I double checked to make sure
> I had ImageMagic / Ghostscript / LibreOfffice and so on install correctly.
>
> I know this probably sounds silly... but the only way I can upload a
> file to the Whiteboard is to reboot my server, restart MySQL, Kurento and
> then Tomcat... Once I upload a file whether it be doc, pdf, jpg and so
> on... the only way I can do an additional upload is to reboot and restart
> all the services... if I do a second upload... everything hangs on the
> "converting stage"... (Ubuntu 18.04.02).
>
> Any suggestions or recommendations would be appreciated.
>
> All the best.
>
> Denis
>
>
> 
>  Virus-free.
> www.avg.com
> 
>
> On Sat, Jun 1, 2019 at 11:38 PM Maxim Solodovnik 
> wrote:
>
>> Thanks for sharing
>> It is known issue, since vulnerability was found in ghost script
>>
>> On Sun, 2 Jun 2019 at 09:45, Daniel Baker <
>> i...@collisiondetection.biz> wrote:
>> >
>> > When installing  4.0.9-SNAPSHOT  on Ubuntu 18.04  I needed to
>> change  imagemagic etc/ImageMagick/policy.xml to make conversions  of 
>> pdfs
>> work correctly.
>> >
>> > NameOpenMeetings
>> > Version4.0.9-SNAPSHOT
>> > Revisionbaa27c7
>> > Build date2019-05-30T03:16:00Z
>> >
>> >
>> >
>> > Distributor ID: Ubuntu
>> > Description:Ubuntu 18.04.2 LTS
>> > Release:18.04
>> > Codename:   bionic
>> >
>> >
>> >
>> >
>> https://stackoverflow.com/questions/42928765/convertnot-authorized--error-constitute-c-readimage-453
>> >
>> >
>> > Thanks,
>> >
>> >
>> > Dan
>>
>>
>>
>> --
>> WBR
>> Maxim aka solomax
>>
>

 --
 WBR
 Maxim aka solomax

>>>
>>
>> --
>> WBR
>> Maxim aka solomax
>>
>>
>>
>
> --
> WBR
> Maxim aka solomax
>
>
>

-- 
WBR
Maxim aka solomax

Re: conversion of pdfs in OM 4.9 error - fixed

[Peter Dähn]

Hi Maxim,

ok... got it... but... ;-)

I think it would be good to have this also for one file... it takes a
long time if one uploads a ppt (and it looks like a challenge to produce
presentations as large as possible)

upload ppt. ppt to pdf, pdf to pngs ... and all with an empty
progressbar... :-(

Probably it is possible to make a progress step after each convertion-step!?

Greetings Peter

Am 05.06.19 um 10:14 schrieb Maxim Solodovnik:
> Hello Peter,
>
> Thanks for the video :)
> As I wrote before *progress bar should show "per file" progress*
> This mean: IF you will choose more than one file, you will see
> percentage of processed files
> In case there is only one file: initially the progress is 0%, then it
> is 100% and dialog is auto-closed 
>
> On Wed, 5 Jun 2019 at 14:24, Peter Dähn  > wrote:
>
> Hi Maxim,
>
> here is what i did... The same in FF...
>
> Made it on Demo right now, maybe there is something in the logs...
>
> Greetings Peter
>
> Am 05.06.19 um 06:01 schrieb Maxim Solodovnik:
>> Hello Peter,
>>
>> yes, upload to WB was recently fixed
>> According to progress bar, it should show "per file" progress
>> And it works for me
>>
>> may you can provide some repo steps?
>>
>> On Tue, 4 Jun 2019 at 18:21, Peter Dähn > > wrote:
>>
>> Hi there,
>>
>> lately we encounter that upload fails, if "load on
>> whiteboard" is selected. This is not reproducible on Demo. Is
>> it fixed with by JIRA OPENMEETINGS-2055? And progressbar is
>> not working (on demo too).
>>
>> Greetings Peter
>>
>> Am 03.06.19 um 18:27 schrieb Maxim Solodovnik:
>>> That's OK
>>>
>>> recently I modified upload dialog behavior (JIRA
>>> OPENMEETINGS-2055, both branches),
>>> This is why I'm asking to check upload dialog on our demo
>>>
>>>
>>> On Mon, 3 Jun 2019 at 19:56, Denis Noctor
>>> mailto:denisnoc...@gmail.com>> wrote:
>>>
>>> Apologies Maxim, I will open my query on a new thread as
>>> I am running 5.0.0-M2-SNAPSHOT. 
>>>
>>> 
>>> 
>>> Virus-free. www.avg.com
>>> 
>>> 
>>>
>>>
>>>
>>> On Mon, Jun 3, 2019 at 12:10 AM Maxim Solodovnik
>>> mailto:solomax...@gmail.com>> wrote:
>>>
>>> Hello Denis,
>>>
>>> Are you sure you are having 4.9?
>>> If so why do you have Kurento?
>>>
>>> Is this issue reproducible on our demo server?
>>>
>>>
>>> On Sun, 2 Jun 2019 at 15:06, Denis Noctor
>>> >> > wrote:
>>>
>>> Hi there Maxim,
>>>
>>> I am torn between whether to write to this reply
>>> or a reply you sent me regarding my last email
>>> about conversion. I double checked to make sure
>>> I had ImageMagic / Ghostscript / LibreOfffice
>>> and so on install correctly.
>>>
>>> I know this probably sounds silly... but the
>>> only way I can upload a file to the Whiteboard
>>> is to reboot my server, restart MySQL, Kurento
>>> and then Tomcat... Once I upload a file
>>> whether it be doc, pdf, jpg and so on... the
>>> only way I can do an additional upload is to
>>> reboot and restart all the services... if I do a
>>> second upload... everything hangs on the
>>> "converting stage"... (Ubuntu 18.04.02).
>>>
>>> Any suggestions or recommendations would be
>>> appreciated.
>>>
>>> All the best.
>>>
>>> Denis
>>>
>>> 
>>> 
>>> Virus-free. www.avg.com
>>> 
>>> 
>>>
>>>
>>>
>>> On Sat, Jun 1, 2019 at 11:38 PM Maxim Solodovnik
>>> >> > wrote:
>>>
>>> Thanks for sharing
>>> It is known issue, since vulnerability was
>>> found in ghost script
>>>
>>> On Sun, 2 Jun 2019 at 09:45, Daniel Baker
>>> >> 

Memory Usage OM4.0.8 and Ubuntu 18.04

[Aaron Hepp]

Recently moved the install from the 16.04 install to a new 18.04 
server.  Everything is working as expected but I m noticing the memory 
usage has greatly expanded.
Restarted the server on Saturday night.  No one uses the room till 
Monday morning. Memory usage on the reboot and starting OM4 memory was 
around 765MB normal.  Monday when I logged into the server it was up to 
1.25GB.  Granted this is with no one using it or accessing it.  Monday 
normal usage 12-15 users (1 screen share 1 ic user), same on Tuesday.  
Each day after everyone leaves the room and all "items" are stopped the 
usage has grown from the previous day.  Today before anyone gets in.  
Memory now sitting @ 2.45GB.


root@om:~# ps -o pid,user,%mem,command ax | sort -b -k3 -r
  907 root 33.6 /usr/bin/java -Dred5.root=/opt/om4 
-Djava.security.debug=failure -Xms1024m -Xmx4096m -Xverify:none 
-XX:+TieredCompilation -XX:+UseBiasedLocking -XX:InitialCodeCacheSize=8m 
-XX:ReservedCodeCacheSize=32m 
-Dorg.terracotta.quartz.skipUpdateCheck=true -XX:MaxMetaspaceSize=128m 
-XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC -XX:ParallelGCThreads=2 
-Dcatalina.home=/opt/om4 -Dcatalina.useNaming=true 
-Djava.library.path=/opt/om4/lib/native -Dpython.home=lib -cp 
/opt/om4/red5-service.jar:/opt/om4/conf: org.red5.server.Bootstrap 

  436 mysql 2.6 /usr/sbin/mysqld
   41 root  0.3 /lib/systemd/systemd-journald
14175 www-data  0.2 /usr/sbin/apache2 -k start

33.6% of 6GB vps.  As you can see the "options" set for the start-up.  I 
am going to let it run to see how high it creeps up, but was wondering 
if other had seen this issue with Ubuntu18.04.  On 16.04 I noticed it 
some but not on this rate of rise.

Re: Memory Usage OM4.0.8 and Ubuntu 18.04

[Maxim Solodovnik]

Actually some processes are working even if there are no users
Mail checks
Reminder checks
Some periodic clean-up jobs
(each performs some DB queries)

I'll try to check our demo server

currently 2 OM instances 4.0.9 and 5.0.0 consumes 3.75Gb (according to htop)
your `ps command` reports more memory (I believe shared memory is
being counted multiple times)

On Wed, 5 Jun 2019 at 19:51, Aaron Hepp  wrote:
>
> Recently moved the install from the 16.04 install to a new 18.04 server.  
> Everything is working as expected but I m noticing the memory usage has 
> greatly expanded.
> Restarted the server on Saturday night.  No one uses the room till Monday 
> morning. Memory usage on the reboot and starting OM4 memory was around 765MB 
> normal.  Monday when I logged into the server it was up to 1.25GB.  Granted 
> this is with no one using it or accessing it.  Monday normal usage 12-15 
> users (1 screen share 1 ic user), same on Tuesday.  Each day after everyone 
> leaves the room and all "items" are stopped the usage has grown from the 
> previous day.  Today before anyone gets in.  Memory now sitting @ 2.45GB.
>
> root@om:~# ps -o pid,user,%mem,command ax | sort -b -k3 -r
>   907 root 33.6 /usr/bin/java -Dred5.root=/opt/om4 
> -Djava.security.debug=failure -Xms1024m -Xmx4096m -Xverify:none 
> -XX:+TieredCompilation -XX:+UseBiasedLocking -XX:InitialCodeCacheSize=8m 
> -XX:ReservedCodeCacheSize=32m -Dorg.terracotta.quartz.skipUpdateCheck=true 
> -XX:MaxMetaspaceSize=128m -XX:+DisableExplicitGC -XX:+UseConcMarkSweepGC 
> -XX:ParallelGCThreads=2 -Dcatalina.home=/opt/om4 -Dcatalina.useNaming=true 
> -Djava.library.path=/opt/om4/lib/native -Dpython.home=lib -cp 
> /opt/om4/red5-service.jar:/opt/om4/conf: org.red5.server.Bootstrap 
>   436 mysql 2.6 /usr/sbin/mysqld
>41 root  0.3 /lib/systemd/systemd-journald
> 14175 www-data  0.2 /usr/sbin/apache2 -k start
>
> 33.6% of 6GB vps.  As you can see the "options" set for the start-up.  I am 
> going to let it run to see how high it creeps up, but was wondering if other 
> had seen this issue with Ubuntu18.04.  On 16.04 I noticed it some but not on 
> this rate of rise.
>


-- 
WBR
Maxim aka solomax

Re: File Upload Converting Issue - Ubuntu 18.04.2 LTS - 5.0.0-M2-SNAPSHOT

[Maxim Solodovnik]

Do you have any errors in the logs?
can you check with PS which processes are started?

Actually conversion is made by running 3rd party tools (imagemagic,
libreoffice etc.)
and there is configurable timeout external.process.ttl
https://openmeetings.apache.org/GeneralConfiguration.html so processes will
not work "forever"

I can suggest to:
1) using real-time logs find the process which hangs
2) try to to manually run it, maybe play with some params

I never saw the behavior like this :(

On Mon, 3 Jun 2019 at 23:27, Denis Noctor  wrote:

> Hi there Maxim,
>
> I am running 2 different AWS instances (both with Ubunto 18.04.2 LTS) –
> the only difference being is that one is running  5.0.0-M2-SNAPSHOT
> (Revision - 85daa3b /Build date 2019-05-13T16:53:23Z) and the other is
> running 5.0.0-M2-SNAPSHOT (Revision - 1c16b6d /Build date
> 2019-05-19T13:29:29Z)
>
> The first one is setup using  NUMB TURNSERVER and as a result audio and
> video is working as expected (solving the whole NAT issue I had some time
> back).
> Both installations are based on Alvaro’s version 9 instructions
> “Installation of Apache OpenMeetings 5.0.0 M1 on Ubuntu 18.04 LTS” … with
> the exception of installing the 5.0.0-M2-SNAPSHOTS… on Ubunto 18.04.2 LTS.
> When I try upload files to “My Files” / the whiteboard, everything seems
> to “hang” on the “Converting…” pop up stage. When I press “cancel” in the
> pop up box, the box closes though there still appears be some activity in
> the background as there is still a “spinning” arrow. When I exit the room
> sometimes get an “Internal Error – Return to home page” 
> (https://./openmeetings/wicket/bookmarkable/org.apache.wicket.markup.html.pages.InternalErrorPage)
>
>
> This is why I set up a second AWS instance to double check installation –
> however, in the second installation I have the same “converting” issues.
>
> However, sometimes if I reboot the instances, restarting MySql, Kurento
> and Tomcat3 (in this order), I can sometimes upload *ONE* document (jpg,
> ppt, doc etc.) but when I try to upload another file, everything is stuck
> on the “converting” process until I cancel.
>
> I am curious to know if there are other users using Ubuntu 18.04.2 LTS
> (AWS instance) and if they are having a similar problem as I am beginning
> to think this is unique to 18.04.2 LTS (and not 18.04).
> For reference the following are installed:
> ImageMagick - Version: ImageMagick 6.9.7-4 Q16 x86_64 20170114
> Ghostscript – Version: GPL Ghostscript 9.26 (2018-11-20)
> LibreOffice  - Version: 6.2.4.2 20(Build:2)
>
> /etc/ImageMagick-6/policy.xml has been edited to comment out the following:
> 
> 
>
> Any feedback would be appreciated.
>
> All the best.
>
> Denis
>
>
> 
>  Virus-free.
> www.avg.com
> 
> <#m_-5775421598985918898_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
>


-- 
WBR
Maxim aka solomax

Re: conversion of pdfs in OM 4.9 error - fixed

[Maxim Solodovnik]

Progress for one file is improved (a little ..)
Would appreciate if you can test :)

On Wed, 5 Jun 2019 at 17:03, Peter Dähn  wrote:

> Hi Maxim,
>
> ok... got it... but... ;-)
>
> I think it would be good to have this also for one file... it takes a long
> time if one uploads a ppt (and it looks like a challenge to produce
> presentations as large as possible)
>
> upload ppt. ppt to pdf, pdf to pngs ... and all with an empty
> progressbar... :-(
>
> Probably it is possible to make a progress step after each
> convertion-step!?
>
> Greetings Peter
>
> Am 05.06.19 um 10:14 schrieb Maxim Solodovnik:
>
> Hello Peter,
>
> Thanks for the video :)
> As I wrote before *progress bar should show "per file" progress*
> This mean: IF you will choose more than one file, you will see percentage
> of processed files
> In case there is only one file: initially the progress is 0%, then it is
> 100% and dialog is auto-closed 
>
> On Wed, 5 Jun 2019 at 14:24, Peter Dähn  wrote:
>
>> Hi Maxim,
>>
>> here is what i did... The same in FF...
>>
>> Made it on Demo right now, maybe there is something in the logs...
>>
>> Greetings Peter
>>
>> Am 05.06.19 um 06:01 schrieb Maxim Solodovnik:
>>
>> Hello Peter,
>>
>> yes, upload to WB was recently fixed
>> According to progress bar, it should show "per file" progress
>> And it works for me
>>
>> may you can provide some repo steps?
>>
>> On Tue, 4 Jun 2019 at 18:21, Peter Dähn  wrote:
>>
>>> Hi there,
>>>
>>> lately we encounter that upload fails, if "load on whiteboard" is
>>> selected. This is not reproducible on Demo. Is it fixed with by JIRA
>>> OPENMEETINGS-2055? And progressbar is not working (on demo too).
>>>
>>> Greetings Peter
>>>
>>> Am 03.06.19 um 18:27 schrieb Maxim Solodovnik:
>>>
>>> That's OK
>>>
>>> recently I modified upload dialog behavior (JIRA OPENMEETINGS-2055, both
>>> branches),
>>> This is why I'm asking to check upload dialog on our demo
>>>
>>>
>>> On Mon, 3 Jun 2019 at 19:56, Denis Noctor  wrote:
>>>
 Apologies Maxim, I will open my query on a new thread as I am running
 5.0.0-M2-SNAPSHOT.


 
  Virus-free.
 www.avg.com
 

 On Mon, Jun 3, 2019 at 12:10 AM Maxim Solodovnik 
 wrote:

> Hello Denis,
>
> Are you sure you are having 4.9?
> If so why do you have Kurento?
>
> Is this issue reproducible on our demo server?
>
>
> On Sun, 2 Jun 2019 at 15:06, Denis Noctor 
> wrote:
>
>> Hi there Maxim,
>>
>> I am torn between whether to write to this reply or a reply you sent
>> me regarding my last email about conversion. I double checked to make 
>> sure
>> I had ImageMagic / Ghostscript / LibreOfffice and so on install 
>> correctly.
>>
>> I know this probably sounds silly... but the only way I can upload a
>> file to the Whiteboard is to reboot my server, restart MySQL, Kurento and
>> then Tomcat... Once I upload a file whether it be doc, pdf, jpg and 
>> so
>> on... the only way I can do an additional upload is to reboot and restart
>> all the services... if I do a second upload... everything hangs on the
>> "converting stage"... (Ubuntu 18.04.02).
>>
>> Any suggestions or recommendations would be appreciated.
>>
>> All the best.
>>
>> Denis
>>
>>
>> 
>>  Virus-free.
>> www.avg.com
>> 
>>
>> On Sat, Jun 1, 2019 at 11:38 PM Maxim Solodovnik <
>> solomax...@gmail.com> wrote:
>>
>>> Thanks for sharing
>>> It is known issue, since vulnerability was found in ghost script
>>>
>>> On Sun, 2 Jun 2019 at 09:45, Daniel Baker <
>>> i...@collisiondetection.biz> wrote:
>>> >
>>> > When installing  4.0.9-SNAPSHOT  on Ubuntu 18.04  I needed to
>>> change  imagemagic etc/ImageMagick/policy.xml to make conversions  of 
>>> pdfs
>>> work correctly.
>>> >
>>> > NameOpenMeetings
>>> > Version4.0.9-SNAPSHOT
>>> > Revisionbaa27c7
>>> > Build date2019-05-30T03:16:00Z
>>> >
>>> >
>>> >
>>> > Distributor ID: Ubuntu
>>> > Description:Ubuntu 18.04.2 LTS
>>> > Release:18.04
>>> > Codename:   bionic
>>> >
>>> >
>>> >
>>> >
>>> https://stackoverflow.com/questions/42928765/convertnot-authorized--error-constitute-c-readimage-453
>>> >
>>> >
>>> > Thanks,
>>> >
>>> >
>>> > Dan
>>>
>>>
>>>
>>> --
>>> WBR
>>> Maxim aka solomax
>>>
>>
>