according to the code ./admin.sh -f --cleanup cleanup streams as well (removes deleted and non-existent recordings)
On Mon, Aug 26, 2013 at 10:24 PM, Lee Saunders <leesenglishless...@gmail.com > wrote: > Thanks, Maxim. > Maybe there is a file path or something I need to add. > > > > On Mon, Aug 26, 2013 at 2:17 AM, Maxim Solodovnik <solomax...@gmail.com>wrote: > >> I'll try to double check the tool. I was sure it performs the full clean >> up >> On Aug 26, 2013 5:50 AM, "Lee Saunders" <leesenglishless...@gmail.com> >> wrote: >> >>> Indeed, Sebastian and Maxim have done a great job, and very generous to >>> keep it Open Source. >>> It was just frustrating to realise I'll have no hard disc left very >>> quickly. >>> >>> >>> On Sun, Aug 25, 2013 at 11:38 PM, Jacob Gaiski <jgai...@emich.edu>wrote: >>> >>>> I think OpenMeetings require a somewhat knowledgable background with >>>> Java and running servers on Tomcat/Red5.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> I would recommend that you become familiar with Java the programming >>>> language and yes, take a look at the source. If you can get it to compile, >>>> publish your version and put in logging functions so that you can better >>>> see what it's doing.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> You should also be able to localize it onto a machine and debug it from >>>> Eclipse, given you have the right enviroment. I think the one you need is >>>> Eclipse Juno.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> Once you have the entire system localized onto your machine, you can >>>> attach and remove debug points from anywhere within the source and see >>>> exactly what's happening from a server perspective as you execute client >>>> code, and also be able to enter your changes accordingly as you need in the >>>> code as well.**** >>>> >>>> ** ** >>>> >>>> I'm not sure if what you're trying to do is standard in OpenMeetings, >>>> but in either case, editing the source the possibilities are endless, >>>> thanks to Sebastion and Maxim at the OpenMeetings/Apache group.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> -Jake**** >>>> ------------------------------ >>>> >>>> *From:* Lee Saunders [mailto:leesenglishless...@gmail.com] >>>> *Sent:* Sunday, August 25, 2013 6:30 PM >>>> *To:* user@openmeetings.apache.org >>>> *Subject:* Re: Why don't calendar events expire?**** >>>> >>>> ** ** >>>> >>>> Hello Jake,**** >>>> >>>> ** ** >>>> >>>> Thank you for your help. I think everyone knows more about that than I >>>> do.**** >>>> >>>> I don't know about programming applications. I learnt some PHP and >>>> MySql from books to build an order tracking/customer info database system, >>>> and that was it.**** >>>> >>>> ** ** >>>> >>>> I did experience a recording issue today. A student left the room and >>>> returned, but the recorder didn't record any of their voice after they >>>> returned to the room, so only my half was recorded. I'll put that down >>>> to experience.**** >>>> >>>> ** ** >>>> >>>> I could perhaps learn from the source, thanks.**** >>>> >>>> ** ** >>>> >>>> All the best,**** >>>> >>>> ** ** >>>> >>>> Lee.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 10:30 PM, Jacob C. Gaiski <jgai...@emich.edu> >>>> wrote:**** >>>> >>>> Write a console app that scans the database and removes files after >>>> encoding.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> Though, if there's a corrupt video and the encoded video becomes >>>> corrupted, you'll have no fall back if say, a multithreaded random bug >>>> happens that causes your ffmpeg to run before the stream had closed.*** >>>> * >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> I did all of my conversions with a console application that runs FFMPEG >>>> and updates a table every 20s.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> If you'd like the source that makes it happen I can send it to you.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> But all in all I'd recommend that you build a console app that reads >>>> from a database and changes it accordingly.**** >>>> >>>> ** ** >>>> >>>> -Jake**** >>>> >>>> >>>> On Aug 25, 2013, at 5:03 PM, Lee Saunders <leesenglishless...@gmail.com> >>>> wrote:**** >>>> >>>> Maxim, I ran -f, --file, and --cleanup, but that doesn't >>>> touch the streams.**** >>>> >>>> ** ** >>>> >>>> Those recordings really need to be removed after rendering to AVI. They >>>> will simply fill my disc if nothing can be deleted. Every meeting is 1 hour >>>> long and recorded, and there is already 6Gb of data in those streams after >>>> one day. **** >>>> >>>> ** ** >>>> >>>> Please don't think of me as moaning. Open Meetings is a great platform. >>>> I am just concerned about filling my disc with redundant data.**** >>>> >>>> ** ** >>>> >>>> Is it not possible to GET the user IDs for a roomID and delete the >>>> relations to the files so they can be deleted? I think not being able to >>>> delete anything, even under a warning, is somewhat restrictive and disc >>>> hogging. I understand the concerns about complaints about something later >>>> down the line and the need to retrieve data, but that would be the decision >>>> of the admin/IT team and management. Besides, there should be a backup of >>>> all that data anyway.**** >>>> >>>> ** ** >>>> >>>> I guess the only other way around it is to record a 1-second video and >>>> audio clip and replace all the files with them. That way the file names >>>> will remain intact. It will be time consuming, but better than rendering my >>>> disc full and unusable after about 3 months. What does Open Meetings do >>>> when a disc is full?**** >>>> >>>> ** ** >>>> >>>> All the best,**** >>>> >>>> ** ** >>>> >>>> Lee.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 4:43 PM, Maxim Solodovnik <solomax...@gmail.com> >>>> wrote:**** >>>> >>>> you can use command line admin for this:**** >>>> >>>> ** ** >>>> >>>> -f,--files File operations - >>>> statictics/cleanup**** >>>> >>>> --cleanup (optional) Should intermediate >>>> files be clean up**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 2:53 PM, Lee Saunders < >>>> leesenglishless...@gmail.com> wrote:**** >>>> >>>> I would like to delete recordings after downloading them to clear disc >>>> space. I'm not sure why the 'drag to trash' option is there if the files >>>> are not really deleted.**** >>>> >>>> I need to remove them somehow as disc space is finite.**** >>>> >>>> ** ** >>>> >>>> Thanks,**** >>>> >>>> ** ** >>>> >>>> Lee.**** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 2:32 AM, seba.wag...@gmail.com < >>>> seba.wag...@gmail.com> wrote:**** >>>> >>>> Not really.**** >>>> >>>> The files in the /streams/hibernate folder are the final videos of the >>>> recordings. If you delete them all your recordings are gone. >>>> >>>> The files in the /streams/$ROOM_ID folders are the raw recording files. >>>> Based on those files there is a complete video mixed (that is then produced >>>> into the /streams/hibernate folder).**** >>>> >>>> Theoretically you can delete the files in the /streams/$ROOM_ID folder >>>> as the final mixed video is already produced.**** >>>> >>>> However for recordings based on the interview room type, there is a >>>> functionality to re-render the raw data but with some parameters to adjust >>>> the audio (make it loader, delay the audio, et cetera). Those are useful if >>>> you want to post-edit the video from inside OpenMeetings because for >>>> instance one participant has a microphone that is a lot loader then some >>>> other participant. Once the video is "mixed" into the final format there >>>> would be no way of re-adjusting those settings. So there is some button in >>>> the OpenMeetings UI to re-render the raw files with some additional >>>> settings.**** >>>> >>>> If you delete the files in the /streams/$ROOM_ID folders bascially the >>>> UI functionality is pointing to files that do no more exist. >>>> Also there are entries in the database that point to the files in the >>>> /streams/$ROOM_ID directory. So in general, it would be basically a bad >>>> idea to just delete those folders, UI functionality might be broken and the >>>> data model would be inconsistent.**** >>>> >>>> Sebastian**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> 2013/8/25 Lee Saunders <leesenglishless...@gmail.com>**** >>>> >>>> Is it safe for me to delete the sub-folders in the streams directory?** >>>> ** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 1:39 AM, Lee Saunders < >>>> leesenglishless...@gmail.com> wrote:**** >>>> >>>> Thank you for the technical information.**** >>>> >>>> I'm just going my my experience using another system in which each >>>> meeting was tied only to the originator and could remain open over any >>>> number of sessions, and then closed when complete. Once complete a PDF of >>>> the whiteboard and accompanying documentation was created as a soft copy >>>> for download, stored in the users account. So, even though the meeting had >>>> been closed, a downloadable representation of the meeting was available in >>>> an archive. I do see how Open Minutes works differently, though.**** >>>> >>>> ** ** >>>> >>>> All in all, Open Meetings is a great service. Thank you for creating it. >>>> **** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 1:27 AM, seba.wag...@gmail.com < >>>> seba.wag...@gmail.com> wrote:**** >>>> >>>> We actually never physically delete anything, we just mark/flag as >>>> deleted and don't show it in the UI anymore.**** >>>> >>>> There are multiple reasons why you do that in software. For instance >>>> there are are often foreign key constraints. That means that you can't >>>> physically delete an user, cause this userId is a foreign key in some other >>>> tables. And by deleting the user physically you would get an inconsistance >>>> data model.**** >>>> >>>> This will become a real issue when you work with databases that have >>>> "real" foreign keys (postgres, oracle, MySQL InnoDB, et cetera). However >>>> even with data on disk in files, just because you "can" delete those files >>>> without throwing any error does not mean that this is a good idea, as for >>>> example records in the database still point to that file. By doing that the >>>> data model simply becomes inconsistent. Some references are missing, it >>>> pretty much gets a mess if you start to delete files.**** >>>> >>>> Another reason is that you want to keep track on changes that have >>>> happened. This is sometimes a legal requirement in companies and >>>> government. You just never delete hard, data must be always possible to be >>>> restored. For instance an user xyz claims his important file XXX was >>>> deleted at the 28.12.2009, now the sys admins need to recover that file. >>>> **** >>>> >>>> There are however attempts to have some kind of clean up tasks that >>>> delete such references to free up disk space. But if ever implemented it >>>> has to be done very carefully and clear to the sys admin that there is no >>>> way back, you will loose data and you probably should back up the data >>>> before doing it. >>>> >>>> Bottom line is: Don't delete, just flag as deleted.**** >>>> >>>> Sebastian**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> 2013/8/25 Lee Saunders <leesenglishless...@gmail.com>**** >>>> >>>> Ah, I see. I guess that does make sense. I just worry about having a >>>> list of rooms that becomes too long to manage.**** >>>> >>>> Perhaps then, completed meetings could go into an archive\ completed >>>> events section, thus keeping them separate from pending events.**** >>>> >>>> ** ** >>>> >>>> I have also noticed that deleted recordings remain in the streams >>>> folder (..\webapps\openmeetings\streams\). Why don't they get deleted when >>>> moved to trash?**** >>>> >>>> ** ** >>>> >>>> All the best,**** >>>> >>>> ** ** >>>> >>>> Lee.**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> On Sun, Aug 25, 2013 at 12:49 AM, seba.wag...@gmail.com < >>>> seba.wag...@gmail.com> wrote:**** >>>> >>>> Hi Lee, >>>> >>>> I don't think we should delete the room after a calendar event was >>>> terminated. Otherwise for example any uploaded or created data that was >>>> part of the conference room itself would be gone.**** >>>> >>>> Also you can attach existing rooms to multiple calendar events. So the >>>> relationship between room to calendar event is not 1:1.**** >>>> >>>> Sebastian**** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> 2013/8/25 Lee Saunders <leesenglishless...@gmail.com>**** >>>> >>>> Hello,**** >>>> >>>> ** ** >>>> >>>> I tested the calendar, but after the event had ended, the room >>>> persisted.**** >>>> >>>> Is there a way to terminate the event when the 'Exit' button is clicked >>>> rather than delete the event in the calendar and receive a 'Cancelled' >>>> message?**** >>>> >>>> ** ** >>>> >>>> I think that if an event is terminated before the start or end time, >>>> then yes, it is cancelled, but after the end time, a meeting has usually >>>> ended.**** >>>> >>>> ** ** >>>> >>>> Just a suggestion.**** >>>> >>>> ** ** >>>> >>>> All the best,**** >>>> >>>> ** ** >>>> >>>> Lee.**** >>>> >>>> >>>> >>>> **** >>>> >>>> -- >>>> Sebastian Wagner >>>> https://twitter.com/#!/dead_lock >>>> http://www.webbase-design.de >>>> http://www.wagner-sebastian.com >>>> seba.wag...@gmail.com **** >>>> >>>> ** ** >>>> >>>> >>>> >>>> >>>> -- >>>> Sebastian Wagner >>>> https://twitter.com/#!/dead_lock >>>> http://www.webbase-design.de >>>> http://www.wagner-sebastian.com >>>> seba.wag...@gmail.com **** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>>> >>>> >>>> >>>> -- >>>> Sebastian Wagner >>>> https://twitter.com/#!/dead_lock >>>> http://www.webbase-design.de >>>> http://www.wagner-sebastian.com >>>> seba.wag...@gmail.com **** >>>> >>>> ** ** >>>> >>>> >>>> >>>> **** >>>> >>>> ** ** >>>> >>>> -- >>>> WBR >>>> Maxim aka solomax **** >>>> >>>> ** ** >>>> >>>> ** ** >>>> >>> >>> > -- WBR Maxim aka solomax
