Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

2016-09-13 Thread John Dickinson
On 13 Sep 2016, at 15:47, Michael Yoon wrote: > Hello Alex and Clay, > > Pardon my jumping in here, we do something similar and have a similar use > case (we chose 1MB segments for mobile, and 10MB segments for desktop). > One question I have in comparing copy/bulk-delete vs keeping the manifest

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

2016-09-13 Thread Michael Yoon
Hello Alex and Clay, Pardon my jumping in here, we do something similar and have a similar use case (we chose 1MB segments for mobile, and 10MB segments for desktop). One question I have in comparing copy/bulk-delete vs keeping the manifest around is what is the overhead of the manifest within swi

Re: [Openstack] [OpenStack] [Swift] Is it possible to stream a file from a Java server to OpenStack Swift?

2016-09-13 Thread Alexandr Porunov
Thanks again Clay! I will try JOSS Now I am joined to #openstack-swift Best regards, Alexandr On Wed, Sep 14, 2016 at 12:21 AM, Alexandr Porunov < alexandr.poru...@gmail.com> wrote: > Thanks again Clay! > > I will try JOSS > > Now I am joined to #openstack-swift > > Best regards, > Alexandr >

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

2016-09-13 Thread Alexandr Porunov
Thank you Clay! I use ffmpeg with remote input and local output for first convertion. Here is a simplified algorithm: 1. Convert with h264 in the highest quality (till 4K) and save it in a transformer server. 2. Convert into lower quality locally. And get additional data (thumbnails and so on). 3.

Re: [Openstack] [OpenStack] [Swift] Is it possible to stream a file from a Java server to OpenStack Swift?

2016-09-13 Thread Clay Gerrard
heh, didn't see this one when responding to the other message :P My favorite client bindings for the java's is JOSS -> http://joss.javaswift.org/ For streaming upload; maybe here: https://github.com/javaswift/tutorial-joss-streaming/blob/e97a302e42b8964b4c87749fc2a5d28a9bb4d32a/src/main/java/org

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

2016-09-13 Thread Clay Gerrard
On Tue, Sep 13, 2016 at 10:37 AM, Alexandr Porunov < alexandr.poru...@gmail.com> wrote: > > Correct me if I am wrong. Algorithm is the next: > 1. Upload 1MB sub-segments (up to 500 sub-segments per segment). After > they will be uploaded I will use "copy" request to create one 500MB > segment. Aft

Re: [Openstack] [OpenStack] [Swift] Segments count minimization.

2016-09-13 Thread Alexandr Porunov
Hello Clay, Thank you for your suggestions. I need to use Swift in several purposes. 1. As a temporary storage for uncompressed video scenes (y4m, mp4) up to 120GB. (After conversion they will be deleted). 2. As a persistent storage for compressed video scenes (mp4) up to 120GB. Most of the compre

[Openstack] [OpenStack] [Swift] Segments count minimization.

2016-09-13 Thread Alexandr Porunov
Hello, Does somebody know how to minimize segments count of a file? I have to implement an upload file service with the chunked upload feature. If a client lose connection for some time we have to be able continue to upload the file after connection is established (From the last successfuly upload

[Openstack] [OpenStack] [Swift] Is it possible to stream a file from a Java server to OpenStack Swift?

2016-09-13 Thread Alexandr Porunov
Hello, Is it possible to stream a file from a Java server to OpenStack Swift? I need to store very large files in the OpenStack swift through the Java server. Java server performs authentication, validation and other special logic after that it sends file into OpenStack Swift. The problem is tha

Re: [Openstack] Easy deployment

2016-09-13 Thread s serge
Networking is configured according to http://docs.openstack.org/mitaka/install-guide-rdo/launch-instance-networks-selfservice.htmlSee also Variable parameters in Configuration section. 13.09.2016, 09:04, "Nasir Mahmood" :What about  neutron visibility in this tool? On Sep 13, 2016 01:57, "s serge"

[Openstack] Call for mentors and funding

2016-09-13 Thread Mahati C
Hello everyone, An update on the Outreachy program, including a request for volunteer mentors and funding. For those of you who are not aware, Outreachy helps people from underrepresented groups get involved in free and open source software by matching interns with established mentors in the upst