[ 
https://issues.apache.org/jira/browse/TIKA-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822187#comment-16822187
 ] 

Hudson commented on TIKA-2849:
------------------------------

SUCCESS: Integrated in Jenkins build Tika-trunk #1643 (See 
[https://builds.apache.org/job/Tika-trunk/1643/])
TIKA-2849 -- move to streaming detection of zip files and apply (tallison: 
[https://github.com/apache/tika/commit/64877c5a6187ecd13e098e99edc97a1f6dc09112])
* (add) 
tika-parsers/src/test/resources/org/apache/tika/parser/pkg/tika-config.xml
* (edit) tika-parsers/src/main/java/org/apache/tika/parser/epub/EpubParser.java
* (edit) 
tika-parsers/src/main/java/org/apache/tika/parser/microsoft/ooxml/OOXMLExtractorFactory.java
* (add) 
tika-parsers/src/main/java/org/apache/tika/parser/pkg/StreamingZipContainerDetector.java
* (edit) 
tika-parsers/src/test/java/org/apache/tika/parser/pkg/ZipContainerDetectorTest.java
* (add) tika-core/src/main/java/org/apache/tika/io/BoundedInputStream.java
* (edit) 
tika-core/src/main/java/org/apache/tika/parser/digest/InputStreamDigester.java
* (edit) 
tika-parsers/src/main/java/org/apache/tika/parser/iwork/IWorkPackageParser.java
* (edit) tika-core/src/test/java/org/apache/tika/TikaTest.java
* (edit) 
tika-parsers/src/test/java/org/apache/tika/parser/microsoft/ooxml/TruncatedOOXMLTest.java
* (add) 
tika-parsers/src/main/java/org/apache/tika/parser/pkg/ZipContainerDetectorBase.java
* (edit) CHANGES.txt
* (edit) tika-core/src/main/java/org/apache/tika/io/TikaInputStream.java
* (edit) 
tika-parsers/src/main/java/org/apache/tika/parser/utils/ZipSalvager.java
* (edit) 
tika-parsers/src/main/java/org/apache/tika/parser/microsoft/POIFSContainerDetector.java
* (edit) 
tika-parsers/src/main/java/org/apache/tika/parser/pkg/ZipContainerDetector.java


> TikaInputStream copies the input stream locally
> -----------------------------------------------
>
>                 Key: TIKA-2849
>                 URL: https://issues.apache.org/jira/browse/TIKA-2849
>             Project: Tika
>          Issue Type: Bug
>    Affects Versions: 1.20
>            Reporter: Boris Petrov
>            Assignee: Tim Allison
>            Priority: Major
>             Fix For: 1.21
>
>
> When doing "tika.detect(stream, name)" and the stream is a "TikaInputStream", 
> execution gets to "TikaInputStream#getPath" which does a "Files.copy(in, 
> path, REPLACE_EXISTING);" which is very, very bad. This input stream could 
> be, as in our case, an input stream from a network file which is tens or 
> hundreds of gigabytes large. Copying it locally is a huge waste of resources 
> to say the least. Why does it do that and can I make it not do it? Or is this 
> something that has to be fixed in Tika?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to