[
https://issues.apache.org/jira/browse/IGNITE-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16125419#comment-16125419
]
ASF GitHub Bot commented on IGNITE-5991:
----------------------------------------
GitHub user devozerov opened a pull request:
https://github.com/apache/ignite/pull/2437
IGNITE-5991
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gridgain/apache-ignite ignite-5991
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/ignite/pull/2437.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2437
----
commit d38ef59ac299b7c2231cdd4c71ce9359c74b338c
Author: devozerov <[email protected]>
Date: 2017-08-08T12:49:19Z
Created example as a starting point.
commit c440314307980dcaf0944b2c826458e0888ed4e7
Author: devozerov <[email protected]>
Date: 2017-08-08T12:51:25Z
Streaming flag on API.
commit 3cd9c8958d3707d429a2dd5bf13656ef33d8f4b7
Author: devozerov <[email protected]>
Date: 2017-08-08T13:56:28Z
Passed streaming flag to query executor.
commit 8efa03604931b0bfcc958dc3d4b6fe318a8b6d5c
Author: devozerov <[email protected]>
Date: 2017-08-09T08:55:29Z
Merge branch 'master' into ignite-5991
commit 3a4c2d75c61a64accd9059c5cecf46267cff8b4e
Author: devozerov <[email protected]>
Date: 2017-08-09T09:38:04Z
Consuming results into own target.
commit d2c86a7c9d0c2db0bc1757a2004a8c614c874862
Author: devozerov <[email protected]>
Date: 2017-08-09T12:46:13Z
Minors.
commit e000fb08f50c1bd5154c96e14ffc5070da1d147d
Author: devozerov <[email protected]>
Date: 2017-08-09T12:48:50Z
Started working on result target.
commit 815178d6a57ff2e13003a5be12d8630537613c4d
Author: devozerov <[email protected]>
Date: 2017-08-09T15:09:24Z
WIP on target.
commit 9f88f51555264323a610eb0cc12806de4ac3e425
Author: devozerov <[email protected]>
Date: 2017-08-10T10:31:26Z
Merge branch 'master' into ignite-5991
commit 0b88846c8a9cc5abebee630d1aac9df9fb109cee
Author: devozerov <[email protected]>
Date: 2017-08-10T11:36:40Z
WIP.
commit 34fa8a08a8e25db6e6cb0a41a515517c3a062fba
Author: devozerov <[email protected]>
Date: 2017-08-10T12:53:52Z
WIP.
commit 8fcc88009e2cb49b0b03f186a6f8409e9410ef5a
Author: devozerov <[email protected]>
Date: 2017-08-10T12:56:22Z
WIP on flags.
commit 3bc3e4bc87d3b602c0288e1541a8e52633d7d104
Author: devozerov <[email protected]>
Date: 2017-08-10T12:57:58Z
Better flag naming.
commit f7afc0dc7ae3954aaf55d5ef1fa6e28afc974011
Author: devozerov <[email protected]>
Date: 2017-08-10T13:23:08Z
Added last page to the response.
commit d465d11ce0efbe35a58e3e78e2cb5895b9b80444
Author: devozerov <[email protected]>
Date: 2017-08-10T14:04:08Z
Done.
commit d1fdb746c9be80072a50c3de5534215e7ad53983
Author: devozerov <[email protected]>
Date: 2017-08-10T14:13:11Z
Done.
commit 00ccadb0c8c157e1c03a0d57c4751b4d85ff322c
Author: devozerov <[email protected]>
Date: 2017-08-10T14:14:25Z
Minors.
commit 9dc947d8c5a0cec22890a1dde86d91cd1ceea685
Author: devozerov <[email protected]>
Date: 2017-08-10T14:17:19Z
Merge branch 'ignite-6027' into ignite-5991
commit c7c122aee8c379ed0f0240e1bde34c345ce6d14a
Author: devozerov <[email protected]>
Date: 2017-08-10T14:25:16Z
Removed unused argument.
commit c955d18ebe7a6f4d567a9719301f3c9b434d6e17
Author: devozerov <[email protected]>
Date: 2017-08-10T14:41:06Z
Identified places for separate threads.
commit 5f121e0e14d3e3c0b634851164cb9a3ce89d6d54
Author: devozerov <[email protected]>
Date: 2017-08-10T14:45:27Z
Propagated node ID to node results.
commit d50edfd55c6b29411624bb8d8f33b0b89272b1de
Author: devozerov <[email protected]>
Date: 2017-08-10T14:57:30Z
Minors.
commit 284387b14ecdb67225e597bdd822d02fed0d3ef0
Author: devozerov <[email protected]>
Date: 2017-08-14T06:55:34Z
Merge branch 'master' into ignite-5991
commit 40e45ad7663efdf59138239e2fd24a5f001a0e5b
Author: devozerov <[email protected]>
Date: 2017-08-14T07:15:31Z
Lazy worker.
commit 8c4527371b884b8244ecbf23aab1051a418eb69a
Author: devozerov <[email protected]>
Date: 2017-08-14T07:34:02Z
Lazy worker key.
commit ccdd179a8563c7585104982c536402b18e5ef367
Author: devozerov <[email protected]>
Date: 2017-08-14T07:48:07Z
Implemented "onQueryRequest" handling.
commit f9960dff9d0e51b5a9b32473e5970d5d6b06a6a6
Author: devozerov <[email protected]>
Date: 2017-08-14T07:50:25Z
Implemented "onQueryRequest" handling.
commit 9e119bddf900f38b47bd1a1a64d5290c56d15d35
Author: devozerov <[email protected]>
Date: 2017-08-14T07:54:14Z
Next page request.
commit 4f1421cdbd1f5e48375eb97c8635cfec8c9e17b6
Author: devozerov <[email protected]>
Date: 2017-08-14T07:54:22Z
Next page request.
commit a063e21fa6a66326bb9a3bd15af81cf5178aafd0
Author: devozerov <[email protected]>
Date: 2017-08-14T07:57:22Z
Minors.
----
> SQL: lazy ResultSet for map query
> ---------------------------------
>
> Key: IGNITE-5991
> URL: https://issues.apache.org/jira/browse/IGNITE-5991
> Project: Ignite
> Issue Type: Improvement
> Components: sql
> Affects Versions: 2.1
> Reporter: Vladimir Ozerov
> Assignee: Vladimir Ozerov
> Priority: Critical
> Fix For: 2.2
>
>
> Currently we move the whole {{ResultSet}} to memory when executing SQL query
> on mapper. If result set is large enough, this could easily bring server down
> due to high GC pressure or even OOME.
> To avoid that we should stream H2's {{ResultSet}} to our own consumer, which
> will construct a page and send it to the client When a page is sent,
> consumer will block current thread until "next page request" is received.
> This approach has disadvantage - query thread will be blocked. However,
> implementation should be fairly easy and will allow us to avoid OOMEs on
> server. In future we will improve it to minimize blocking (or even avoid it
> completely).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
