gortiz opened a new pull request, #15910:
URL: https://github.com/apache/pinot/pull/15910
In previous PR #15245, I modified MSE to return partial query stats when
errors are detected during query execution. However, that PR didn't change the
broker part, so although the broker received the stats, it didn't share them
with the customer.
This small PR solves that. Now, for example, a query like the following,
which fails with
`Received 1 error from servers: Cannot process join, reached number of rows
limit: 1048576`:
```sql
select *
from userAttributes a
CROSS join userAttributes g
```
Also _also_ returns the following stats:
```json
{
"type": "MAILBOX_RECEIVE",
"executionTimeMs": 85,
"fanIn": 4,
"rawMessages": 3,
"deserializedBytes": 1907,
"upstreamWaitMs": 185,
"children": [
{
"type": "MAILBOX_SEND",
"stage": 1,
"parallelism": 1,
"fanOut": 1,
"children": [
{
"type": "HASH_JOIN",
"executionTimeMs": 13,
"timeBuildingHashTableMs": 13,
"children": [
{
"type": "MAILBOX_RECEIVE",
"fanIn": 2,
"rawMessages": 2,
"deserializedBytes": 120,
"upstreamWaitMs": 15,
"children": [
{
"type": "EMPTY_MAILBOX_SEND",
"stage": 2,
"description": "No stats available for this stage",
"table": "userAttributes"
}
]
},
{
"type": "MAILBOX_RECEIVE",
"executionTimeMs": 11,
"emittedRows": 10000,
"fanIn": 2,
"rawMessages": 6,
"deserializedBytes": 290050,
"deserializationTimeMs": 3,
"upstreamWaitMs": 27,
"children": [
{
"type": "EMPTY_MAILBOX_SEND",
"stage": 3,
"description": "No stats available for this stage",
"table": "userAttributes"
}
]
}
]
}
]
}
]
}
```
Notice that given the error was raised in the JOIN operator, its inputs (the
leaf stages) didn't have time to finish and therefore they didn't have time to
send their local stats. That is the normal behavior in #15245
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
