[
https://issues.apache.org/jira/browse/ARROW-18314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lucas Mation updated ARROW-18314:
---------------------------------
Description:
I issued two calls
```
ft <- path_to_dataset1
fa <- path_to_dataset2
#1)
tic()
d2 <- ft %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
toc()
927.11 sec elapsed
#returned a dataset with 44 obs, 38 columns, took abnormal time, 16min
#1)
tic()
d3 <- fa %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
terminate called after throwing an instance of 'cpp11::unwind_exception'
```
Then I got an error that craspad_hendler.exe stopped working. And R becomes
frozen, after a while R crashed too.
!image-2022-11-11-14-59-30-132.png!
was:
I issued two calls
```
ft <- path_to_dataset1
fa <- path_to_dataset2
tic()
d2 <- ft %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
toc()
927.11 sec elapsed
#returned a dataset with 44 obs, 38 columns, took abnormal time, 16min
ft <- paste0(p2,'/RAIS_operacional/vinc_1976_2001/parquet_temp')
fa <- paste0(p2,'/RAIS_operacional/vinc_1976_2001/parquet')
tic()
d3 <- fa %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
terminate called after throwing an instance of 'cpp11::unwind_exception'
```
Then I got an error that craspad_hendler.exe stopped working. And R becomes
frozen, after a while R crashed too.
!image-2022-11-11-14-59-30-132.png!
> "open_dataset(f) %>% filter(id %in% myvec) %>% collect" causes
> CPP11::unwind_execption, crashed R
> --------------------------------------------------------------------------------------------------
>
> Key: ARROW-18314
> URL: https://issues.apache.org/jira/browse/ARROW-18314
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: Lucas Mation
> Priority: Major
> Attachments: image-2022-11-11-14-55-36-430.png,
> image-2022-11-11-14-59-30-132.png
>
>
> I issued two calls
> ```
> ft <- path_to_dataset1
> fa <- path_to_dataset2
> #1)
> tic()
> d2 <- ft %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
> toc()
> 927.11 sec elapsed
> #returned a dataset with 44 obs, 38 columns, took abnormal time, 16min
> #1)
> tic()
> d3 <- fa %>% open_dataset %>% filter( pis %in% mypis ) %>% collect
> terminate called after throwing an instance of 'cpp11::unwind_exception'
> ```
> Then I got an error that craspad_hendler.exe stopped working. And R becomes
> frozen, after a while R crashed too.
> !image-2022-11-11-14-59-30-132.png!
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
