Tham created ARROW-5410: --------------------------- Summary: Crash at arrow::internal::FileWrite Key: ARROW-5410 URL: https://issues.apache.org/jira/browse/ARROW-5410 Project: Apache Arrow Issue Type: Bug Environment: Windows version 10.0.14393.0 (rs1_release.160715-1616)
Reporter: Tham My applicationĀ is writing a bunch of parquet files and it often crashes. Most of the time it crashes when writing the first file, sometimes it can write the first file and crashing at the 2nd file. The file can always be opened. It only crashes at writeTable. As I tested, my application crashes when build with release mode, but don't crash with debug mode. It crashed only on one Windows machine, not others. Here is stack trace from dump file: {code:java} STACK_TEXT: 0000001e`10efd840 00007ffc`0333d53f : 00000000`00000000 0000001e`10efe230 00000000`00000033 00007ffc`032dbe21 : CortexSync!google_breakpad::ExceptionHandler::HandleInvalidParameter+0x1a0 0000001e`10efe170 00007ffc`0333d559 : 00000000`ffffff02 00007ffc`032da63d 00000000`00000033 00000000`00000033 : ucrtbase!invalid_parameter+0x13f 0000001e`10efe1b0 00007ffc`03318664 : 00007ff7`7f7c8489 00000000`ffffff02 0000001e`10efe230 00000000`00000033 : ucrtbase!invalid_parameter_noinfo+0x9 0000001e`10efe1f0 00007ffc`032d926d : 00000000`ffffffff 00000000`00000140 00000000`00000005 00000122`bbe61e30 : ucrtbase!_acrt_uninitialize_command_line+0x6fd4 0000001e`10efe250 00007ff7`7f66585e : 00000010`00000005 00000000`00000000 0000001e`10efe560 00000122`b2337b88 : ucrtbase!write+0x8d 0000001e`10efe2a0 00007ff7`7f632785 : 00007ff7`00000000 00007ff7`7f7bb153 00000122`bbe890e0 0000001e`10efe634 : CortexSync!arrow::internal::FileWrite+0x5e 0000001e`10efe360 00007ff7`7f632442 : 00000000`0000348a 00000000`00000004 0000733f`5e86f38c 00000122`bbe14c40 : CortexSync!arrow::io::OSFile::Write+0x1d5 0000001e`10efe510 00007ff7`7f71c1b9 : 0000001e`10efe738 00007ff7`7f665522 00000122`bbffe6e0 00000000`ffffffff : CortexSync!arrow::io::FileOutputStream::Write+0x12 0000001e`10efe540 00007ff7`7f79cb2f : 00000122`bbe61e30 00000122`bbffe6e0 00000000`00000013 0000001e`10efe730 : CortexSync!parquet::ArrowOutputStream::Write+0x39 0000001e`10efe6e0 00007ff7`7f7abbaf : 00007ff7`7fd75b78 00007ff7`7fd75b78 0000001e`10efe9c0 00000000`00000000 : CortexSync!parquet::ThriftSerializer::Serialize<parquet::format::PageHeader>+0x11f 0000001e`10efe8c0 00007ff7`7f7aaf93 : 00000000`00000000 00000122`bbe3f450 00000000`00000002 00000122`bc0218d0 : CortexSync!parquet::SerializedPageWriter::WriteDictionaryPage+0x44f 0000001e`10efee20 00007ff7`7f7a3707 : 00000122`bbe3f450 0000001e`10eff250 00000000`00000000 00000122`b1680000 : CortexSync!parquet::TypedColumnWriterImpl<parquet::DataType<5> >::WriteDictionaryPage+0x143 0000001e`10efeed0 00007ff7`7f710480 : 0000001e`10eff1c0 00000000`00000000 00000122`bbe3f540 00000122`b2439998 : CortexSync!parquet::ColumnWriterImpl::Close+0x47 0000001e`10efef60 00007ff7`7f7154da : 00000122`bbec3cd0 0000001e`10eff1c0 00000122`bbec4bb0 00000122`b2439998 : CortexSync!parquet::arrow::FileWriter::Impl::`vector deleting destructor'+0x100 0000001e`10efefa0 00007ff7`7f71619c : 00000000`00000000 0000001e`10eff1c0 00000122`bbe89390 00000000`00000000 : CortexSync!parquet::arrow::FileWriter::Impl::WriteColumnChunk+0x6fa 0000001e`10eff150 00007ff7`7f202de9 : 00000000`00000001 0000001e`10eff430 00000000`0000000f 00000000`00000000 : CortexSync!parquet::arrow::FileWriter::WriteTable+0x6cc 0000001e`10eff410 00007ff7`7f18baf3 : 00000122`bbec39b0 00000122`b24c53f8 00000000`3f800000 00000000`00000000 : CortexSync!Cortex::Storage::ParquetStreamWriter::writeRowGroup+0x49{code} I tried a lot of ways to find out the root cause, but failed. Can anyone here give me some information/advice please, so that I can investigate more? Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005)