1. No. Go will never scan objects outside of the Go-allocated heap. That 
includes mmap'd memory.
That means you can't have pointers from such memory into the Go heap.  
Pointers within the mmap'd area are fine.

> that also means no regular Go pointer should be defined into such structs

Right.

On Wednesday, September 19, 2018 at 7:39:33 PM UTC-7, Compl Yue wrote:
>
> Hi Gophers,
>
> I'm new to Go and excited by it's elegancy and potentials :D
>
> I'm investigating into the Go way to serve massive structured data which's 
> backed by few huge files mmap-ed.
>
> As I researched so far, boltdb has done similar things pretty successful, 
> but it received criticism about its transactional performance, so I wonder 
> if it is be coz of poor GC interactions (besides global write locking), and 
> searched the actively maintained bbolt codebase, I found no GC related 
> coordination code.
>
> I read about in this group, that GC will scan memory with missing runtime 
> type for any words look like pointers, as to be `conservative`, so I came 
> to the question:
>
>    1. If a regular `*struct{...}` pointer is obtained via 
>    `unsafe.Pointer()` by reinterpreting a `[]byte` offset from mmap-ed 
> memory, 
>    obviously it has no runtime type info from Go allocator, then will it 
>    invoke GC to scan the bytes it points to ?
>    2. And if 1.=> True, will GC treat pointer-like words within the 
>    struct as Go pointers thus keep pointed-to object alive ?
>
> If both 1. and 2. are True, then those structs living in mmap-ed memory 
> can fully function as Go objects (i.e. with pointer fields), but I worry 
> about too much performance impact will limit number of such pointers to be 
> held at runtime, then Go pointers need to be reinterpreted on-demand, from 
> offsets on-the-fly, at last not easily be correct to hold pointer fields.
>
> So I hope 1.=>False then intensive use of such pointers causes no 
> performance penalty, but that also means no regular Go pointer should be 
> defined into such structs. I think boltdb did this and I can live with it.
>
> Thanks with best regards,
> Compl
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"golang-nuts" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to golang-nuts+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to