Re: [R] parallel: socket connection behind a NAT router

Thanks! This solution also looks promising. It should be more stable than using ssh tunneling. I will also explore this method. Best, Jiefei On Tue, Jan 19, 2021 at 3:11 PM Martin Morgan wrote: > A different approach uses doRedis > https://CRAN.R-project.org/package=doRedis (currently archived,

Re: [R] parallel: socket connection behind a NAT router

Thank you! It works now!! Your guess is correct, I'm using windows so the default ssh does not work. Sadly the bug hasn't been fixed yet. The PuTTY solution works like a charm. Glad to know the ssh tunneling trick. This is much simpler than using port hole punching. This package is awesome! Many t

Re: [R] parallel: socket connection behind a NAT router

A different approach uses doRedis https://CRAN.R-project.org/package=doRedis (currently archived, but actively developed) for use with the foreach package, or RedisParam https://github.com/mtmorgan/RedisParam (not released) for use with Bioconductor's BiocParallel package. These use a redis ser

Re: [R] parallel: socket connection behind a NAT router

On Mon, Jan 18, 2021 at 9:42 PM Jiefei Wang wrote: > > Thanks for introducing this interesting package to me! it is great to know a > new powerful tool, but it seems like this method does not work in my > environment. ` parallelly::makeClusterPSOCK` will hang until timeout. > > I checked the ver

Re: [R] parallel: socket connection behind a NAT router

Thanks for introducing this interesting package to me! it is great to know a new powerful tool, but it seems like this method does not work in my environment. ` parallelly::makeClusterPSOCK` will hang until timeout. I checked the verbose output and it looks like the parallelly package also depends

Re: [R] parallel: socket connection behind a NAT router

If you have SSH access to the workers, then workers <- c("machine1.example.org", "machine2.example.org") cl <- parallelly::makeClusterPSOCK(workers) should do it. It does this without admin rights and port forwarding. See also the README in https://cran.r-project.org/package=parallelly. /Henrik

[R] parallel: socket connection behind a NAT router

Hi all, I have a few cloud instances and I want to use them to do parallel computing. I would like to create a socket cluster on my local machine to control the remote instances. Here is my network setup: local machine -- NAT -- Internet -- cloud instances In the parallel package, the server nee