Re: [Bug-apl] Use with word2vec

2017-04-28 Thread Leslie S Satenstein
Hi  Fred  Following up on Xiao-Yong Jin's response. You did not mention if you need the data in realtime or if you can work at the apl interpretor speed.Do you have a structure for your data.  You mentioned a format of  [text][floats] without specifyingsize of text and number of floats.  Is y

Re: [Bug-apl] Use with word2vec

2017-04-28 Thread Xiao-Yong Jin
If shared variables can go through SHMEM, you can probably interface cuda that way without much bottle neck. But with the way GNU APL is implemented now, there are just too many other limitations on performance with arrays of such size. > On Apr 28, 2017, at 9:19 PM, Fred Weigel wrote: > > Jeurg

[Bug-apl] Use with word2vec

2017-04-28 Thread Fred Weigel
Jeurgen, and other GNU APL experts. I am exploring neural nets, word2vec and some other AI related areas. Right now, I want to tie in google's word2vec trained models (the billion word one GoogleNews-vectors-negative300.bin.gz) This is a binary file containing a lot of floating point data -- abo

[Bug-apl] Use with word2vec

2017-04-28 Thread Fred Weigel
Jeurgen, and other GNU APL experts. I am exploring neural nets, word2vec and some other AI related areas. Right now, I want to tie in google's word2vec trained models (the billion word one GoogleNews-vectors-negative300.bin.gz) This is a binary file containing a lot of floating point data -- abo