Re: perl streaming framework

[Shlomi Fish]

Hi Warren!

Please reply to list.

On Tue, 14 Jul 2020 10:34:57 +0800
Warren Pang  wrote:

> Hi
> 
> Does perl have a stream computing framework?
> I know Java/python have many, such as spark, flink, beam etc.
> But I am looking for a perl alternative, since most of our team members
> have been using perl for data analysis.
> 

1. Do you want one for Raku which was formerly known as "Perl 6" (see
https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for "perl 5"?

2. What do you mean by "stream computing framework"? Is there a wikipedia/etc.
page for them?

3. Can you link to some examples?

4. Do you mean something like http://pdl.perl.org/ (or numpy for python)?


> Thank you.



-- 

Shlomi Fish   https://www.shlomifish.org/
Why I Love Perl - https://shlom.in/joy-of-perl

The reason the Messiah has not come yet, is because Chuck Norris keeps finding
faults in God’s plan for his coming.
— https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/

Please reply to list if it's a mailing list post - https://shlom.in/reply .

Re: perl streaming framework

[Fernando Santagata]

…or maybe something like Pandas https://pandas.pydata.org/ ?

BTW, it would be nice to build something like that for Raku.

(Shameless plug: I'm working on a Raku interface to the GNU Scientific
Library (see: https://modules.raku.org/search/?q=Math%3A%3ALibgsl). The
next modules in my queue are all about statistics, so it might be easy to
build a framework like Pandas using those)

On Tue, Jul 14, 2020 at 10:01 AM Shlomi Fish  wrote:

> Hi Warren!
>
> Please reply to list.
>
> On Tue, 14 Jul 2020 10:34:57 +0800
> Warren Pang  wrote:
>
> > Hi
> >
> > Does perl have a stream computing framework?
> > I know Java/python have many, such as spark, flink, beam etc.
> > But I am looking for a perl alternative, since most of our team members
> > have been using perl for data analysis.
> >
>
> 1. Do you want one for Raku which was formerly known as "Perl 6" (see
> https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for "perl
> 5"?
>
> 2. What do you mean by "stream computing framework"? Is there a
> wikipedia/etc.
> page for them?
>
> 3. Can you link to some examples?
>
> 4. Do you mean something like http://pdl.perl.org/ (or numpy for python)?
>
>
> > Thank you.
>
>
>
> --
>
> Shlomi Fish   https://www.shlomifish.org/
> Why I Love Perl - https://shlom.in/joy-of-perl
>
> The reason the Messiah has not come yet, is because Chuck Norris keeps
> finding
> faults in God’s plan for his coming.
> — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/
>
> Please reply to list if it's a mailing list post - https://shlom.in/reply
> .
>


-- 
Fernando Santagata

Re: perl streaming framework

[Warren Pang]

Hello

We are already using perl PDL and something similar.
The streaming framework is mainly used for real time data analysis.
Tyler from Apache Beam project has wrote a great book about streaming
system:
http://streamingsystems.net/
So I have interest to know if there is the perl implementation for that.

Thank you.



On Tue, Jul 14, 2020 at 3:39 PM Shlomi Fish  wrote:

> Hi Warren!
>
> Please reply to list.
>
> On Tue, 14 Jul 2020 10:34:57 +0800
> Warren Pang  wrote:
>
> > Hi
> >
> > Does perl have a stream computing framework?
> > I know Java/python have many, such as spark, flink, beam etc.
> > But I am looking for a perl alternative, since most of our team members
> > have been using perl for data analysis.
> >
>
> 1. Do you want one for Raku which was formerly known as "Perl 6" (see
> https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for "perl
> 5"?
>
> 2. What do you mean by "stream computing framework"? Is there a
> wikipedia/etc.
> page for them?
>
> 3. Can you link to some examples?
>
> 4. Do you mean something like http://pdl.perl.org/ (or numpy for python)?
>
>
> > Thank you.
>
>
>
> --
>
> Shlomi Fish   https://www.shlomifish.org/
> Why I Love Perl - https://shlom.in/joy-of-perl
>
> The reason the Messiah has not come yet, is because Chuck Norris keeps
> finding
> faults in God’s plan for his coming.
> — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/
>
> Please reply to list if it's a mailing list post - https://shlom.in/reply
> .
>

NativeLibs not loading on Module testing

[Richard Hainsworth]

I'm adding a Module to the ecosystem, and the Build system failed, see

https://travis-ci.com/github/Raku/ecosystem/builds/175326153

It doesn't seem that it is my Module that's failing, but NativeLibs.

see line 165.

As for my Module (raku-pod-render) it passes all tests, including 
Test-Meta locally, so I don't think its my module.


Richard aka finanalyst

Re: perl streaming framework

[Richard Hainsworth]

There was a talk by Steven Lembark about using the lazy gathers and 
concurrency constructs in Raku at the last Perl conference that might be 
of interest.


Steven (if I remember correctly) was using these tools to analyse vast 
quantities of data.


The language constructs exist in Raku, and the actual processing is as 
fast as any other language. But the ease of writing, and thus 
maintaining the code, is much much simpler.


On 14/07/2020 09:54, Warren Pang wrote:

Hello

We are already using perl PDL and something similar.
The streaming framework is mainly used for real time data analysis.
Tyler from Apache Beam project has wrote a great book about streaming 
system:

http://streamingsystems.net/
So I have interest to know if there is the perl implementation for that.

Thank you.



On Tue, Jul 14, 2020 at 3:39 PM Shlomi Fish > wrote:


Hi Warren!

Please reply to list.

On Tue, 14 Jul 2020 10:34:57 +0800
Warren Pang mailto:war...@gmail.com>> wrote:

> Hi
>
> Does perl have a stream computing framework?
> I know Java/python have many, such as spark, flink, beam etc.
> But I am looking for a perl alternative, since most of our team
members
> have been using perl for data analysis.
>

1. Do you want one for Raku which was formerly known as "Perl 6" (see
https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for
"perl 5"?

2. What do you mean by "stream computing framework"? Is there a
wikipedia/etc.
page for them?

3. Can you link to some examples?

4. Do you mean something like http://pdl.perl.org/ (or numpy for
python)?


> Thank you.



-- 


Shlomi Fish https://www.shlomifish.org/
Why I Love Perl - https://shlom.in/joy-of-perl

The reason the Messiah has not come yet, is because Chuck Norris
keeps finding
faults in God’s plan for his coming.
    — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/

Please reply to list if it's a mailing list post -
https://shlom.in/reply .

impact of compiling pod doc

[Marcel Timmerman]

Hi,

I was wondering if pod documentation has a large impact on compiling 
modules. I assume on small files it would be ignorable but I have some 
modules which have grown big, one has 7153 lines of which the biggest 
part is pod doc. Would it be useful to split such a file in two. one for 
code and the other for doc to improve the install time?


Regards,
Marcel

Re: perl streaming framework

[Shlomi Fish]

Hi Warren,

On Tue, 14 Jul 2020 16:54:49 +0800
Warren Pang  wrote:

> Hello
> 
> We are already using perl PDL and something similar.
> The streaming framework is mainly used for real time data analysis.
> Tyler from Apache Beam project has wrote a great book about streaming
> system:
> http://streamingsystems.net/
> So I have interest to know if there is the perl implementation for that.
> 

I think I get the general idea. You can try bridging perl 5 to Java, Python, or
whatever's APIs using the Inline::* modules such as
https://metacpan.org/pod/distribution/Inline-Java/lib/Inline/Java.pod
. Some of them work fairly well from my experience (caveat: I currently
comaintain
Inline-Ruby:
https://metacpan.org/pod/distribution/Inline-Ruby/lib/Inline/Ruby.pod
)

> Thank you.
> 
> 
> 
> On Tue, Jul 14, 2020 at 3:39 PM Shlomi Fish  wrote:
> 
> > Hi Warren!
> >
> > Please reply to list.
> >
> > On Tue, 14 Jul 2020 10:34:57 +0800
> > Warren Pang  wrote:
> >  
> > > Hi
> > >
> > > Does perl have a stream computing framework?
> > > I know Java/python have many, such as spark, flink, beam etc.
> > > But I am looking for a perl alternative, since most of our team members
> > > have been using perl for data analysis.
> > >  
> >
> > 1. Do you want one for Raku which was formerly known as "Perl 6" (see
> > https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for "perl
> > 5"?
> >
> > 2. What do you mean by "stream computing framework"? Is there a
> > wikipedia/etc.
> > page for them?
> >
> > 3. Can you link to some examples?
> >
> > 4. Do you mean something like http://pdl.perl.org/ (or numpy for python)?
> >
> >  
> > > Thank you.  
> >
> >
> >
> > --
> >
> > Shlomi Fish   https://www.shlomifish.org/
> > Why I Love Perl - https://shlom.in/joy-of-perl
> >
> > The reason the Messiah has not come yet, is because Chuck Norris keeps
> > finding
> > faults in God’s plan for his coming.
> > — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/
> >
> > Please reply to list if it's a mailing list post - https://shlom.in/reply
> > .
> >  



-- 

Shlomi Fish   https://www.shlomifish.org/
https://youtu.be/GoEn1YfYTBM - Tiffany Alvord - “Fall Together”

Selina: How may I be of service?
Alan: Well, according to the Codex, we’re supposed to be slain by you.
— https://www.shlomifish.org/humour/Selina-Mandrake/

Please reply to list if it's a mailing list post - https://shlom.in/reply .

Re: perl streaming framework

[Brad Gilbert]

If you really want a streaming framework for Perl, the mailing list for
Raku users might not be the best place to ask.
(Raku used to be known as Perl6, and we haven't done anything to change the
name of this mailing list.)

Raku has a very similar syntax to Perl. (It used to be called Perl6 after
all.)
But it is different enough that it would take experience Perl programmers a
while to get used to.
(It might actually be easier for Perl novices to get used to it.)

It would probably be a better idea to go to a place that Perl programmers
frequent.
PerlMonks might be a good starting place.

On Tue, Jul 14, 2020 at 3:55 AM Warren Pang  wrote:

> Hello
>
> We are already using perl PDL and something similar.
> The streaming framework is mainly used for real time data analysis.
> Tyler from Apache Beam project has wrote a great book about streaming
> system:
> http://streamingsystems.net/
> So I have interest to know if there is the perl implementation for that.
>
> Thank you.
>
>
>
> On Tue, Jul 14, 2020 at 3:39 PM Shlomi Fish 
> wrote:
>
>> Hi Warren!
>>
>> Please reply to list.
>>
>> On Tue, 14 Jul 2020 10:34:57 +0800
>> Warren Pang  wrote:
>>
>> > Hi
>> >
>> > Does perl have a stream computing framework?
>> > I know Java/python have many, such as spark, flink, beam etc.
>> > But I am looking for a perl alternative, since most of our team members
>> > have been using perl for data analysis.
>> >
>>
>> 1. Do you want one for Raku which was formerly known as "Perl 6" (see
>> https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for "perl
>> 5"?
>>
>> 2. What do you mean by "stream computing framework"? Is there a
>> wikipedia/etc.
>> page for them?
>>
>> 3. Can you link to some examples?
>>
>> 4. Do you mean something like http://pdl.perl.org/ (or numpy for python)?
>>
>>
>> > Thank you.
>>
>>
>>
>> --
>>
>> Shlomi Fish   https://www.shlomifish.org/
>> Why I Love Perl - https://shlom.in/joy-of-perl
>>
>> The reason the Messiah has not come yet, is because Chuck Norris keeps
>> finding
>> faults in God’s plan for his coming.
>> — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/
>>
>> Please reply to list if it's a mailing list post - https://shlom.in/reply
>> .
>>
>

Re: perl streaming framework

[Aureliano Guedes]

I already mentioned it here.
Since Raku supports truly well functional programming.

To data analysis might be better something like
https://www.tidyverse.org/ implemented
in R to approximate a natural language.




On Tue, Jul 14, 2020 at 11:03 AM Brad Gilbert  wrote:

> If you really want a streaming framework for Perl, the mailing list for
> Raku users might not be the best place to ask.
> (Raku used to be known as Perl6, and we haven't done anything to change
> the name of this mailing list.)
>
> Raku has a very similar syntax to Perl. (It used to be called Perl6 after
> all.)
> But it is different enough that it would take experience Perl programmers
> a while to get used to.
> (It might actually be easier for Perl novices to get used to it.)
>
> It would probably be a better idea to go to a place that Perl programmers
> frequent.
> PerlMonks might be a good starting place.
>
> On Tue, Jul 14, 2020 at 3:55 AM Warren Pang  wrote:
>
>> Hello
>>
>> We are already using perl PDL and something similar.
>> The streaming framework is mainly used for real time data analysis.
>> Tyler from Apache Beam project has wrote a great book about streaming
>> system:
>> http://streamingsystems.net/
>> So I have interest to know if there is the perl implementation for that.
>>
>> Thank you.
>>
>>
>>
>> On Tue, Jul 14, 2020 at 3:39 PM Shlomi Fish 
>> wrote:
>>
>>> Hi Warren!
>>>
>>> Please reply to list.
>>>
>>> On Tue, 14 Jul 2020 10:34:57 +0800
>>> Warren Pang  wrote:
>>>
>>> > Hi
>>> >
>>> > Does perl have a stream computing framework?
>>> > I know Java/python have many, such as spark, flink, beam etc.
>>> > But I am looking for a perl alternative, since most of our team members
>>> > have been using perl for data analysis.
>>> >
>>>
>>> 1. Do you want one for Raku which was formerly known as "Perl 6" (see
>>> https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for
>>> "perl 5"?
>>>
>>> 2. What do you mean by "stream computing framework"? Is there a
>>> wikipedia/etc.
>>> page for them?
>>>
>>> 3. Can you link to some examples?
>>>
>>> 4. Do you mean something like http://pdl.perl.org/ (or numpy for
>>> python)?
>>>
>>>
>>> > Thank you.
>>>
>>>
>>>
>>> --
>>>
>>> Shlomi Fish   https://www.shlomifish.org/
>>> Why I Love Perl - https://shlom.in/joy-of-perl
>>>
>>> The reason the Messiah has not come yet, is because Chuck Norris keeps
>>> finding
>>> faults in God’s plan for his coming.
>>> — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/
>>>
>>> Please reply to list if it's a mailing list post -
>>> https://shlom.in/reply .
>>>
>>

-- 
Aureliano Guedes
skype: aureliano.guedes
contato:  (11) 94292-6110
whatsapp +5511942926110

Re: impact of compiling pod doc

[JJ Merelo]

It's going to be pretty much the same. If it's installed, it's going to be
precompiled anyway. The overhead added by reading the file might even make
it slower.
Of course, you can always give it a try and measure. Measuring might always
surprise you :-)

El mar., 14 jul. 2020 a las 14:20, Marcel Timmerman ()
escribió:

> Hi,
>
> I was wondering if pod documentation has a large impact on compiling
> modules. I assume on small files it would be ignorable but I have some
> modules which have grown big, one has 7153 lines of which the biggest
> part is pod doc. Would it be useful to split such a file in two. one for
> code and the other for doc to improve the install time?
>
> Regards,
> Marcel
>


-- 
JJ

Re: NativeLibs not loading on Module testing

[JJ Merelo]

I've submitted now a PR to NativeLibs that fixes that issue.

El mar., 14 jul. 2020 a las 11:03, Richard Hainsworth (<
rnhainswo...@gmail.com>) escribió:

> I'm adding a Module to the ecosystem, and the Build system failed, see
>
> https://travis-ci.com/github/Raku/ecosystem/builds/175326153
>
> It doesn't seem that it is my Module that's failing, but NativeLibs.
>
> see line 165.
>
> As for my Module (raku-pod-render) it passes all tests, including
> Test-Meta locally, so I don't think its my module.
>
> Richard aka finanalyst
>


-- 
JJ

Re: perl streaming framework

[Ralph Mellor]

I second Brad's comment -- perlmonks.org is a great place to ask.

Use the following link for a quick start. The user interface is something
out of the dark ages but you'll generally get outstandingly good replies,
especially if you explicitly add something like "Thank you for considering
my question." They honor humility there. :)

I recommend you do NOT mention Raku or Perl 6. It isn't Perl, despite
the name. You will almost certainly ruin your chance of keeping the focus
on useful non-confusing answers if you mention Raku or Perl 6.

https://perlmonks.org/?node=Seekers%20of%20Perl%20Wisdom#post

On Tue, Jul 14, 2020 at 3:35 AM Warren Pang  wrote:
>
> Hi
>
> Does perl have a stream computing framework?
> I know Java/python have many, such as spark, flink, beam etc.
> But I am looking for a perl alternative, since most of our team members have 
> been using perl for data analysis.
>
> Thank you.
>

Re: impact of compiling pod doc

[Marcel Timmerman]

Thank you for answer JJ.

It is quite a work to split such a large file up so I thought I'd better 
ask before I dive in head first. Later I might think it over. I have 
this documentation on the github pages too so I could separate the pod 
doc and keep them somewhere else where they won't get processed and 
installed.


Thanks again,
Marcel

It's going to be pretty much the same. If it's installed, it's going 
to be precompiled anyway. The overhead added by reading the file might 
even make it slower.
Of course, you can always give it a try and measure. Measuring might 
always surprise you :-)


El mar., 14 jul. 2020 a las 14:20, Marcel Timmerman (>) escribió:


Hi,

I was wondering if pod documentation has a large impact on compiling
modules. I assume on small files it would be ignorable but I have
some
modules which have grown big, one has 7153 lines of which the biggest
part is pod doc. Would it be useful to split such a file in two.
one for
code and the other for doc to improve the install time?

Regards,
Marcel



--
JJ

Re: perl streaming framework

[William Michels via perl6-users]

Steven Lembark's talk (using Raku to analyze 123GB of BLAST-formatted
AA sequences). Definitely worth watching:

https://www.youtube.com/watch?v=rgCk5w2o-GY

On Tue, Jul 14, 2020 at 2:16 AM Richard Hainsworth
 wrote:
>
> There was a talk by Steven Lembark about using the lazy gathers and 
> concurrency constructs in Raku at the last Perl conference that might be of 
> interest.
>
> Steven (if I remember correctly) was using these tools to analyse vast 
> quantities of data.
>
> The language constructs exist in Raku, and the actual processing is as fast 
> as any other language. But the ease of writing, and thus maintaining the 
> code, is much much simpler.
>
> On 14/07/2020 09:54, Warren Pang wrote:
>
> Hello
>
> We are already using perl PDL and something similar.
> The streaming framework is mainly used for real time data analysis.
> Tyler from Apache Beam project has wrote a great book about streaming system:
> http://streamingsystems.net/
> So I have interest to know if there is the perl implementation for that.
>
> Thank you.
>
>
>
> On Tue, Jul 14, 2020 at 3:39 PM Shlomi Fish  wrote:
>>
>> Hi Warren!
>>
>> Please reply to list.
>>
>> On Tue, 14 Jul 2020 10:34:57 +0800
>> Warren Pang  wrote:
>>
>> > Hi
>> >
>> > Does perl have a stream computing framework?
>> > I know Java/python have many, such as spark, flink, beam etc.
>> > But I am looking for a perl alternative, since most of our team members
>> > have been using perl for data analysis.
>> >
>>
>> 1. Do you want one for Raku which was formerly known as "Perl 6" (see
>> https://en.wikipedia.org/wiki/Raku_(programming_language) ) or for "perl 5"?
>>
>> 2. What do you mean by "stream computing framework"? Is there a 
>> wikipedia/etc.
>> page for them?
>>
>> 3. Can you link to some examples?
>>
>> 4. Do you mean something like http://pdl.perl.org/ (or numpy for python)?
>>
>>
>> > Thank you.
>>
>>
>>
>> --
>>
>> Shlomi Fish   https://www.shlomifish.org/
>> Why I Love Perl - https://shlom.in/joy-of-perl
>>
>> The reason the Messiah has not come yet, is because Chuck Norris keeps 
>> finding
>> faults in God’s plan for his coming.
>> — https://www.shlomifish.org/humour/bits/facts/Chuck-Norris/
>>
>> Please reply to list if it's a mailing list post - https://shlom.in/reply .

Re: perl streaming framework

[Warren Pang]

Thank you all very much.

I have tried to search "perl discussion" and it brings me to perl6's list
page.
Yes for data analysis we primarily use classic perl5, which is smart enough
especially the regex matching.
There are "spark streaming", "flink streaming", "storm streaming", and a
lot of others, but they don't support perl language well.
So I expect the community, either perl6 or perl5, can make that a framework.
We can't lose the capability in big data, cloud computing, AI, ML,
streaming, these are the main features of current internet.
Everyone today writes CGI with perl? NO.

Thanks.

Re: perl streaming framework

[William Michels via perl6-users]

Hi Warren,

The topic you raise is an interesting one. When I've previously
searched for 'streaming' and 'Python' I often see articles on
Iterables such as the following:

[1] "Data streaming in Python: generators, iterators, iterables"
https://rare-technologies.com/data-streaming-in-python-generators-iterators-iterables/

[2] "Python Basics: Iteration, Iterables, Iterators, and Looping"
https://towardsdatascience.com/python-basics-iteration-and-looping-6ca63b30835c

>From the first URL, there is an introductory quote regarding Lazy
Evaluation. Well, Raku does Lazy Evaluation, so no problem there:

"There are tools and concepts in computing that are very powerful but
potentially confusing even to advanced users. One such concept is data
streaming (aka lazy evaluation), which can be realized neatly and
natively in Python."

>From the second URL, you will find a discussion on Iterators:
"An iterator is an object representing a stream of data. You can
create an iterator object by applying the iter() built-in function to
an iterable."

So maybe we should be looking for articles on Iterators in Raku? Well
as luck would have it, there are two recent blog posts on the subject:

https://datakinds.github.io/2020/06/24/python-s-itertools-in-pure-raku
https://datakinds.github.io/2020/06/25/explaining-raku-using-itertools

And if you want to search further, you can also take a look at this
series of four Raku (Perl6) blog posts--which has been recently
updated--but stretches all the way back to 2018:

https://0racle.info/articles/pick_and_choose_part_n

HTH, Bill.

W. Michels, Ph.D.






On Tue, Jul 14, 2020 at 5:43 PM Warren Pang  wrote:
>
> Thank you all very much.
>
> I have tried to search "perl discussion" and it brings me to perl6's list 
> page.
> Yes for data analysis we primarily use classic perl5, which is smart enough 
> especially the regex matching.
> There are "spark streaming", "flink streaming", "storm streaming", and a lot 
> of others, but they don't support perl language well.
> So I expect the community, either perl6 or perl5, can make that a framework.
> We can't lose the capability in big data, cloud computing, AI, ML, streaming, 
> these are the main features of current internet.
> Everyone today writes CGI with perl? NO.
>
> Thanks.
>

Re: perl streaming framework

[Aureliano Guedes]

I'm really sad about the conceptions of programming with non-functional
languages. Truly better an R as a reference than a OO in data analysis.

On Wed, Jul 15, 2020 at 12:13 AM William Michels 
wrote:

> Hi Warren,
>
> The topic you raise is an interesting one. When I've previously
> searched for 'streaming' and 'Python' I often see articles on
> Iterables such as the following:
>
> [1] "Data streaming in Python: generators, iterators, iterables"
>
> https://rare-technologies.com/data-streaming-in-python-generators-iterators-iterables/
>
> [2] "Python Basics: Iteration, Iterables, Iterators, and Looping"
>
> https://towardsdatascience.com/python-basics-iteration-and-looping-6ca63b30835c
>
> From the first URL, there is an introductory quote regarding Lazy
> Evaluation. Well, Raku does Lazy Evaluation, so no problem there:
>
> "There are tools and concepts in computing that are very powerful but
> potentially confusing even to advanced users. One such concept is data
> streaming (aka lazy evaluation), which can be realized neatly and
> natively in Python."
>
> From the second URL, you will find a discussion on Iterators:
> "An iterator is an object representing a stream of data. You can
> create an iterator object by applying the iter() built-in function to
> an iterable."
>
> So maybe we should be looking for articles on Iterators in Raku? Well
> as luck would have it, there are two recent blog posts on the subject:
>
> https://datakinds.github.io/2020/06/24/python-s-itertools-in-pure-raku
> https://datakinds.github.io/2020/06/25/explaining-raku-using-itertools
>
> And if you want to search further, you can also take a look at this
> series of four Raku (Perl6) blog posts--which has been recently
> updated--but stretches all the way back to 2018:
>
> https://0racle.info/articles/pick_and_choose_part_n
>
> HTH, Bill.
>
> W. Michels, Ph.D.
>
>
>
>
>
>
> On Tue, Jul 14, 2020 at 5:43 PM Warren Pang  wrote:
> >
> > Thank you all very much.
> >
> > I have tried to search "perl discussion" and it brings me to perl6's
> list page.
> > Yes for data analysis we primarily use classic perl5, which is smart
> enough especially the regex matching.
> > There are "spark streaming", "flink streaming", "storm streaming", and a
> lot of others, but they don't support perl language well.
> > So I expect the community, either perl6 or perl5, can make that a
> framework.
> > We can't lose the capability in big data, cloud computing, AI, ML,
> streaming, these are the main features of current internet.
> > Everyone today writes CGI with perl? NO.
> >
> > Thanks.
> >
>


-- 
Aureliano Guedes
skype: aureliano.guedes
contato:  (11) 94292-6110
whatsapp +5511942926110

Re: perl streaming framework

[Warren Pang]

Thanks for the info @Wiliam.

We are probably seeking for a streaming framework which
is Engineering-oriented.
The documentation you provided are mostly Algorithm-oriented.
For instance, as an algorithm engineer, I can implement the algorithm
Logistic regression by hand.
But I won't do this, instead I will use a framework such as Tensorflow,
which is much easier and more standard.
For an engineering-oriented platform and technology details, please refer
to this small book:
https://mapr.com/introduction-to-apache-flink/assets/introduction-to-apache-flink.pdf


And, we team know streaming well, if the community has the interest to
develop that a framework, we will try our best to support it.

Thank you.



On Wed, Jul 15, 2020 at 11:13 AM William Michels 
wrote:

> Hi Warren,
>
> The topic you raise is an interesting one. When I've previously
> searched for 'streaming' and 'Python' I often see articles on
> Iterables such as the following:
>
> [1] "Data streaming in Python: generators, iterators, iterables"
>
> https://rare-technologies.com/data-streaming-in-python-generators-iterators-iterables/
>
> [2] "Python Basics: Iteration, Iterables, Iterators, and Looping"
>
> https://towardsdatascience.com/python-basics-iteration-and-looping-6ca63b30835c
>
> From the first URL, there is an introductory quote regarding Lazy
> Evaluation. Well, Raku does Lazy Evaluation, so no problem there:
>
> "There are tools and concepts in computing that are very powerful but
> potentially confusing even to advanced users. One such concept is data
> streaming (aka lazy evaluation), which can be realized neatly and
> natively in Python."
>
> From the second URL, you will find a discussion on Iterators:
> "An iterator is an object representing a stream of data. You can
> create an iterator object by applying the iter() built-in function to
> an iterable."
>
> So maybe we should be looking for articles on Iterators in Raku? Well
> as luck would have it, there are two recent blog posts on the subject:
>
> https://datakinds.github.io/2020/06/24/python-s-itertools-in-pure-raku
> https://datakinds.github.io/2020/06/25/explaining-raku-using-itertools
>
> And if you want to search further, you can also take a look at this
> series of four Raku (Perl6) blog posts--which has been recently
> updated--but stretches all the way back to 2018:
>
> https://0racle.info/articles/pick_and_choose_part_n
>
> HTH, Bill.
>
> W. Michels, Ph.D.
>
>
>
>
>
>
> On Tue, Jul 14, 2020 at 5:43 PM Warren Pang  wrote:
> >
> > Thank you all very much.
> >
> > I have tried to search "perl discussion" and it brings me to perl6's
> list page.
> > Yes for data analysis we primarily use classic perl5, which is smart
> enough especially the regex matching.
> > There are "spark streaming", "flink streaming", "storm streaming", and a
> lot of others, but they don't support perl language well.
> > So I expect the community, either perl6 or perl5, can make that a
> framework.
> > We can't lose the capability in big data, cloud computing, AI, ML,
> streaming, these are the main features of current internet.
> > Everyone today writes CGI with perl? NO.
> >
> > Thanks.
> >
>