[Ubuntu-zh] ?????? Ubuntu????????????CentOS??????????

2020-12-21 Thread Wush
centos的创始人另外开了一个叫Rocky Linux的项目。 -- 原始邮件 -- 发件人: "wojiushixxx"https://ubuntu.com/blog/migrating-to-ubuntu-lts-six-facts-for-centos-users 可能是因为CentOS要停止维护了吧(笑哭) -- 下一部分 -- 一个HTML附件被移除... URL: <" target="_blank" rel="noopener">https://lists

[Ubuntu-zh] ?????? ??????????????????????

2020-12-16 Thread Wush
改用SSD是不是快一点? -- 原始邮件 -- 发件人: "梅 凱"https://lists.ubuntu.com/archives/ubuntu-zh/attachments/20201205/270f00bb/attachment.html> >-- >ubuntu-zh mailing list >ubuntu-zh@lists.ubuntu.com >https://lists.ubuntu.com/mailman/listinfo/ubun

Re: [Rcpp-devel] `checkUserInterrupt()` might not be safe if Rcout is used.

2018-07-29 Thread Wush Wu
Hi Kevin, I tried the latest master branch ("522e66d9ea04502b4a98bb28642fb4724ff0a479") in R 3.5.1, but the `checkUserInterrupt` still does not throw the exception. The R is under a docker container (library/r-base:3.5.1), so there should be no GUI. Hope these info helps. Best, Wu

Re: [Rcpp-devel] `checkUserInterrupt()` might not be safe if Rcout is used.

2018-07-26 Thread Wush Wu
e > describing its use. > > (We might also consider in Rcpp wrapping our calls to Rprintf() in > R_ToplevelExec() and 'catching' and 'rethrowing' interrupts seen, but this > might have some unintended side-effects) > > Best, > Kevin > > On Thu, Jul 26,

[Rcpp-devel] `checkUserInterrupt()` might not be safe if Rcout is used.

2018-07-26 Thread Wush Wu
, right? Best, Wush ___ Rcpp-devel mailing list Rcpp-devel@lists.r-forge.r-project.org https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/rcpp-devel

Re: [R] Failed to read UTF-16LE file on Windows

2015-10-28 Thread Wush Wu
n, header = TRUE, sep = ",") ``` Hope it will help someone in the future. Wush 2015-10-27 21:24 GMT+08:00 Wush Wu : > Dear all, > > I tried to run the following code on 3 different OS: > > ``` > download.file(" > https://raw.githubusercontent.com/wush978/DataSci

[R] Failed to read UTF-16LE file on Windows

2015-10-27 Thread Wush Wu
encoding = "UTF-16LE")) : incomplete final line found on 'orglist-100.CSV' ``` Is there any recommended way to read a local UTF-16LE file on windows? Thanks, Wush [[alternative HTML version deleted]] __ R-help@r-project.o

Re: Frequency of RECEIVE << PING

2015-09-09 Thread Wush Wu
github.com/apache/incubator-zeppelin/commit/a9d686b40f0a5a37cdc775403866f711df70cf56 > > However, if you got 211 ping a second, it would mean you had 211 notebooks > opened, or that there is a bug (ping still sent after you move from > notebook for example) > > On Thu, Sep

Frequency of RECEIVE << PING

2015-09-09 Thread Wush Wu
Dear all, I saw about 211 line of logs of "INFO NotebookServer: RECEIVE << PING" in 1 second. Is there a parameter to configure the frequency of PING? --- Currently we use the zeppelin on commit: b4b4f5521a57fd3b0902b5e3ab0e228c10b8bac5 Best, Wush

[jira] [Created] (ZEPPELIN-264) Viewing Task Queue of Zeppelin

2015-08-25 Thread Wush Wu (JIRA)
Wush Wu created ZEPPELIN-264: Summary: Viewing Task Queue of Zeppelin Key: ZEPPELIN-264 URL: https://issues.apache.org/jira/browse/ZEPPELIN-264 Project: Zeppelin Issue Type: Wish

Re: Checking the reason of pending

2015-08-25 Thread Wush Wu
Dear Victors, Thanks for your reply. I'll create a ticket for this feature. Dear Moon, Thanks for the information. Sadly, our task are usually written in scala and python. FIFO is OK for us now, but knowing the job queue should be helpful. Wush 2015-08-25 23:20 GMT+08:00 moon soo Lee :

Checking the reason of pending

2015-08-25 Thread Wush Wu
Dear all, Our team is using zeppelin to submit ad hoc queries to our spark cluster. There are many people using the zeppelin at the same time. Sometimes, we need to wait each other and the task is pending for a long time. Is there a place to see the task queue in the zeppelin? Thanks, Wush

Re: Efficiency of leftOuterJoin a cassandra rdd

2015-07-15 Thread Wush Wu
Dear Sujit, Thanks for your suggestion. After testing, the `joinWithCassandraTable` does the trick like what you mentioned. The rdd2 only query those data which have the same key in rdd1. Best, Wush 2015-07-16 0:00 GMT+08:00 Sujit Pal : > Hi Wush, > > One option may be to try a r

Re: Efficiency of leftOuterJoin a cassandra rdd

2015-07-14 Thread Wush Wu
14, 2015 at 9:35 PM, Wush Wu wrote: >> >> Dear all, >> >> I have found a post discussing the same thing: >> >> https://groups.google.com/a/lists.datastax.com/forum/#!searchin/spark-connector-user/join/spark-connector-user/q3GotS-n0Wk/g-LPTteCEg0J >>

Re: Efficiency of leftOuterJoin a cassandra rdd

2015-07-14 Thread Wush Wu
github.com/datastax/spark-cassandra-connector/blob/v1.3.0-M2/doc/2_loading.md Wush 2015-07-15 12:15 GMT+08:00 Wush Wu : > Dear all, > > I am trying to join two RDDs, named rdd1 and rdd2. > > rdd1 is loaded from a textfile with about 33000 records. > > rdd2 is loaded from a table

Efficiency of leftOuterJoin a cassandra rdd

2015-07-14 Thread Wush Wu
from cassandra and only 33000 records left at the end. Is there a way to query the cassandra based on the key in rdd1? Here is some information of our system: - The spark version is 1.3.1 - The cassandra version is 2.0.14 - The key of joining is the primary key of the cassa

Re: sqlContext fails to discover parquet partition

2015-06-23 Thread Wush Wu
rquetFile("hdfs:///bwlogs/beta/archive/EC.RTB/_year=2015/_month=06/_day=22") ``` Hope this might help others in the future. Best, Wush 2015-06-23 10:00 GMT+08:00 Wush Wu : > Dear all, > > Today we try to load parquet file with partition as instructed in < > https://spark.apa

sqlContext fails to discover parquet partition

2015-06-22 Thread Wush Wu
ive/EC.Buy/_year=2015/_month=06/_day=11") ``` It works. Is this a bug? Or did I make a mistake in configuration my hdfs cluster? Thanks, Wush

Re: matplotlib in pyspark

2015-06-10 Thread Wush Wu
Dear moon, Thanks! It works. Wush 2015-06-10 21:22 GMT+08:00 moon soo Lee : > Hi, > > I could make matplotlib work in Zeppelin with helper function > > %pyspark > import matplotlib.pyplot as plt > import StringIO > def show(p): > img = StringIO.StringIO() >

matplotlib in pyspark

2015-06-09 Thread Wush Wu
2, c='#d6ebf2', edgecolors='#8cbfd0', alpha=0.75) ax.set_xlabel(r'$range(1, 50)$'), ax.set_ylabel(r'$\log_e(x^2)$') pass ``` (, TclError('no display name and no $DISPLAY environment variable',), ) Is there any work around to use matplotlib in zeppelin so far? Or should I open an issue? Best, Wush

Difference behaviour of DateType in SparkSQL between 1.2 and 1.3

2015-03-26 Thread Wush Wu
object(before saving to Hive and after loading from Hive), the value are 86400 and -2880. Do I misuse the API? Or is this a bug? Best, Wush

Construct model matrix from SchemaRDD automatically

2015-03-05 Thread Wush Wu
Dear all, I am a new spark user from R. After exploring the schemaRDD, I notice that it is similar to data.frame. Is there a feature like `model.matrix` in R to convert schemaRDD to model matrix automatically according to the type without explicitly converting them one by one? Thanks, Wush

Re: Global sequential access of elements in RDD

2015-02-27 Thread Wush Wu
Thanks for your reply. But your code snippet uses the `collect` which is not feasible for me. My algorithm involves a large amount of data and I do not want to transmit them. Wush 2015-02-27 16:27 GMT+08:00 Yanbo Liang : > Actually, sortBy will return an ordered RDD. > Your output is uno

Global sequential access of elements in RDD

2015-02-26 Thread Wush Wu
sortBy(x => x, true) rdd.foreach(println) I want to see the ordered number on my screen, but it shows unordered integers. The two partitions execute the println simultaneously. How do I make the RDD execute a function globally sequential? Best, Wush

Re: Extract hour from Timestamp in Spark SQL

2015-02-16 Thread Wush Wu
Dear Cheng Hao, You are right! After using the HiveContext, the issue is solved. Thanks, Wush 2015-02-15 10:42 GMT+08:00 Cheng, Hao : > Are you using the SQLContext? I think the HiveContext is recommended. > > > > Cheng Hao > > > > *From:* Wush Wu [mailto:w

Extract hour from Timestamp in Spark SQL

2015-02-11 Thread Wush Wu
confusing about which functions I could use in Spark SQL. Is there any list of available functions except http://spark.apache.org/docs/1.2.0/sql-programming-guide.html#compatibility-with-apache-hive ? Thanks, Wush

Re: [Rcpp-devel] Does uncaught c++ exception cause memory leak?

2014-12-29 Thread Wush Wu
crease if the `tryCatch` block in R increases. If you agree that it is a bug, I am happy to send a pull request and we could discuss more details there. Best, Wush 2014-12-30 11:32 GMT+08:00 Qiang Kou : > Hi, Wush, > > It seems that memory leakage has nothing to do with R.

Re: [Rcpp-devel] Does uncaught c++ exception cause memory leak?

2014-12-29 Thread Wush Wu
However, if I manually use a try/catch to enclose the exception, then the valgrind detects no error. It seems that raising R error causes the memory error, is it? 2014-12-30 1:42 GMT+08:00 Romain Francois : > includes ___ Rcpp-devel mailing list Rcpp-d

[Rcpp-devel] Does uncaught c++ exception cause memory leak?

2014-12-29 Thread Wush Wu
valgrind: https://gist.github.com/wush978/629743109e4aaa762968 Best, Wush ___ Rcpp-devel mailing list Rcpp-devel@lists.r-forge.r-project.org https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/rcpp-devel

Re: [R] using inspect with a TermDocumentMatrix to convert to a data frame

2014-12-04 Thread Wush Wu
frame(tail(df)) } ``` Hope that helps. Regards, Wush 2014-12-05 11:53 GMT+08:00 Erin Hodgess : > Hello! > > I am working through the "Social Media Mining with R" book and I have > something that is a bit problematic. > > Here is the code: > > hash2_tdm <

Re: [R] Compressing code help in a loop

2014-11-10 Thread Wush Wu
Dear Francesca, Is this what you want? ```r index <- c(406, 107, 207, 307, 407, 108, 208, 308, 408, 109, 209, 309, 409, 110, 210, 310, 410, 111, 211) p_m <- match( p_int$p_made, index) dim(p_m) <- c(dim(p_int)[1],1) ``` Best, Wush PhD Student Graduate Institute of Electrical En

[R] Compression variable in memory with gzcon

2014-11-09 Thread Wush Wu
.UTF-8/zh_TW.UTF-8 attached base packages: [1] stats graphics grDevices utils datasets methods base ``` Thanks, Wush PhD Student Graduate Institute of Electrical Engineering, National Taiwan University [[alternative HTML version deleted]]

[R] Matrix::sparse.model.matrix produces inconsistent result

2014-10-26 Thread Wush Wu
ontr(TRUE)) m2 <- sparse.model.matrix(~.^2, CO2, get_contr(FALSE)) dim(m1) dim(m2) ``` The dimension is different: > dim(m1) [1] 84 66 > dim(m2) [1] 84 104 > The example should be reproduced with docker image rocker/r-base Wush PhD Student of Graduate Institute of Electrical

[R] Looking for Feature Hashing

2014-10-26 Thread Wush Wu
x quickly without the overhead of constructing the index. The probability of "collision" might be small if we pick a good hashing function. For details, please see http://en.wikipedia.org/wiki/Feature_hashing Best, Wush Wu PhD Student Graduate Institute of Electrical Engineering, National Ta

Re: Using String Dataset for Logistic Regression

2014-06-02 Thread Wush Wu
Dear all, Does spark support sparse matrix/vector for LR now? Best, Wush 2014/6/2 下午3:19 於 "praveshjain1991" 寫道: > Thank you for your replies. I've now been using integer datasets but ran > into > another issue. > > > http://apache-spark-user-list.1001560.

Recommended way to develop spark application with both java and python

2014-04-07 Thread Wush Wu
Dear all, We have a spark 0.8.1 cluster on mesos 0.15. Some of my colleagues are familiar with python, but some of features are developed under java. I am looking for a way to integrate java and python on spark. I notice that the initialization of pyspark does not include a field to distribute ja

Re: Run spark on mesos remotely

2014-03-28 Thread Wush Wu
Dear all, After studying the source code and my environment, I guess the problem is that the hostPort is wrong. On my machine, the hostname will be exported into `blockManager.hostPort` such as wush-home:45678, but the slaves could not resolve the hostname to ip correctly. I am trying to solve

Re: Run spark on mesos remotely

2014-03-27 Thread Wush Wu
org.apache.spark.storage.BlockManagerMaster.askDriverWithReply(BlockManagerMaster.scala:160) ... 8 more Exception in thread "Thread-0" Is there any suggestion to handle the error above? Thanks, Wush 2014-03-28 4:09 GMT+08:00 Mayur Rustagi : > Yes but you have to maintain connection of that machine

Run spark on mesos remotely

2014-03-27 Thread Wush Wu
that the mesos does not copy the spark-0.8.1-incubating.tar.gz to the temporal working directory, so the job lost immediately. Is it possible to submit the job from the machine not belong to mesos cluster? Thanks! Wush

Re: [Rcpp-devel] Copyright Issue of using 3rd party C/C++ library in R package

2013-09-08 Thread Wush Wu
Dear Dirk, About hiredis, I am trying to improve the efficiency of rredis with Bryan, the maintainer of rredis now. Even though we might not need hiredis, the copyright issue will still bother me in the future. Note that your example is interesting, because it shows that the performance of rredis

[Rcpp-devel] Copyright Issue of using 3rd party C/C++ library in R package

2013-09-08 Thread Wush Wu
know if it is inappropriate. Thanks. Wush ___ Rcpp-devel mailing list Rcpp-devel@lists.r-forge.r-project.org https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/rcpp-devel

Re: [Rcpp-devel] Returning an element from a List with its attributes?

2013-08-20 Thread Wush Wu
Hi Tal, ``` cppFunction(' std::vector temp2_fail(RObject x){ std::vector lower; List x_list(wrap(x)); int n = x_list.size(); lower.push_back(x); return(lower) ; } ') ``` Is this what you want? 2013/8/20 Tal Galili > Dear list members, > > I would like to be able to

Re: [Rcpp-devel] Rcpp build trouble with strings

2013-08-19 Thread Wush Wu
"Rcpp:::LdFlags()"` OBJECTS = RcppExports.o rcpp_hello_world.o /home/wush/Test/TestLinking/inst/linkHello.so ``` Is that correct? Thanks, Wush 2013/8/20 Dirk Eddelbuettel > > On 20 August 2013 at 08:34, Wush Wu wrote: > | Maybe you need to set some flag in NAMESPACES to

Re: [Rcpp-devel] Rcpp build trouble with strings

2013-08-19 Thread Wush Wu
Maybe you need to set some flag in NAMESPACES to ask the package to load required libraries. Hope that help. Hey again, I built the default Rcpp.package.skeleton rcpp_hello_world to take in strings and it worked fine. My problems seem to be from the libraries themselves. I recompiled the librarie

Re: [Rcpp-devel] Invitation to connect on LinkedIn

2013-08-08 Thread Wush Wu
Hi all, I am very sorry about this spam message. Please ignore it. Best, Wush 2013/8/7 下午10:07 於 "Wush Wu" 寫道: > > [image: LinkedIn] > > > > > * From Wush Wu * > > PhD Student at Institute of Electrical Engineering, National Taiwan > Universi

[Rcpp-devel] Invitation to connect on LinkedIn

2013-08-07 Thread Wush Wu
LinkedIn rcpp-devel, I'd like to add you to my professional network on LinkedIn. - Wush Wush Wu PhD Student at Institute of Electrical Engineering, National Taiwan University Taiwan Confirm that you know Wush Wu: https://www.linkedin.com/e/1p7qzd-hk2m2aez-18/isd/156067

Re: [Rcpp-devel] Favourite Rcpp examples for newbies ?

2013-08-01 Thread Wush Wu
For me, there are two reasons to learn Rcpp: 1. Rcpp provides a straightforward way to speed up existed R script. I answered 2 question of speeding up R code on StackOverflow with Rcpp: http://stackoverflow.com/questions/14495697/speeding-up-a-repeated-function-call/14495967#14495967 For this q

Re: [Rcpp-devel] What is the best practice to expose a C st ructure from 3rd party library into R?

2013-07-29 Thread Wush Wu
Thanks for your suggestion, Dirk. I'll try to rewrite Rhiredis based on your approach and provide a similar rredis interface. If everything is good, I'll try to make it on CRAN if it is possible. 2013/7/24 Dirk Eddelbuettel > > Hi Wush, > > After some more cleanup

Re: [Rcpp-devel] What is the best practice to expose a C st ructure from 3rd party library into R?

2013-07-23 Thread Wush Wu
By the way, maybe you should look two files in `inst`. The `gen_function.R` crawls http://redis.io/commands and generates the command according to the official redis manual. You could modify `template.R` to generate the helper functions dynamically based on the exposed Rcpp function. Hope it help

Re: [Rcpp-devel] What is the best practice to expose a C st ructure from 3rd party library into R?

2013-07-23 Thread Wush Wu
Hi all, Thanks for your reply. I'm very happy to contribute to Rcpp Gallery. I wrote some wrappers of C structure from 3rd party library with Rcpp, and these issues kept bothering me. A good example will make the life easier. 2013/7/23 Dirk Eddelbuettel > > Hi Wush, > > Nice

[Rcpp-devel] What is the best practice to expose a C structure from 3rd party library into R?

2013-07-22 Thread Wush Wu
(s4); Rcpp::XPtr xptr(env.get(".pointer")); return static_cast(R_ExternalPtrAddr(xptr)); } ``` Please give me some suggestion if you know a better or a different approach. Thanks. Wush ___ Rcpp-devel mailing list Rcpp-devel@lists.r-forge.r-project.

Re: [Rcpp-devel] Help with accessing and manipulating List objects

2013-07-20 Thread Wush Wu
r a(wrap(x[0])); Rcout << as(a.attr("type")) << std::endl; List c(wrap(x[2])); IntegerVector ca(wrap(c[0])); Rcout << as(ca.attr("type")) << std::endl; ') f(x) ``` I hope it helps. Wush ___ Rcpp-devel mailing list Rcpp-devel@lists.r-forge.r-project.org https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/rcpp-devel

[Rpy] Embedded python in R

2013-03-13 Thread Wush Wu
/questions/15162685/lookuperror-unknown-encoding-big5-under-embeded-python A toy result is under https://github.com/wush978/Rython I just wondering if you will develop an embedded python in R or not? Regards, Wush -- Everyone

[Rcpp-devel] RCMake

2013-02-09 Thread Wush Wu
alling cmake. Please read https://github.com/wush978/RCMake/blob/master/README.md for further introductions. The package is still under testing, so please report the bugs or give me some feedbacks on https://github.com/wush978/RCMake/issues Thanks Wush Wu _

Re: [Rcpp-devel] Integrate xts_API for C with Rcpp

2013-01-11 Thread Wu Wush
s to xts, but I am unlikely to > drive. Maybe a user (you?) wants to do it, maybe we offer it as a GSoC > project. > Well, I might do it if I use Rcpp and xts in another project. I love Rcpp, so I am glad to do some contribution to it. :) Wush ___

Re: [Rcpp-devel] Integrate xts_API for C with Rcpp

2013-01-11 Thread Wu Wush
Dear Dirk, > Exactly what type of access / use did you have in mind from C / C++? > > Recently, I am developing a trading system involving xts with my friends. To handle xts in c++, I am using `Rcpp::RObject`, xts API, and some C functions found in the source of xts. In my opinion, it might be

[Rcpp-devel] Integrate xts_API for C with Rcpp

2013-01-11 Thread Wu Wush
Dear Dirk, I have seen your post in http://stackoverflow.com/questions/14274055/how-to-use-c-api-of-xts-package-in-rcpp . What should we do to generalize the include flag settings? Regards, Wush Wu ___ Rcpp-devel mailing list Rcpp-devel@lists.r

[visualization-api] Re: Problem with the Getting started tutorial

2012-07-16 Thread Wush
On Tuesday, 17 July 2012 03:51:22 UTC+8, asgallant wrote: > > Can you confirm that Apache is working? If it isn't, you should consult > their support resources <http://tomcat.apache.org/findhelp.html>. > > On Sunday, July 15, 2012 10:00:49 PM UTC-4, Wush wrote: >&g

[visualization-api] Problem with the Getting started tutorial

2012-07-15 Thread Wush
Hi, I am new to Tomcat and I have followed the instructions on this link https://developers.google.com/chart/interactive/docs/dev/dsl_get_started under Creating a Web Application on Apache Tomcat and when I click http://localhost:8080/myWebApp/simpleexample I get an error called : "HTTP Status

Profile inheritance and activation in POM

2009-09-22 Thread Wush'
Hi, I have a parent POM with multiple profiles containing dependencyManagements. > > > PROD-1.0 > > > > > group