Basically implementing Aliyun OSS fs is good and it's widely used in China.
Steve and Chris have given good comments in the JIRA. My main concern is about testability: we must make sure the basic functionalities are not broken in each release. Does Aliyun supply a public/test account and we can use it in tests? Or as Chris said, is there a local emulator of the remote service? Regards, Yi Liu On Mon, Feb 15, 2016 at 6:01 PM, 肖学武(肃和) <xuewu....@alibaba-inc.com> wrote: > +1, Aliyun OSS is very popular in china's market. > > From: Shi Mingfei > Date: 2016-02-15 16:56 > To: common-dev > Subject: Re: Incorporate Aliyun OSS file system implementation any more > ideas? > > 2016-02-14 16:27 GMT+08:00 Cheng, Hao <hao.ch...@intel.com>: > > +1 on this, as Aliyun OSS has large number of users / developers around. > > > > -----Original Message----- > > From: Shi Mingfei [mailto:devmailli...@gmail.com] > > Sent: Sunday, February 14, 2016 4:02 PM > > To: common-dev@hadoop.apache.org > > Subject: Incorporate Aliyun OSS file system implementation > > > > Aliyun OSS is widely used among China’s cloud users, but currently it is > not easy to access data laid on OSS storage from user’s Hadoop/Spark > application, because of no original support for OSS in Hadoop. > > > > This work aims to integrate Aliyun OSS with Hadoop. By simple > > configuration, Spark/Hadoop applications can read/write data from OSS > > without any code change. Narrowing the gap between user’s APP and data > > storage, like what have been done for S3 in Hadoop > > > > The JIRA ticket is : > > > > https://issues.apache.org/jira/browse/HADOOP-12756 > >