Hi all,
With the development of big data technology and its wide application in various fields, a large amount of fragmented data has been generated in the process. Under the background of strong business demand, how to respond quickly and completely avoid the risk of data system has become a problem. The hot spot of everyone's attention. In addition, how to make full use of data analysis and data mining to discover more valuable information, thereby bringing economic benefits, is also an important challenge that everyone faces when conducting big data analysis and calculation. In order to meet the business needs of different scenarios, enrich the big data platform architecture, and make it easier for users to manage various types of data, recently, openLooKeng and Linkis have reached a cooperation to realize the interconnection of data resources and make big data simpler. The combination of the two parties will further expand each other's advantages. The powerful cross-source and cross-domain features of openLooKeng allow Linkis to have richer performance, enabling it to support query tasks such as cross-source heterogeneous query, cross-domain and cross-DC. As a computing middleware, Linkis can connect more underlying computing and storage components by using the connectivity capabilities of openLooKeng Connector based on Linkis' EngineConn Plugin (ECP), thereby eliminating data islands, realizing data fusion, reducing resource waste, and meeting the needs of business development. different needs. Linkis is expected to release this version in late April, and the two communities will work together to launch other features later, For example, Linkis supports the openLooKeng on Yarn mode, and optimise the Linkis Orchestrator's ability based on openLooKeng to complete the mixing ability of ecs in subsequent plans. I hope that you can download the experience, provide more powerful suggestions and help for the subsequent optimization, and build a fully connected and integrated financial-level big data platform together. openLooKeng is an open source high-performance data virtualization engine that provides a unified SQL entry, which can be easily controlled whether it is Hive, Hbase, or OLTP database PostgreSQL and MySQL. openLooKeng has a reliable and powerful capability of joint query across multiple data sources. The developed cross-data center Data Center Connector provides high-performance cross-domain collaborative computing, further extends engine query performance, and solves the problem of complex cross-source query architecture and too many programming entries in the past. Many problems and poor system integration have realized the mode conversion of data from "transportation" to "connection", which is convenient for users to quickly realize the value of massive data. Learn more:https://mp.weixin.qq.com/s/0C2TPyzFqMy2BPOemyqAOA ----- 康悦Rita Email:rita0...@163.com <mailto:rita0...@163.com> Twitter:https://twitter.com/Ritakhahaha