基于R语言的大数据处理平台的设计与实现

发布时间：2018-11-27 15:22

【摘要】：R语言是一种基于统计、运算和绘图的数据处理方式,其能够较为理想地进行大数据处理工作。因此,设计基于R语言的大数据处理平台。当平台的用户请求层向技术层发送大数据处理指令,技术层随即开始工作,其处理结果也将反馈至用户请求层。技术层由大数据管理模块、大数据处理模块和R语言控制模块组成,大数据处理模块的EP1C6Q240C8芯片通过借鉴大型数据库内容,进行大数据的挖掘工作,并将其挖掘结果提供给大数据处理模块进行大数据的筛选、汇总、转换和标准控制。经大数据处理模块处理后的大数据,将通过串口通信电路回传给用户请求层。R语言控制模块为整个平台制订处理标准。软件方面利用R语言的类聚性能设计技术层挖掘功能图和大数据向量化处理代码。实验结果表明,所设计的平台能够对大数据进行高性能的处理。
[Abstract]:R language is a kind of data processing method based on statistics, operation and drawing. Therefore, big data processing platform based on R language is designed. When the user request layer of the platform sends big data processing instructions to the technical layer, the technical layer starts to work, and the processing result will also be fed back to the user request layer. The technical layer is composed of big data management module, big data processing module and R language control module. The EP1C6Q240C8 chip of big data processing module uses large-scale database content for reference to carry out the mining work of big data. The mining results are provided to big data processing module for the selection, collection, conversion and standard control of big data. After processing by big data processing module big data will be sent back to the user request layer through the serial communication circuit. The R language control module sets the processing standard for the whole platform. In the aspect of software, the clustering performance design of R language is used to mine function diagram and big data vectorization code. The experimental results show that the designed platform can deal with big data with high performance.
【作者单位】：云南师范大学商学院;
【基金】：云南自然科学基金资助(2014ZB148)
【分类号】：TP311.13

【相似文献】