信息教学创新21年12期

Spark 实时大数据处理技术在线开放课程建设与实践
朱常鹏¹,刘元超²,李刚¹
(1. 重庆理工大学 两江人工智能学院,重庆 401135;2. 重庆理工大学 电气与电子工程学院,重庆 400054)

摘  要:随着移动互联网的发展,大数据相关技术的广泛应用成为未来发展的必然趋势,推动社会对大数据人才需求的快速增长。文章通过对重庆理工大学数据科学与大数据技术专业“Spark 实时大数据处理技术”在线开放课程的建设,从课程开设背景出发,对课程建设基础、课程设计情况以及课程建设措施三个方面进行详细阐述。在线开放课程的建设与实践进一步深化了教育教学改革,提高了教学与人才培养质量。


关键词:Spark;实时大数据处理;在线开放课程



DOI:10.19850/j.cnki.2096-4706.2021.12.050


基金项目:重庆理工大学研究生教育教学改 革研究项目(clgyjg2020211)


中图分类号:TP311;G434                                文献标识码:A                                 文章编号:2096-4706(2021)12-0195-04


Construction and Practice of Spark Real-time Big Data Processing Technology Online Open Course

ZHU Changpeng1 , LIU Yuanchao2 , LI Gang1

(1.School of Liangjiang Artificial Intelligence, Chongqing University of Technology, Chongqing 401135, China; 2.School of Electrical and Electronic Engineering, Chongqing University of Technology, Chongqing 400054, China)

Abstract: With the development of mobile internet, the wide application of big data related technologies has become an inevitable trend of future development, promoting the rapid growth of social demand for big data talents. Based on the construction of the online open course "Spark real-time big data processing technology" for the major of data science and big data technology of Chongqing University of Technology, this paper expounds it in detail from three aspects of the course construction basis, course design and course construction measures under the background of the course offering. The construction and practice of online open courses have further deepened the education and teaching reform and improved the quality of teaching and talent training.

Keywords: Spark; real-time big data processing; online open course


参考文献:

[1] 李晓锋 . 从精品开放课程到在线开放课程:精品课程建设 理念与实践的转型 [J]. 中国教育信息化,2021(1):15-18.

[2] 杨文武,张海防 . 共享理念下高校继续教育信息化建设研 究——以江苏省为例 [J]. 中国成人教育,2021(9):61-65.

[3] 刘允,王友国,罗先辉 . 地方高校在线开放课程建设实践 与探索——以南京邮电大学为例 [J]. 教育与教学研究,2016,30 (8):69-73.

[4] ZHU C P,HAN B,ZHAO Y L. A bi-metric autoscaling approach for n-tier web applications on kubernetes [J/OL]. Front. Comput. Sci.,2022,16(3):163101.https://doi.org/10.1007/s11704-021-0118-1.

[5] ZHU C P,HAN B,ZHAO Y L. A Comparative Study of Spark in the bare metal and kubernetes [C]//2020 6th International Conference On Big Data and Information Analytics,2020.


作者简介:朱常鹏(1981—),男,汉族,湖北仙桃人,讲师, 博士研究生,主要研究方向:大数据、云计算;刘元超(1979—), 女,汉族,山东德州人,讲师,硕士研究生,主要研究方向:教学 管理;李刚(1968—),男,汉族,四川泸州人,教授,博士研究生, 主要研究方向:软件工程、人工智能。