The following step by step will take you to explore big data learning:用什麼語言?Learn what content?技術棧有哪些?Finally also send you all complete and big data project study notes.
一、What language is used for big data development?
PythonAlready very popular in the data world.It has a lot of libraries and frameworks available for developers to use.
許多PythonLibraries are especially useful for data analysis and machine learning.These libraries provide countless support for processing big data,使PythonBecome the most popular language for big data.
而且Python對比其他語言來說,簡單易學、語法簡潔,Can let more people to focus on large data learning.
二、大數據學什麼?
Concise version of the learning path:
- 開發入門:MySQL數據庫
- 核心基礎: Hadoop
- 數倉技術: Hive數倉項目
- PB內存計算: Python入門 → Python進階→ pyspark框架 → Hive+Spark項目
Learning plan reference for each stage:
2022年Python+大數據學習路線圖,源碼筆記,最優學習資源_黑馬程序員官方的博客-CSDN博客_黑馬python大數據任何學習過程都需要一個科學合理的學習路線,才能夠有條不紊的完成我們的學習目標.Python+大數據所需學習的內容紛繁復雜,難度較大,所以今天特別為大家整理了一個全面的Python+大數據學習路線圖,幫大家理清思路,攻破難關!文章目錄前言第一階段 大數據開發入門1.大數據數據開發基礎MySQL8.0從入門到精通第二階段 大數據核心基礎2022版大數據Hadoop入門教程第三階段 千億級數倉技術數據離線數據倉庫,企業級在線教育項目實戰(Hive數倉項目完整流程)第四階段 PB內存計算1.pythohttps://blog.csdn.net/itcast_cn/article/details/122306552
三、大數據技術棧
附:官方文檔學習
- MySQL:MySQL 5.7 Reference Manual
- Hadoop:Hadoop Cluster Setup
- Spark:RDD Programming Guide
- Hive:LanguageManual - Apache Hive - Apache Software Foundation
- Flink:Stateful Computations over Data Streams
- Hbase:https://hbase.apache.org/book.html#_preface
- Sqoop:https://sqoop.apache.org/docs/1.99.7/user/CommandLineClient.html
- Flume:Flume 1.9用戶手冊中文版
- Kafka:https://kafka.apachecn.org/
- Oozie:https://oozie.apache.org/docs/4.0.0/DG_QuickStart.html
- ZooKeeper:ZooKeeper: Because Coordinating Distributed Systems is a Zoo
四、項目實戰
HiveData warehouse project notes(已完結):
- Dark Horse Big Data ProjectHive數倉項目 01
- Dark Horse Big Data ProjectHive數倉項目 02
- Dark Horse Big Data ProjectHive數倉項目 03
- Dark Horse Big Data ProjectHive數倉項目 04
- Dark Horse Big Data ProjectHive數倉項目 05(上)
- Dark Horse Big Data ProjectHive數倉項目 05(下)
- Dark Horse Big Data ProjectHive數倉項目 06(上)
- Dark Horse Big Data ProjectHive數倉項目 06(下)
- Dark Horse Big Data ProjectHive數倉項目 07
- 黑馬大數據項目-補充Git部分 08
架構說明:
The project is from the demand research、設計、Research and development to test online,涵蓋了項目的完整工序,Mining and analyzing the data behavior of massive users,形成數據集市,Available for every scene.
Big data project online experience ↓↓↓
- 黑馬頭條-Benchmark today's headlines, 強化PythonInformation Technology Development Capability
- 天天生鮮-Typical fresh goods online trading patterns,Industry-leading e-commerce courses
- 美多商城-To the mainstream electric business platform,PythonCombining technology and business functions
- 新經資訊-強化PythonInformation Technology Development Capability,Cultivate the ability to quickly build platform
- 自動化運維中台-Benchmarking the operation and maintenance development engineer of large and medium-sized enterprises,Development capability of a complete automation platform
- Dark Horse Monitoring and Link Tracking-No monitoring, no testing(性能)No monitoring, no iteration(架構)工程師必備技能
If you think the above content is helpful to you,歡迎關注 The column above takes you to learnPython+大數據 !