Design System and Process Big Data
-
1. Introduction
The following is items of this course:
- Understand Big Data sources
- Techniques in Big Data
- Process to design a Big Data System
- Setup and work with Hadoop Eco System
- Setup and Analysis with Hive
- Process data with Apache Spark
- Deploy a Big Data System
-
2. Training Targets
- Help trainees to acquaint with Big Data environment
- Can setup and operate a Big Data System
- Can Process big dataset
- Can do analytics which required by business
-
3. Knowledge and Skills gained after the course
- Be cconfident to build a big data system
-
-
4. Career Opportunities
- Can join projects with data is so big
-
-
5. Training Period
- Training time is 72 hours
- The Schedule is Saturday - Sunday, from 15:30 to 18:30
- Fee: 3.400.000 VNĐ
-
6. Target
You want to work in Big Data Technology
-
7. Requirements
- Basic in Relational Database (ex: MySQL)
- Basic in Linux (ex: Ubutu)
-
8. Content
|
I. Introduction Big Data
|
|
|
1. Introduction
|
|
|
2. Data Basic and Store with a large of data
|
|
|
3. Problems with relation database
|
|
|
4. Introduction to Big Data
|
|
|
5. Technologies for Big Data
|
|
|
II. Design Big Data System
|
|
|
1. Requirements
|
|
|
2. Process
|
|
|
3. Data Storage
|
|
|
4. System Architecture
|
|
|
III. HDFS, Hive
|
|
|
1. Introduction HDFS System
|
|
|
2. Map, Reduce
|
|
|
3. Hive core concept and Architecture
|
|
|
4. Create and Manage Hive tables
|
|
|
5. Best Practices (partition, hive table textfile, ORC, engine,..)
|
|
|
6. Hive Analysis
|
|
|
7. Deploy and pratice
|
|
|
IV. Introduction to Apache Spark
|
|
|
1. Basis Spark Architecture
|
|
|
2. Deployment
|
|
|
3. Spark Common Operations
|
|
|
4. Build Spark Project with Scala interwork with HDFS, MySQL, MongoDB
|
|
|
5. How to avoid mistakes in coding
|
|
|
6. Deploy a data process by spark
|
|
-
9. Materials
-
10. Study Method
- 100% study directly on computer, each student studies on a computer.
- 2 sessions of theory & 1 practice session in alternating order (Lab exercises / Activities)
-
11. Evaluation
- Examination form: theory (multiple choice) and practice (on computer)
http://exam.b4usolution.com/Satisfactory score is greater than or equal to 45%
-
12. After completing, you can:
- Involve any Big Data project
Hình thức thu học phí:
- Chuyển khoản: Vietcombank: Số tk: 0071003095741, Lê Thị Bích Hòa, chi nhánh Kỳ Đồng, Quận 3, Tp.HCM
- Đóng trực tiếp tại: 122, Đường B2, Phường An Lợi Đông, Quận 2, Thành Phố Hồ Chính Minh, Gặp chị Việt. Phone/Zalo: 0379887449 (9:00AM – 6:00PM)
Đang xử lý....
