Development Process
Table 1 describes each phase in developing the machine learning algorithm library.
Phase |
Description |
|---|---|
Learn basic concepts |
Before application development, you need to understand the basic concepts of machine learning algorithms, Spark Core, and the Spark algorithm library. |
Set up a development environment |
Machine learning algorithms can be developed by using Scala, Java, Python, and R. This document uses Scala as an example to describe how to use the IDEA tool to configure the development environment. |
Create a project |
You can create a Spark machine learning algorithm project according to related guide. |
Develop a program based on a specific scenario |
You can select a machine learning algorithm for development based on your service scenarios. This chapter uses the GBDT algorithm as an example to describe how to develop machine learning algorithms. |
Submit and run a task |
This phase describes how to submit a developed application to a cluster for running. |
Check the application running result |
The application running result is printed. You can view the application status on the UI. |