The Diversified Machine Learning Applications In Big Data

Image for post
Image for post

Machine Learning and How to Use It on Alibaba Cloud

Machine learning is an important way to use to create value for customers. This article discusses what machine learning is and how you can use it on Alibaba Cloud.

What Is Machine Learning?

Machine learning (abbreviated ML) can be described as a mechanism whereby a machine learns a pattern from data sets so that it can predict future data. The major types of machine learning algorithms are supervises, semi-supervised, unsupervised, and reinforcement learning. In a machine learning pipeline, training data, some sort of model for that data, and an algorithm are used. After initial training, a test dataset is applied to the model to check the accuracy of predictions made by this pipeline.

  1. Data Preprocessing
  2. Feature engineering
  3. Training and prediction
  4. Evaluation

What Can Machine Learning Be Used for?

One common application of machine learning in recent years is recommendation systems. These systems use user input data to provide user recommendations. On example of these systems is the one used by Netflix.

Related Blogs

The Differences between AI, Machine Learning, and Deep Learning

Although conceptually similar, the terms AI, machine learning, and deep learning are not interchangeable.

Introduction

On November 9, 2015, Google released an open source Artificial Intelligence (AI) system known as TensorFlow. Ever since the launch of TensorFlow, the growth of AI and machine learning has been immense. Machine learning, as a type of AI, enables software to elaborate or predict future events based on a large volume of data. Today, leading technology giants are all making substantial investments in machine learning, including Facebook, Apple, Microsoft, and even China’s leading search engine — Baidu.

Differences and Similarities

Although conceptually similar, the terms AI, machine learning, and deep learning are not interchangeable. Referencing the interpretations from Michael Copeland of NVIDIA, this article unveils the concepts of AI, machine learning, and deep learning. To understand the relationship between the three, let us look at the figure below:

Image for post
Image for post

AI: From Irrelevance to Global Adoption

Since 1956, when computer scientists coined the term AI at Dartmouth Conferences, there has been an endless stream of creative ideas about AI. AI was one of the hottest topic or research because many perceived AI as the key to a bright future of human civilization. However, the idea of AI was quickly discarded for being too pretentious and whimsical.

6 Top AutoML Frameworks for Machine Learning Applications (May 2019)

In this post, we 6 key automated machine learning (AutoML) platforms that can assist data scientists to accelerate machine learning development.

1. What Is AutoML?

1.1 Overview

AutoML (automated machine learning) refers to the automated end-to-end process of applying machine learning in real and practical scenarios.

Image for post
Image for post

1.2 Why Is AutoML Needed?

From the application perspective, the demand for machine learning systems has soared over the past few years. ML has been adopted in a wide range of applications. However, although it is proven that machine learning can provide better support for some enterprises, many enterprises are still struggling to implement ML model deployment.

Finding Public Data for Your Machine Learning Pipelines

This article discusses how and where you can find public data to use in machine learning pipelines that you can then use in a variety of applications.

Machine Learning Requires Data

Machine learning requires data. Without data you cannot be sure a machine learning model works. However, the data you need may not always be readily available.

Be Careful When It Comes to Synthetic Data

One solution to these data needs is to generate synthetic data, or fake data to use layman’s terms. Sometimes this is safe. But synthetic data is usually inappropriate for machine learning use cases because most datasets are too complex to fake correctly. More to the point, using synthetic data can also lead to misunderstandings during the development phase about how your machine learning model will perform with the intended data as you move onwards.

Analyzing Census Data Using Alibaba Cloud’s Machine Learning Platform

This article shows you how to set up a machine learning platform with Alibaba Cloud Machine Learning Platform for AI to analyze census data.

Image for post
Image for post

Related Courses

Machine Learning Career Learning Path

The Machine Learning Career Path teaches users about end-to-end machine learning services, including data processing, feature engineering, model training, model prediction, and model evaluation. Alibaba Cloud’s Machine Learning Platform combines all of these services to make AI more accessible than ever. Learn how to use this platform through the completion of this learning path.

Machine Learning for Beginners — Linear Regression

This course is the first class of the Alibaba Cloud Machine Learning Algorithm QuickStart series, It mainly introduces the basic concept and algorithm principle of linear regression model, as well as the model evaluation metrics, explains and demonstrates a complete process of building linear regression analysis and prediction model in PAI, prepare for the knowledge associate with subsequent machine learning courses.

Powering your Big Data Analytics with IoT Device Data

Internet-of-things (IoT) and Big Data are closely connected with each other and provide a significant impact on many vertical industries opening up new opportunities for innovation and process optimization.

How to Start Machine Learning on Cloud — Linear Regression

This course is the first class of the Alibaba Cloud Machine Learning Algorithm QuickStart series, It mainly introduces the basic concept and algorithm principle of linear regression model, as well as the model evaluation metrics, explains and demonstrates a complete process of building linear regression analysis and prediction model in PAI, prepare for the knowledge associate with subsequent machine learning courses.

Related Market products

Machine Learning Algorithm Primer 2-Naive Bayes Classifier

How to use Alibaba Cloud advanced machine learning platform for AI (PAI) to quickly apply the linear regression model in machine learning to properly solve business-related prediction problems.

Machine Learning:Heart Disease Prediction

This session introduces how to use Alibaba Cloud Machine Learning Platform For AI to create a heart disease prediction model based on the data collected from heart disease patients.

Machine Learning Algorithm 4-Decision Tree and Random Forest

How to apply decision tree and random forest model to solve classification problems with PAI.

Related Documentation

What is Machine Learning Platform for AI?

Product overview

Machine learning refers to the practice of instructing machines to discover regular patterns from accumulated data to help users make predictions and decisions.

Successful case — Sina Weibo

Sina Weibo is a leading social media platform in China. Sina Weibo has 165 million daily active users (DAUs) and 376 million monthly active users (MAUs). Mobile MAUs occupy as high as 92% of all MAUs. Involved data operation scenarios include, but are not limited to:

Image for post
Image for post

Challenges

Users generate a huge amount of data on the platform every day. After data processing, tens of billions of features and hundreds of billions of sample entries may be generated. How to compute and analyze such a huge amount of data poses a great challenge for the bottom-layer computing engine.

Machine learning — Machine Learning Platform for AI

Linear SVM

Developed in the mid 90’s, Support Vector Machine (SVM) is a statistical learning theory based machine learning method. It seeks to improve the learning machine’s generalization ability through structural risk minimization, so as to minimize the empirical risk and confidence range. Therefore, good statistics can be obtained from small sample sizes. For more information about SVM, see wiki.

Related Products

Machine Learning Platform for AI

Machine Learning Platform for AI provides end-to-end machine learning services, including data processing, feature engineering, model training, model prediction, and model evaluation. Machine Learning Platform for AI combines all of these services to make AI more accessible than ever.

Image Search

Alibaba Cloud Image Search is an intelligent image search service that helps users find similar or identical images. Based on machine learning and deep learning, the product enables end-users to take a screenshot or upload an image to search and find desired products and fulfill other search requests.

Original Source:

Follow me to keep abreast with the latest technology news, industry insights, and developer trends.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store