Migrating from AWS S3 to Alibaba Cloud OSS Using Data Migration Service

By Thomas Poon, Solutions Architect

Cloud Object Storage is a widely used technology for public cloud providers. Alibaba Cloud Object Storage Service (OSS), AWS S3, and Azure Blob Storage are some notable examples of object storage products hosted on the cloud.

Alibaba Cloud has recently released Data Migration Service, a console GUI tool that helps customers migrate Object Storage services from other sources to Alibaba Cloud OSS.

In this article, I will show you how to migrate from AWS S3 to Alibaba Cloud OSS. Data Migration Service is not limited to AWS S3, you can use it with other products as well. If you want to migrate from other sources, the steps will be similar because the tool is very easy to use.

Let’s get started with the tutorial.

Prerequisites

  1. You should already have data in your S3 bucket.
  2. A valid Alibaba Cloud account. If you don’t have one already, head over to https://www.alibabacloud.com/campaign/free-trial for a free account.

Setting Up S3

I have created a bucket named “frombuckettp” in AWS S3 Singapore, and have stored files in the basic bucket.

Image for post
Image for post

Additionally, I have two folders with files inside of them. The figure below shows the contents of folder1.

Image for post
Image for post

Next, get the API Key and Secret from “My Security Credentials”

Image for post
Image for post

If you don’t have one, you can create new access key. Then, save your access key and secret, we will use it during the migration.

Image for post
Image for post

Setting Up OSS

Next, log in to the Alibaba Cloud console and navigate to OSS. Click + to create a new bucket.

Image for post
Image for post

Create the destination bucket “tobuckettp” in Region “Hong Kong”.

You will see an empty bucket named “tobuckettp” created.

Image for post
Image for post

Next, navigate to the Data Migration Service console https://mgw.console.aliyun.com. You can also locate this feature under “Data Transport”.

Image for post
Image for post

Then you will see this screen:

Image for post
Image for post

Now we will create two data addresses, using AWS S3 as source and Alibaba Cloud OSS as destination.

Click “Create Data Address”.

Image for post
Image for post

You will see a list of supported data types under “Data Type”.

Image for post
Image for post

Fill in the following information and click OK. You’ll need to enter information such as the endpoint, bucket, and access keys.

Image for post
Image for post

Next, create the OSS endpoint by clicking “Create Data Address”.

Image for post
Image for post

Similarly, input your Alibaba Cloud ECS AK/AKS, and bucket information “tobuckettp”. Once completed, click OK.

Image for post
Image for post

Perform Migration

After completing all the necessary setups, we can now we start the actual migration.

Navigate to Migration Jobs and click Create Job.

Image for post
Image for post

Accept the terms and conditions of Migration Service and click “Next”.

Image for post
Image for post

Just input the arbitrary job name, source data address and destination data address and click “Next”.

Image for post
Image for post

If you know the Data Size and File Count information, you can specify them here and the tool will try prioritize the task based on the input. Click “Create” when you have completed the settings.

Image for post
Image for post

You should see the job status is “Creating”, which will then change to “Migrating”.

Image for post
Image for post
Image for post
Image for post

You can click on “Manage” to see the status of your migration.

Image for post
Image for post

Once the task is finished, you can go back to the OSS console to confirm that your migration is successful. Under the Files tab of “tobuckettp” bucket, you should see all data from S3 are now migrated to OSS.

Image for post
Image for post

That’s it! Alibaba Cloud Data Migration Service tool is easy to use and can help you speed up your migration process.

Reference:https://www.alibabacloud.com/blog/migrating-from-aws-s3-to-alibaba-cloud-oss-using-data-migration-service_594382?spm=a2c41.12516971.0.0

Written by

Follow me to keep abreast with the latest technology news, industry insights, and developer trends.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store