Migrating from AWS S3 to Alibaba Cloud OSS Using Data Migration Service
By Thomas Poon, Solutions Architect
Cloud Object Storage is a widely used technology for public cloud providers. Alibaba Cloud Object Storage Service (OSS), AWS S3, and Azure Blob Storage are some notable examples of object storage products hosted on the cloud.
Alibaba Cloud has recently released Data Migration Service, a console GUI tool that helps customers migrate Object Storage services from other sources to Alibaba Cloud OSS.
In this article, I will show you how to migrate from AWS S3 to Alibaba Cloud OSS. Data Migration Service is not limited to AWS S3, you can use it with other products as well. If you want to migrate from other sources, the steps will be similar because the tool is very easy to use.
Let’s get started with the tutorial.
Prerequisites
- You should already have data in your S3 bucket.
- A valid Alibaba Cloud account. If you don’t have one already, head over to https://www.alibabacloud.com/campaign/free-trial for a free account.
Setting Up S3
I have created a bucket named “frombuckettp” in AWS S3 Singapore, and have stored files in the basic bucket.
Additionally, I have two folders with files inside of them. The figure below shows the contents of folder1.
Next, get the API Key and Secret from “My Security Credentials”
If you don’t have one, you can create new access key. Then, save your access key and secret, we will use it during the migration.
Setting Up OSS
Next, log in to the Alibaba Cloud console and navigate to OSS. Click + to create a new bucket.
Create the destination bucket “tobuckettp” in Region “Hong Kong”.
You will see an empty bucket named “tobuckettp” created.
Next, navigate to the Data Migration Service console https://mgw.console.aliyun.com. You can also locate this feature under “Data Transport”.
Then you will see this screen:
Now we will create two data addresses, using AWS S3 as source and Alibaba Cloud OSS as destination.
Click “Create Data Address”.
You will see a list of supported data types under “Data Type”.
Fill in the following information and click OK. You’ll need to enter information such as the endpoint, bucket, and access keys.
Next, create the OSS endpoint by clicking “Create Data Address”.
Similarly, input your Alibaba Cloud ECS AK/AKS, and bucket information “tobuckettp”. Once completed, click OK.
Perform Migration
After completing all the necessary setups, we can now we start the actual migration.
Navigate to Migration Jobs and click Create Job.
Accept the terms and conditions of Migration Service and click “Next”.
Just input the arbitrary job name, source data address and destination data address and click “Next”.
If you know the Data Size and File Count information, you can specify them here and the tool will try prioritize the task based on the input. Click “Create” when you have completed the settings.
You should see the job status is “Creating”, which will then change to “Migrating”.
You can click on “Manage” to see the status of your migration.
Once the task is finished, you can go back to the OSS console to confirm that your migration is successful. Under the Files tab of “tobuckettp” bucket, you should see all data from S3 are now migrated to OSS.
That’s it! Alibaba Cloud Data Migration Service tool is easy to use and can help you speed up your migration process.
