The last decade gave birth to many technologies and applying them to build and evolve is essential for the organization’s future. The evolution of these technologies has created a niche for itself in the changing environment. In a traditional setting, developers were dependent on the host environment, but today, with cloud computing, there is a standardized way to code, build, and deploy.
Traditional environment and platforms faced many challenges; developers were ridden with platform dependencies, testers had no standardized testing environment, and the production environment varied from technology to technology. After all of this, teams in charge of operations were not in sync and were practically disconnected from developers and tester. This presented a big challenge for system administrators. …
Technological innovations are fuelled by the current needs of the industry. As 2020 is coming to an end, we are looking at a considerable enhancement in technological tools and practices. There was a need for a sturdier infrastructure and more resilient practices that gave way to further computing advancements, and Alibaba Cloud presented itself as an integrated in-house one-stop solution for a variety of cloud computing solutions.
A world recovering from economic instability needed an anchor and new technology was the perfect anchor. …
By Shantanu Kaushik
Firewall is a word that induces a sense of security and protection. For many years, firewalls have been the core of basic computing security, but with the introduction and evolution of the cloud, security threats, and malicious iterations of code have also evolved. To deal with evolving threats, tech giants like Alibaba Cloud created a Cloud firewall solution.
Before we discuss the Alibaba Cloud Firewall, let’s discuss some of the basics of a Cloud Firewall. A Cloud Firewall is a multi-application tool that performs security, monitoring, reporting, and self-learning using AI. …
As cliché as it may sound, 2020 has indeed been a challenging year for all of us, perhaps the most difficult year yet. Looking back, we’ve done well to overcome unprecedented challenges through innovative ideas, including maintaining our position as the third largest global provider for IaaS for the third consecutive year, hosting our very first fully-digital Apsara Conference, and the wide adoption of cloud native technologies for this year’s Double 11. We’ve weathered the storm of 2020, and we can only expect the best for 2021.
In this blog, we’d like to share some of our biggest achievements and innovations this year amid the “new normal”. We’d also like to take this opportunity to thank all of you for your incessant support in this eventful year. …
By Shantanu Kaushik
A Web Application Firewall (WAF) enables the protection of your web applications by standing between the Internet and your web applications. It monitors and filters out web traffic that travels to and from your application. Web Application Firewall (WAF) works within the seventh layer of the OSI model and provides a defense mechanism against certain types of attacks, including SQL injections, cross-site scripting, Challenge Collapsar, and many more.
Alibaba Cloud Web Application Firewall is a service that competes and leads many other WAF solutions available but is different from the Cloud Firewall service we discussed previously. Alibaba Cloud WAF is primarily used as a defense mechanism to protect your website and applications. …
By Shantanu Kaushik
DataOps is an approach to data analytics that combines storage and access to allow data engineers to adapt and leverage the benefits based on the same principles that the DevOps pipeline utilizes. As a developer, tester, or administrator, you have worked with DevOps. However, as a data analyst, you may feel left out of the DevOps revolution. Well, that is changing.
When you combine the functionality and principles associated with DevOps and Data Analytics, you get DataOps. DataOps is an extension of DevOps practices combined with Data Analytics. DevOps is all about seamless collaboration between the Developer Team, QA, and Operation Teams. …
By Shantanu Kaushik
DataOps or Data Operations is based on Agile methodology. It is an emerging trend for data analytics that shows the potential to revolutionize DevOps. It could be the next evolutionary step for DevOps methodology. DataOps is process-oriented and works to bring DevOps, data scientists, and engineers together to form a data-focused organizational structure with more productive tools and practices.
Alibaba Cloud has provided enterprises with the latest tools of the trade and platforms, such as IAC, to build and deploy. If you want to deploy with Alibaba Cloud, DataOps can be incorporated into your DevOps cycle easily.
After reading this article, you will learn:
Apache Flink supports multiple types of state backends. When the state is large, only
RocksDBStateBackends are available.
RocksDB is a key-value (KV) database based on the Log-Structured Merge-tree (LSM-tree). Due to the severe read amplification of the LSM tree, high disk performance is required in RocksDB. We recommend using a solid-state drive (SSD) as the storage medium for RocksDB in the production environment. However, some clusters may be configured with common hard disk drives (HDDs) instead of SSDs. When Flink processes large jobs with frequent state accesses, the high I/O of the HDD may restrict the performance. …
The Alibaba Cloud Academy is the Training and Certification arm of Alibaba Cloud. The Academy offers over 130 online and offline certification courses that prepare customers, partners, and developers to tackle Cloud solutions with Alibaba Cloud products. In order to ensure that our materials are tailored to the needs of every customer, our certifications are divided into 5 categories: Professional, Specialty, Clouder, Free E-Learning, and Offline.
By Song Xintong (Wuzang)
Edited by Wang Wenjie (volunteer of Flink community)
This article is composed based on the Apache Flink series live broadcasts and shared by Song Xintong, a senior development engineer at Alibaba. It helps developers understand Flink resource management mechanism in depth from three aspects: basic concepts, current mechanisms and policies, and future development directions.
The components introduced in this article are related to Flink resource management. A Flink cluster consists of one Flink master and multiple task managers. The Flink master and task managers are process-level components. …