Cloud Software Development

AWS is the most preferred cloud platform among Python developers: Survey

A new survey by Python Software Foundation and JetBrains finds that adoption of Python 3 is growing fast, data analysis has become more popular than web development among Python developers, and Python developers majorly target IT and software development industry.

For the Python Developers Survey 2018, more than twenty thousand developers across 150 different countries were surveyed. It is the second survey by PSF and JetBrains in last two years.

10 key findings from the Python Developers Survey 2018

1. Python is used as primary language by 84% Python users

According to the survey, 84% of Python users choose Python as their primary language, whereas the remaining use it as a secondary option. The usage of Python as main language has increased by 5% from 79% in 2017.

Python Developers Survey by Jetbrains

Half of Python users also choose JavaScript, while 47% of them use HTML and CSS. The more languages used by Python developers included Bash/Shell (45%), SQL (40%), C/C++ (31%), Java (23%), PHP (13%), etc.

2. Python is used for both personal and professional types of projects

60% of Python developers said that they use Python for both personal and professional projects. 21% of them use it for personal purpose, while 19% use it for work.

purpose of Python

3. Python is majorly used for data analysis and web development

An interesting thing about Python usage, according to the survey, is that developers are increasingly using it for data analysis as compared to web development.

Popularity of Python has increased by 8% for data analysis as well as DevOps, but only 3% for web development. Python usage for machine learning has also witnessed growth, from 31% to 37% in a year.

Uses of Python

4. Python 3 is the most used version of Python

84% of Python developers use Python 3, while only 16% use Python 2. The popularity of Python 3 has significantly jumped in one year, from 75% in 2017 to 84% now.

Python 3 vs Python 2

One of the main reasons for decline is usage of Python 2 is that it is no longer developed actively, doesn’t get new features, and its maintenance is going to be stopped next year.

90% of Python developers use the latest version of Python for data science, while 82% use it for web development, and 81% for DevOps.

5. Python is mostly installed from or OS-provided package managers

Majority of users install Python either from or with OS-provided package managers like APT and Homebrew. Installation of Python from Anaconda has increased by 7% in one year.

Python Installation

6. Flask and Django are the most popular frameworks for Python developers

The popularity of Flask among Python developers has increased by 15% in last year, which has now made it the most popular framework for Python developers, surpassing Django.

Frameworks for Python developers

7. NumPy and Pandas are the most popular data science frameworks and libraries

The most used data science frameworks and libraries among Python developers are NumPy, Pandas, Matplotlib, and SciPy.

Other popular libraries specific to machine learning are SciKit-Learn, TensorFlow, and Keras.

Popular data science frameworks

8. Amazon Web Services (AWS) is the most used cloud platform among Python developers

Majority of Python developers who use cloud platforms prefer AWS. Google Cloud Platform (GCP), Heroku, DigitalOcean, and Microsoft Azure are the other popular cloud platforms among Python users.

Cloud used by Python developers

Suggested reading: Top 4 development trends in cloud of which every developer should be aware of

9. Linux and Windows are the most preferred operating systems by Python users

69% of the Python users choose Linux as the development environment OS, while 47% developers choose Windows.

Popular operating system for Python

MacOs follows Linux and Windows with 32% usage, while BSD could hold only 1% share.

10. Most of the Python developers choose free and open source databases

According to the Python Developers Survey, majority of developers are choosing to use free or open source databases like PostgreSQL, MySQL, and SQLite.

The Python developers who do some form of machine learning or data engineering use non-relational databases like MongoDB and Redis.

databases used by Python developers

For full results of the Python Developers Survey 2018, click here.

Images source: Python Developers Survey 2018 by Jetbrains and Python Software Foundation

Cloud Cloud News

Amazon Web Services unveils fully-managed and centralized backup service

With a new backup service, Amazon Web Services (AWS) is making it easier and faster for enterprises to back up their data across AWS services and on-premises.

Called AWS Backup, it is a fully-managed and centralized backup service that will help enterprises to easily meet regulatory backup compliance requirements.

Today, organizations are increasingly shifting their applications to cloud. The data is becoming distributed across distinct services, like databases, block storage, object storage, and file systems.

AWS Backup will allow enterprises to configure and audit the resources they backup using a single service. Whether the data is distributed in storage volumes, databases, or file systems, the new service will allow enterprises to audit and configure everything from a single place.

It will also automate backup scheduling, allow users to set retention policies, and monitor recent backups and restores in one place, AWS said.

“As the cloud has become the default choice for customers of all sizes, it has attracted two distinct types of builders. Some are tinkerers who want to tweak and fine tune the full range of AWS services into a desired architecture, and other builders are drawn to the same breadth and depth of functionality in AWS, but are willing to trade some of the service granularity to start at a higher abstraction layer, so they can build even faster,” said Bill Vass, VP of Storage, Automation, and Management Services, AWS.

“We designed AWS Backup for this second type of builder who has told us that they want one place to go for backups versus having to do it across multiple, individual services. Today, we are proud to make AWS Backup available with support for block storage volumes, databases, and file systems, and over time, we plan to support additional AWS services.”

Also read: Amazon reportedly acquiring CloudEndure for $250 million

AWS has integrated the new service with Amazon DynamoDB, Amazon Elastic Block Store (Amazon EBS), Amazon Elastic File System (Amazon EFS), Amazon Relational Database Service (Amazon RDS), and AWS Storage Gateway. The public cloud giant is planning to integrate more services in future.

Cloud Cloud News

Cisco and AWS launch Kubernetes-powered hybrid cloud solution

Cisco has announced a new hybrid cloud platform that will make it easier for enterprises to run new containerized applications across all environments. The new platform will be powered by Kubernetes, and has been built for Amazon Web Services (AWS).

Called Cisco Hybrid Solution for Kubernetes on AWS, the new solution integrates Cisco’s networking, security, management and monitoring software with AWS’ cloud services.

It configures on-premises Kubernetes environments to be consistent with Amazon Elastic Container Service for Kubernetes (EKS), the companies said. The Amazon EKS is a managed Kubernetes service for managing software containers, which became generally available in June this year.

Today, applications have become the lifeblood for enterprises. Hence, enterprises are looking to develop and deploy applications across public and private clouds, without any obstruction. If they build the applications easily, get them up and run quickly, if can provide huge competitive advantage.

Cisco Hybrid Solution for Kubernetes on AWS aims to allow developers deploy and manage containerized applications more easily across on-premises and the AWS cloud. It will allow them focus on building and using applications, speed up innovation and reduce time to market.

“Today, most customers are forced to choose between developing applications on-premises or in the cloud. This can create a complex mix of environments, technologies, teams and vendors. But they shouldn’t have to make a choice,” said Kip Compton, senior vice president, Cloud Platform and Solutions at Cisco.

“Now, developers can use existing investments to build new cloud-scale applications that fuel business innovation. This makes it easier to deploy and manage hybrid applications, no matter where they run. This allows customers to get the best out of both cloud and their on-premises environments with a single solution.”

The new solution will come with a common set of tools for on-premises and AWS, which will simplify the management of on-premises Kubernetes infrastructure. It will help IT operations team to reduce complexity and costs.

Cisco Hybrid Solution for Kubernetes on AWS will also enable containerized applications to work with existing resources and production environments. This provides another advantage to both developers and IT operation teams.

“More customers run containers on AWS and Kubernetes on AWS than anywhere else,” said Terry Wise, Global Vice President of Channels & Alliances, Amazon Web Services, Inc.

“Our customers want solutions that are designed for the cloud and Cisco’s integration with Amazon EKS will make it easier for them to rapidly deploy and run containerized applications across both Cisco-based on-premises environments and the AWS cloud.”

Also read: Cisco acquires Duo Security for multi- and hybrid-cloud security

The new solution is expected to be available in December 2018. Cisco will provide the solution as a software solution requiring only Cisco Container Platform, or as hardware/software solution with Cisco Container Platform running on Cisco HyperFlex.

Cloud Cloud News

Equinix will bring its ECX Fabric capabilities to APAC this year

Equinix is planning to bring its Cloud Exchange Fabric (ECX Fabric) capabilities to Asia Pacific region this year.

The Equinix Cloud Exchange Fabric leverages software-defined networking (SDN) to enable multiple connections through one port. It is a platform which allows customers to connect with any other ECX Fabric customers in the region.

It helps customers to implement economic data replication and synchronization for business continuity, and enables inter-country connectivity to backup cloud services.

Its availability in APAC will help enterprises in the region to easily provision connections to other ECX Fabric facilities in Australia, Hong Kong, Japan, and Singapore to build highly available strategies in near real time.

ECX Fabric customers can also directly connect to key service providers including Alibaba Cloud, Amazon Web Services (AWS), Google Cloud, IBM Cloud, Microsoft Azure, Oracle Cloud, and SAP.

Equinix believes that interconnection with key business partners and customers is becoming an essential element of digital supply chain, as companies move to digital business models.

The interconnection removes the need of traversing public internet or WAN, and enables direct and private access to cloud service providers, SaaS providers, network service providers and more. The key advantages of interconnection are improved application performance, reduced latency, increased security, and improved network control.

The Equinix Cloud Exchange Fabric capabilities are currently available in all the EXC Fabric locations in Americas, and EMEA regions. It is expected to be available in APAC in their quarter of 2018.

Furthermore, Equinix recently partnered with Omantel to establish a joint venture in Barka, the capital of Oman. The joint venture will provide data center and interconnection services to carriers, content providers, and cloud providers in the Middle East.

Also read: Equinix closes acquisition of Australian datacenter provider Metronode

Image source: Equinix

Cloud Cloud News News

Developers can now undo database clusters on Amazon Aurora with new backtrack feature

Amazon Web Services (AWS) has added a new ‘undo’ feature to its Aurora database engine. Called Backtrack for Amazon Aurora, the feature will allow users to quickly move an Aurora database to a prior point in time without having to restore data from a backup.

On several occasions, the developers compose the query and let it run to the production database. But later realize that they forgot to add some clauses to it, or dropped the wrong table, or made any other mistake.

The backtrack option will help the developers in such scenarios, by allowing them to pause the application and select the point in time they want to go back to. AWS said it will allow users to retain the log information going back in time up to 72 hours.

When a backtrack will be initiated, Aurora will pause the database, close the open connections, and drop the uncommitted writes. It will then roll back database to time before the error occurred.

Once the backtrack process completes, users can resume the application and proceed as if nothing really had gone wrong. Furthermore, if the users realize that they have gone back a bit too far with the process, then they can backtrack to a later time.

“I’m sure you can think of some creative and non-obvious use cases for this cool new feature. For example, you could use it to restore a test database after running a test that makes changes to the database. You can initiate the restoration from the API or the CLI, making it easy to integrate into your existing test framework,” wrote Jeff Barr, AWS Chief Evangelist, in a blog post.

Aurora is based on distributed and log-structured storage system, hence a new log record is generated every time a change is made to database. The log record is then identified by a log sequence number (LSN). When the backtrack feature is enabled, a first-in, first-out (FIFO) buffer in the cluster for storage of LSNs is provisioned. It enables quick access and recovery times measured in seconds.

Barr further wrote that backtrack feature will be applicable to newly created MySQL-compatible Aurora database clusters and to MySQL-compatible clusters that have been restored from a backup. The backtrack cannot be enabled for a running cluster.

Also read: AWS updates Amazon S3 to reduce costs and improve performance

Backtrack feature for Aurora is now available in all AWS regions where Amazon Aurora runs.

Cloud Cloud News News

Worldwide public cloud market to hit $186.4 billion, with hyperscale cloud providers dominating it: Gartner

According to a new analysis by Gartner, public cloud services market is projected to grow from $153.5 billion in 2017 to $186.4 billion in 2018, which is a rise of 21.4 percent.

Amongst the cloud segments, IaaS (Infrastructure-as-a-service) was identified as the fastest growing segment, predicted to grow 35.9 percent in 2018, reaching $40.8 billion, led by leading IaaS providers like Amazon Web Services (AWS) and Microsoft Azure.

Source: Gartner

SaaS (Software-as-a-service) was again identified as one of the largest segments of the cloud market with a revenue growth expected of 22.2 percent, to hit $73.6 billion in 2018. Gartner also predicted that by 2021, SaaS will reach 45 percent of the total application software spending.

SaaS based application models are becoming a preferred choice for most of the enterprises. Sid Nag, who is a research director at Gartner, thinks that the SaaS demands are changing with users seeking more purpose-built solutions that can meet their specific business outcomes.

Under PaaS (Platform-as-a-Service) segment, dbPaaS (database platform as a service) is seeing the highest demand, expected to hit $10 billion by the year 2021. As a result, the hyperscale cloud providers are expanding their range of services to include dbPaaS.

Talking about the high demand of dbPaaS, Mr. Nag said that the customers should explore other dbPaaS service offers apart from the one offered by the large service providers, to avoid any lock-in.

Despite the high forecast rates, Gartner expects the growth rate to stabilize from 2018 onwards, due to the maturity that cloud services might gain within the IT segment.

One of the primary challenges here is to avoid vendor lock-in. With most of the big cloud providers like AWS, Microsoft etc. offering major cloud services, companies that once use any vendor’s cloud platform can find it very expensive and complicated to move away again.

Gartner said that this scenario might give rise to new demands by customers who want easy migration of their apps and data, without any penalties.

Cloud Cloud News News

Amazon’s AI-based image recognition technology now available to Australian developers

Amazon Web Services announced availability of Amazon Rekognition in Asia Pacific (Sydney) region.

Amazon Rekognition is a deep learning based technology that can analyze images and video files stored in Amazon S3. The technology makes it easier for developers to add image and video analysis in applications.

Rekognition can identify objects (bike, telephone, building), people, text, scenes (parking lot, beach, city), activities (playing soccer), and detect the inappropriate content as well.

Its availability in Sydney will enable more developers to leverage the Rekognition and add visual analysis to the application they build.

AWS had announced Rekognition at its re:Invent conference in November last year along with a number of new services, including a deep-learning based wireless video camera called DeepLens, and a machine-learning based managed service called Amazon SageMaker.

The Rekognition is a pre-trained AI solution which doesn’t require developers to build deep learning algorithms, or train machine learning models. Hence, they can easily build new generation of applications that can accurately analyze face, compare faces for user verification, count people, etc.

The facial analysis can determine the attributes of faces in images or videos, like emotions, age range, facial hair, eyes open, glasses, etc. If a celebrity is detected in the image or video, it can tell the name.

It offers real-time recognition of faces for live stream videos (even when they are partially hidden from view), and accurately detect thousands of activities and objects from videos streams and video content.

Australian customers have played a key role in the evolution of our services over the past five years, providing feedback to help us develop thousands of new features and service updates to meet their needs. These have included innovation in security, compute, analytics, serverless computing, and the internet of things,” said Paul Migliorini, Managing director, AWS Australia and New Zealand. 

Additionally, Amazon Rekognition can detect and recognize text from images, like captions, product names, street names, etc.

“More recently, Australian customers are using AWS machine learning and artificial intelligence services to further accelerate innovation and competitive advantage, and the availability of Amazon Rekognition in the AWS Sydney region will support this acceleration,” added Paul Migliorini

Cloud Cloud News News

Google brings advanced Stackdriver features to non-premium users 

Google is bringing advanced functionalities and simplified pricing model to its Stackdriver— the monitoring, logging and diagnostic solution for applications that run on Google Cloud Platform (GCP) and Amazon Web Services (AWS).

Stackdriver Monitoring enables organizations to visualize the performance, uptime, and overall health of the cloud applications, by collecting metrics and metadata from GCP and AWS. It automatically discovers and monitors the resources from both the clouds.

At present, there are several monitoring features in Stackdriver which are available to premium-tier users only. These features include alerting and notification options for monitoring, and creating monitoring dashboards and alerting policies. From 30th June 2018, these advanced functionalities will be available to the users without premium pricing.

Furthermore, Google has simplified the pricing model for Stackdriver Monitoring and Stackdriver Logging services. With the new pay-as-you-go pricing model, organizations will need to pay only for the data they send for monitoring, instead of the number of resources in projects.

The free-trial option for GCP metrics will be replaced by permanent free allocation. Customers can use all GCP metrics and first 150 MB of non-GCP metrics per month for free.

Google has reduced pricing for monitoring non-GCP metrics by 80%. The non-GCP metrics include agent metrics, AWS metrics, log-based metrics and custom metrics. The pricing has been dropped from $0.258 to $0.061 per MB.

Stackdriver Logging enables organizations to store, search, analyze and alert on log data and events form GCP and AWS. It is a managed and scalable solution to ingest data from applications and systems from Virtual Machines.

Google increased retention of Stackdriver logs from seven days to three days for all the users. The Stackdriver Logging users will get 50 GB free allocation of ingested logs every month. In case of using logs over the free limit, Google will charge $0.50 per GB.

Also read: Acronis bolsters its leadership position in cloud data protection with Google Cloud partnership

The new exclusion filters option will help users to optimize the costs by applying filters for services they want to use. The new pricing models for Monitoring and Logging will be independent, and will be applicable from June 2018.


AWS Serverless Application Repository now generally available 

Amazon Web Services yesterday announced the general availability of Serverless Application Repository, which was available for public preview yet.

The Serverless Application Repository makes it easier for users to discover, configure, and deploy serverless applications and components on AWS.

Consumers can use the repository to build applications without having to worry about underlying hardware on which the application runs as it will be managed by AWS.

“As a consumer, you will be able to tap in to a thriving ecosystem of serverless applications and components that will be a perfect complement to your machine learning, image processing, IoT, and general-purpose work. You can configure and consume them as-is, or you can take them apart, add features, and submit pull requests to the author,” explained Jeff Barr, Chief Evangelist, AWS.

For publishers, the AWS Serverless Application Repository offers a location to host their serverless applications and components by simply entering a name, description, choosing labels for better discoverability, selecting befitting open source license from the dropdown and providing a README for helping users begin. They can link their source code repository, select SAM template and assign a semantic version.

The other advantage of serverless computing is that it enables users to pay cloud providers by seconds rather than by hours, hence a cost-effective solution.

AWS Serverless Application Repository can be accessed through AWS Lambda console. Lambda is an event-driven computing service which helps developers to write short computing functions that run to trigger events.

Launch of Serverless Application Repository is yet another step of Amazon towards growing serverless computing market. In November last year, AWS updated its Amazon Aurora with Aurora Serverless feature, enabling users to create database instances only when they need it.

Also read: Amazon and Salesforce planning to move away from Oracle database

AWS Serverless Application Repository is now generally available in the US East, US West, Asia Pacific, Canada, Europe, and South America regions.

Acquisition Cloud News

Veeam acquires N2WS, strengthens its position as data protection provider for AWS Cloud 

Switzerland-based software firm, Veeam, has acquired N2WS, a leading provider of IaaS data protection, with a cloud-native backup and disaster recovery solution designed especially for AWS workloads.

Veeam is known for its Availability for the Always-On Enterprise solution which helps organizations meet recovery time and point objectives (RTPO) for any data, application or cloud.

By acquiring N2WS, Veeam aims to enhance its product portfolio with Availability solutions for different apps, data and across physical, virtual and multi-cloud environments. With the move, Veeam will be able to access N2WS’s data protection technology and R&D for integrating IaaS data protection for AWS workloads into Veeam Availability Platform, while N2WS will have access to nearly 55,000 resellers and 18,000 CSPs of Veeam.

“As enterprises look to migrate more workloads to the public cloud, having a robust and intuitive data protection and Availability solution is imperative,” said Peter McKay, Co-CEO and President at Veeam. “By combining Veeam’s industry-leading capabilities in protecting virtual, physical and cloud environments with N2WS’ leadership in AWS data protection, we have a strong solution to deliver on the needs of the digital enterprise. N2WS has experienced incredible growth in the last 12 months and it will continue to operate as a standalone business to best position the company to provide AWS data protection – the same way Veeam transformed protection for VMware environments a decade ago. Together, we will achieve great things; this is a game-changer in every sense!”

Public cloud adoption is rapidly increasing (AWS in particular), and it seems that Veeam has timed the acquisition really well. The company might see strong growth in the market in 2018.

“Joining forces with one of the world’s fastest growing software companies is very exciting for the N2WS team and for our customers,” said Jason Judge, CEO at N2WS. “We will further accelerate our rapid growth and the development of our top-rated solutions by leveraging the world-class team that Veeam has established. We also look forward to assisting Veeam customers explore their public cloud strategies with our years of innovation in public cloud storage.”

Additionally, Veeam will now help enterprises of all sizes to run considerable number of workloads in public cloud, and enable its existing customers to take advantage of Cloud Protection Manager (CPM) from N2WS.

Also read: 5 Cloud Computing Predictions for 2018 that will define the cloud industry for good

For acquisition, Veeam paid $42.5 million in cash. N2WS will continue to keep its brand name, but will be called “A Veeam Company”.

Page 1 of 4
1 2 3 4