The challenges faced by IT departments are unique. IT is typically viewed as a cost center, has low visibility and few tangible products, and yet plays a critical role in today’s business environment. As IT departments routinely have to operate on minimal budgets and with scarce resources, maximizing the return on investment and making the most of every computing dollar (and CPU cycle) is critical.
Customization
One way that IT departments can cut costs on their cloud and hosted server spending is by switching to microservers. Microservers are an emerging technology, based on the premise that today’s IT workloads are different from those of the past. More transactional computing is taking place, and an emphasis is placed on horizontal scalability and data replication instead of single node performance. Additionally, segmentation of workloads by specific use cases can make better use of resources in a customized microserver environment, as opposed to generic one-size-fits-all general purpose servers.
Arm servers and micro server platforms can be optimized for delivering IT services such as:
Networking – Routing and transport, packet shaping / forwarding, firewalls.
Databases – MySQL, PostgreSQL, and NoSQL databases such as mongoDB, Redis, and Cassandra
Web Servers – Apache, nginx
Caching – CDN servers and caching dynamic content in flat format at the edge to alleviate workload on backend servers.
Load Balancers – Dedicated nodes to prioritize and intelligently allocate requests to servers.
Reporting – Logging, analysis, business intelligence, and reporting services.
Big Data – Transactional and batch processing of data for machine learning or Hadoop.
Communications and APIs – Standard services like email and IM, emerging communication technologies like RabbitMQ, and API feeds back to other services and devices.
In the past, all of these services would have to be delivered by a single type of commodity server, which generally could not be effectively optimized for each different workload. This resulted in overspending and wasted resources. Arm servers and their software stack can easily be tailored to each independent workload, ensuring the most efficient delivery of these common IT services.
Efficiency
Let’s look closer at the efficiency and advantages offered by ARM microservers:
Flexibility – As already mentioned, ARM servers are flexible in their hardware platform design, varying from single-core units with 256mb of RAM and 100mb ethernet all the way to 48-core designs with 40gbE uplinks.
Size – As the name implies, micro servers are small. Some are the size of a credit card, others range up the size of a phonebook. Either way, they are much smaller than the traditional 1U, 2U, and 4U rackmount chassis.
Power Consumption – Here again, the numbers can vary, but they range from 2 to 3 watts up to about 40 watts in the more powerful configurations. However, this is on the order of 20x more efficient than a traditional server which incorporates a 500 to 1000 watt power supply.
Cost – Prices can vary of course, but micro servers can cost anywhere from $50, to a few hundred dollars, up to $3,000 depending again on the configuration and capability. A standard server can cost anywhere from $500 to $10,000, so an ARM server could be 10x to 20x more cost effective as well.
Scalability – This is another area where ARM servers excel. Traditionally, as more compute power was needed, a faster processor and more memory was the answer. As the upper end of the processing power spectrum is reached, costs grow exponentially. Small, marginal gains in processor speed incur a steep increase in cost. To demonstrate this concept, here is a current price list for Intel Core i7 processors, illustrating this phenomenon.
Core i7-4790S – $303
3.2GHz / 4 cores
Core i7-4930K – $583
3.4GHz / 6 cores
Core i7-4960X – $999
3.6GHz / 6 cores
Source: http://www.cpu-world.com/Price_Compare/Desktop_CPU_prices_(latest).html
In the example above, a marginal improvement from 3.4ghz to 3.6ghz nearly doubles the cost of the processor, but does not effectively double the performance or compute capacity. The same effect is observed in the price of memory, where cost vs. capacity follows a similar exponential curve. A superior method of addressing capacity issues is thus to scale horizontally and add additional nodes to handle increased workload, and balance the computational requests across the newly formed cluster of servers. This is the premise that Hadoop and mongoDB are founded upon, as well as many other emerging technologies like Cassandra, Varnish caching, and Docker.
Developing a New Ecosystem
While there are clearly significant advantages, microserver and ARM servers have a bit more maturing to do in the marketplace and ecosystem before they can capture sizable market share. The ecosystem can be defined as follows, per the supply chain:
Chip vendors, such as AMD, Allwinner, Freescale, Qualcomm, Samsung, MediaTek, Rockchip, etc. who produce CPU’s based on ARM cores and IP. Currently, the bulk of chips produced are 32-bit processors, whereas business and micro servers will need 64-bit support. ARM has A53 and A57 64-bit cores sampling and in early adopter products, but volume production of these cores and processors needs to ramp up.
Hardware integrators like HardKernel, Wandboard, Olimex, pcDuino, CubieTech, Radxa, Advantech, and others need to integrate those 64-bit cores into custom PCB designs.
Software and Operating Systems needs to mature and fully support 64-bit ARMv8 processors. Ubuntu and Fedora are already there, but RedHat, CentOS, and CoreOS have work to do still.
Datacenters that host next generation microserver and hosted ARM servers need to come online and provide capacity for mass deployment of nodes to build both public and private clouds.
These ecosystem components will take time to build out and scale. These initiatives need to be well planned, repeatable, and cost effective to ensure that ARM servers can gain a foothold in the marketplace, and then build momentum from there based on competitive advantages and disruptive forces. These components won’t appear overnight, but it won’t be long until the microserver takes significant market share aware from traditional, generic servers.