I originally used SliceHost which was acquired and integrated into Rackspace for cloud hosting since 2010. The services is easy use and rock solid with many advanced features. But then again it is a premium service and cost prohibitive. In 2010 I switched to KVM based hosting using vServer Center and still use it today.

Recently, though I still have vServer Center because of the great cost factor, I have started using Microsoft Azure Cloud hosting.

Gen 3 Cloud

Currently (Dec 2016) evaluating cloud services and techniques,

...

Gen 2 Self-Serve Virtual Hosting

...

Log

Aug 2018

Lots of Low End Box, and there are more - I have not looked closely yet.

Note these often use OpenVZ ... which previously had trouble with Java now (Aug 2019) it's better and depends on the hosting provider setting limits on memory / not overselling too. Also restricted to Ubuntu supported by OpenVZ base image which is 16.x at the moment.

Container technology and Docker does not work due to older kernel.

Here are the offers: 

These are very inexpensive prices and there's further discount if you pay for the full year up front! However, keep in mind this is VPS hosting which can end up oversubscribing resulting in a very slow system.

Feb 2012

I spent some time to look for cheaper alternatives. This is still best bang for the buck despite Gen 3 Cloud services.

...

support email: support@cybercon.net 

KVM hosting at $29.95/Month with life-time discount using http://www.webhostingtalk.com/showthread.php?t=1102906  code WHTVDSKV20A (last used Feb 2015) and it goes down to reduced to $9.95/Month which provides,

• 2 GB of Memory
• Ubuntu OS
• UnMetered 20mbps bandwidth
• 50 GB Hard Disk
• One dedicated IPv4 IP Addresss 

Verified discount code WHTVDSKV20 from http://www.domainpromocodes.com/coupons/vserver-center/

$9.95/month for KVM with Mem = 1GB, BW = Unmetered at 10mbps = 1000GB, Space = 20GB

Using wget downloaded at 1.28M/s grabbing a Confluence download.
Using browser to download from Apache same file averaged 1.2M/s.

...

• Address 
• Web Terminal
• Allow Custom Installation of number of Linux OS including Ubuntu

Purchased additional IP for $1/Month.

To allow install of your own OS, during purchase select,

...