Getting Started with Ubuntu Orchestra — Servers in Concert!

Posted by Dustin Kirkland // October 27th, 2011 // Uncategorized


Servers in Concert!

Ubuntu Orchestra is one of the most exciting features of the Ubuntu 11.10 Server release, and we're already improving upon it for the big 12.04 LTS!

I've previously given an architectural introduction to the design of Orchestra.  Now, let's take a practical look at it in this how-to guide.

Prerequisites

To follow this particular guide, you'll need at least two physical systems and administrative access rights on your local DHCP server (perhaps on your network's router).  With a little ingenuity, you can probably use two virtual machines and work around the router configuration.  I'll follow this guide with another one using entirely virtual machines.

To build this demonstration, I'm using two older ASUS (P1AH2) desktop systems.  They're both dual-core 2.4GHz AMD processors and 2GB of RAM each.  I'm also using a Linksys WRT310n router flashed with DD-WRT.  Most importantly, at least one of the systems must be able to boot over the network using PXE.

Orchestra Installation

You will need to manually install Ubuntu 11.10 Server on one of the systems, using an ISO or a USB flash disk.  I used the 64-bit Ubuntu 11.10 Server ISO, and my no-questions-asked uquick installation method.  This took me a little less than 10 minutes.

After this system reboots, update and upgrade all packages on the system, and then install the ubuntu-orchestra-server package.

sudo apt-get update
sudo apt-get dist-upgrade -y
sudo apt-get install -y ubuntu-orchestra-server

You'll be prompted to enter a couple of configuration parameters, such as setting the cobbler user's password.  It's important to read and understand each question.  The default values are probably acceptable, except for one, which you'll want to be very careful about...the one that asks about DHCP/DNS management.

In this post, I selected "No", as I want my DD-WRT router to continue handling DHCP/DNS.  However, in a production environment (and if you want to use Orchestra with Juju), you might need to select "Yes" here.


And a about five minutes later, you should have an Ubuntu Orchestra Server up and running!

Target System Setup

Once your Orchestra Server is installed, you're ready to prepare your target system for installation.  You will need to enter your target system's BIOS settings, and ensure that the system is set to first boot from PXE (netboot), and then to local disk (hdd).  Orchestra uses Cobbler (a project maintained by our friends at Fedora) to prepare the network installation using PXE and TFTP, and thus your machine needs to boot from the network.  While you're in your BIOS configuration, you might also ensure that Wake on LAN (WoL) is also enabled.

Next, you'll need to obtain the MAC address of the network card in your target system.  One of many ways to obtain this is by booting that Ubuntu ISO, pressing ctrl-alt-F2, and running ip addr show.

Now, you should add the system to Cobbler.  Ubuntu 11.10 ships a feature called cobbler-enlist that automates this, however, for this guide, we'll use the Cobbler web interface.  Give the system a hostname (e.g., asus1), select its profile (e.g., oneiric-x86_64), IP address (e.g. 192.168.1.70), and MAC address (e.g., 00:1a:92:88:b7:d9).  In the case of this system, I needed to tweak the Kernel Options, since this machine has more than one attached hard drive, and I want to ensure that Ubuntu installs onto /dev/sdc, so I set the Kernel Options to partman-auto/disk=/dev/sdc.  You might have other tweaks on a system-by-system basis that you need or want to adjust here (like IPMI configuration).


Finally, I adjusted my DD-WRT router to add a static lease for my target system, and point dnsmasq to PXE boot against the Orchestra Server.  You'll need to do something similar-but-different here, depending on how your network handles DHCP.


NOTE: As of October 27, 2011, Bug #882726 must be manually worked around, though this should be fixed in oneiric-updates any day now.  To work around this bug, login to the Orchestra Server and run:

RELEASES=$(distro-info --supported)
ARCHES="x86_64 i386"
KSDIR="/var/lib/orchestra/kickstarts"
for r in $RELEASES; do
for a in $ARCHES; do
sudo cobbler profile edit --name="$r-$a" \
--kickstart="$KSDIR/orchestra.preseed"
done
done

Target Installation

All set!  Now, let's trigger the installation.  In the web interface, enable the machine for netbooting.


If you have WoL working for this system, you can even use the web interface to power the system on.  If not, you'll need to press the power button yourself.

Now, we can watch the installation remotely, from an SSH session into our Orchestra Server!  For extra bling, install these two packages:

sudo apt-get install -y tmux ccze

Now launch byobu-tmux (which handles splits much better than byobu-screen).  In the current window, run:

tail -f /var/log/syslog | ccze

Now, split the screen vertically with ctrl-F2.  In the new split, run:

sudo tail -f /var/log/squid/access.log | ccze

Move back and forth between splits with shift-F3 and shift-F4.  The ccze command colorizes log files.

syslog progress of your installation scrolling by.  In the right split, you'll see your squid logs, as your Orchestra server caches the binary deb files it downloads.  On your first installation, you'll see a lot of TCP_MISS messages.  But if you try this installation a second time, subsequent installs will roll along much faster and you should see lots of TCP_HIT messages.


It takes me about 5 minutes to install these machines with a warm squid cache (and maybe 10 mintues to do that first installation downloading all of those debs over the Internet).  More importantly, I have installed as many as 30 machines simultaneously in a little over 5 minutes with a warm cache!  I'd love to try more, but that's as much hardware as I've had concurrent access to, at this point.

Post Installation

Most of what you've seen above is the provisioning aspect of Orchestra -- how to get the Ubuntu Server installed to bare metal, over the network, and at scale.  Cobbler does much of the hard work there,  but remarkably, that's only the first pillar of Orchestra.

What you can do after the system is installed is even more exciting!  Each system installed by Orchestra automatically uses rsyslog to push logs back to the Orchestra server.  To keep the logs of multiple clients in sync, NTP is installed and running on every Orchestra managed system.  The Orchestra Server also includes the Nagios web front end, and each installed client runs a Nagios client.  We're working on improving the out-of-the-box Nagios experience for 12.04, but the fundamentals are already there.  Orchestra clients are running PowerNap in power-save mode, by default, so that Orchestra installed servers operate as energy efficiently as possible.

Perhaps most importantly, Orchestra can actually serve as a machine provider to Juju, which can then offer complete Service Orchestration to your physical servers.  I'll explain in another post soon how to point Juju to your Orchestra infrastructure, and deploy services directly to your bare metal servers.

Questions?  Comments?

I won't be able to offer support in the comments below, but if you have questions or comments, drop by the friendly #ubuntu-server IRC channel on irc.freenode.net, where we have at least a dozen Ubuntu Server developers with Orchestra expertise, hanging around and happy to help!

Cheers,
:-Dustin

4 Responses to “Getting Started with Ubuntu Orchestra — Servers in Concert!”

  1. Joel says:

    I noticed that puppet wasn’t mentioned at all. Will puppet or mcollective be included in orchestra for configuration management? If not then are there any plans for that?

    Thanks,

  2. Joel says:

    Also, is there any plans to allow orchestra to setup ubuntu desktop systems? This would strike me as a way to simplify desktop deployment

  3. Vilito says:

    Hi Justin,

    Thanks for the info.

    What would be your suggestion for the following situation?

    I would like to demonstrate to my manager, that we should have a build farm and it would be ‘relatively’ easy to manage with Ubuntu cloud solution.

    Here is what I want for us and how I would like to demonstrate it to him.

    We have a number of developers who needs to do Linux builds. Currently, everyone logs into a Linux machine and builds there. What I want, is a set of VMs, with each user having their own VM. They can log in there, and do their builds. The problem now, is, that this build server is always over burdened and often runs out of space. Users are asked to delete files to help free up space. If we add another server, then developers have to decided or be told which to use. Still not the best utilization of computing resources.

    With a cloud solution, I want their VM to float around to some available Node Controller (NC) and they won’t have to worry about which physical machine it is on. They will always log into the same VM.

    This is how I would like to demonstrate this is.
    - Create the same setup as the live cloud image on a single Server (I already have the server with 11.10 on it)
    * So I would need the steps to turn my server into the one configured on the live cloud image. So I am able to create instances to demonstrate that it is very easy to create a VM that are fully configured.
    - Be able to add another NC with the server and show that the instances migrate to the NC without much or any manual intervention.
    - Add another Storage Controller/Walrus node to show storage can be increased at will.

    If I can demonstrate those three things, there is no way he won’t say go ahead and do it. I already have one beefy machine (Xeon dual CPUs, 6 cores per CPU, with 6GM Ram and 3×150 GB hard).

  4. Jay says:

    Maybe it’s just me, but there seems to be a missing step:

    > Once your Orchestra Server is installed, you’re ready to prepare your target system for installation.

    I don’t know what black magic you used, but once I installed the “meta-package” I did not magically view the cobbler pages…. You seem to go:

    1: Install packages
    2: ???
    3: Use packages
    4: Profit

    Which is, the wrong sequence of events… should be:

    1: Install Packages
    2: Login to Packages
    3: Use Packages
    4: ???
    5: Profit

    I know you say you can’t “support” our questions, but this seems to be a rather large… omission (The part about, you know, how to login to your newly installed software…).

    Hopefully, you understand my I’ll fated attempt at humor, and don’t take me as being snide.

    Thanks for the article, it was great until I had to login to my software to follow your instructions, at this point I’m stuck and too tired to troubleshoot further; a task for tomorrow. Again, thanks for the article.