Be Fast Or Stay Behind - Building A Continuous Delivery Platform

Schlomo Schapiro (ImmobilienScout24), Ingmar Krusch (ImmobilienScout24)
Operations and Culture
Location: Hall 1 B/C
Average rating: **...
(2.71, 42 ratings)

Ten years of continuous growth leave many stretch marks on any website, like
increasing maintenance overhead, lengthy and complex internal processes
and lots of code and configuration that nobody knows about. A
Windows-Linux migration in the past also does not help to achieve a clean
platform.

On the other hand, being a market leader does not leave any room for
relaxation but requires us to stay ahead. We need to be faster than the competition and make sure that our own size and being part of a larger corporation does not slow us down.

Continuous Delivery is not just a buzz
word but the answer to many of our current problems. Today we
envision our data center and the various IT departments as building
blocks in a Continuous Delivery Platform (CDP) that strives to shorten
the time it takes to convert an idea into productive code.

This talk starts from a big picture of a typical web company and drills
down into the technical and organizational challenges that stood in the
way of creating a CDP. Our developers turning agile and doing everything
through SCRUM was only the start of a series of profound changes that
touched all IT departments and beyond.

DevOps helped us
a lot to explain to our management and colleagues what is going on and
what we want. But only a brand-new deployment and configuration management
brought the actual break-through to shared responsibility and teams
developing operational thinking.

An important learning was that engineers come together through solving common problems as a team. In our case we had to deal with two main concerns: Linux and Java.

Linux being the choice operating environment we started to do things the
Linux Way
and package all our software, configuration files and even content into
RPM packages, thus greatly simplifying the problem of deployment and system management. Since our developers build the RPM packages they also get
much more involved in site operations and suddenly the whole DevOps idea
actually works out for us.

Java being the choice coding language (with a huge code base :-() and a lot of “Java thinking” lead us to write a bridge
between Java and Linux: Our Nexus YUM
plugin translates between a Java world that knows only Maven and a Linux
world that likes to install packages via YUM. The automated build
process in TeamCity creates RPM packages and puts them into the Nexus
which serves the same RPM packages as a YUM repository to our servers. This simplifies the handover from development to operations and is a big performance boost for our delivery chain.

These and other technical solutions come together with many organizational changes – e.g. giving developers more access in the data center – to create the foundation for our Continuous Delivery Platform and enable everyone to focus on working the software while relying on a reliable delivery tool chain below.

Another important learning is the way how to ensure the management buy-in into what essentially started out as an internal grassroots movements. Previously closely guarded kingdoms are now open to common responsibility based on a trust relationship between development and operations.

With even product owners seeing the
business value of web operations, ImmobilienScout24 is now in a much
better position to deliver business value as fast as possible to our web
platform.

We would like to share with you the details of our journey, the ideas
that helped us along the way and the code that we wrote. This talk will be useful to both managers and engineers who want to embark on a similar path.

Photo of Schlomo Schapiro

Schlomo Schapiro

ImmobilienScout24

Schlomo Schapiro works as a Systems Architect and Open Source Evangelist at ImmobilienScout24, the leading German real estate market place. Core areas of interest are open source solutions and web operations.

The ImmobilienScout24 web platform is based on Linux, Apache, Tomcat and open standards. We are currently creating a new deployment and management solution for our data center based on RPM packages.

Schlomo maintains several successful open source projects and is a regular speaker at various conferences. Schlomo is a strong DevOps and web operations advocate and writes regularly for German IT magazines and his BLOG.

Photo of Ingmar Krusch

Ingmar Krusch

ImmobilienScout24

Ingmar Krusch is a teamlead of Sysadmins and Systemdevelopers at germany’s leading real estate search portal.

Through his former life as a developer and teamlead of developers, he first got in contact with the agile mindset through Scrum. Ingmar started to implement Scrum at his employer as a dev teamlead and broadened his agile mindset with DevOps and Kanban trough his work in the ops realm, first as a systems architect and now as an ops teamlead.

Currently he is implementing Kanban and promoting the DevOps mindset and culture at his employer while implementing a continuous delivery platform (CDP). ImmobilienScout24 uses this CDP to deploy 800+ VMs completely (including configuration) via RPMs.

See YADT http://code.google.com/p/yadt/

You can reach him via twitter@IngmarKrusch, via mail krusch@gmx.de or Google+

Comments on this page are now closed.

Comments

Paul Nasrat
10/11/2011 9:48 CET

Great to have a walk through of how they tackled their continuous delivery problems but ,perhaps due to end of day fatigue, I felt could have been condensed into a shorter talk.

Picture of Ingmar Krusch
Ingmar Krusch
30/10/2011 14:16 CET

Hi Xavier

Thanks. Our plugin exposes arbitrary views over the RPMs in a nexus repository and exposes those as a YUM channel. For the most part our portal is deployed in weekly major releases. So all the RPMs for a specific release get their own view. Meaning you get an URL for a yum channel where you see all the RPMs for a specific release and only those. Plus you are able to define aliases for releases like “latest” or “previous”. Once we get to a stable version of the plugin we will open source this also.

HTH Ingmar

Xavier Chatelain
29/09/2011 18:11 CEST

Great post! Is your “Nexus YUM plugin” similar to this request: issues.sonatype.org/browse/... I think a lot of people would be interested in your contribution. Cheers, Xavier

Bulletin

Bulletin

  • ip-label
  • Compuware Corporation
  • dynaTrace
  • Keynote Systems
  • New Relic
  • Citrix Systems
  • Google
  • Apica
  • AppDynamics
  • CDNetworks
  • Cotendo
  • Dyn Inc.
  • ImmobilienScout24
  • Spil Games
  • Dyn Inc.

For information on exhibition and sponsorship opportunities at the conference, contact Gloria Lombardo at glombardo@oreilly.com

View a list of Velocity Europe contacts