Product, Use Cases, Company

The Internet of Pis with Hackers at Berkeley

For more than five years, DC/OS has enabled some of the largest, most sophisticated enterprises in the world to achieve unparalleled levels of efficiency, reliability, and scalability from their IT infrastructure. But now it is time to pass the torch to a new generation of technology: the D2iQ Kubernetes Platform (DKP). Why? Kubernetes has now achieved a level of capability that only DC/OS could formerly provide and is now evolving and improving far faster (as is true of its supporting ecosystem). That’s why we have chosen to sunset DC/OS, with an end-of-life date of October 31, 2021. With DKP, our customers get the same benefits provided by DC/OS and more, as well as access to the most impressive pace of innovation the technology world has ever seen. This was not an easy decision to make, but we are dedicated to enabling our customers to accelerate their digital transformations, so they can increase the velocity and responsiveness of their organizations to an ever-more challenging future. And the best way to do that right now is with DKP.

Sep 24, 2015

Sunil Shah

D2iQ

On Thursday 17th September, Mesosphere hosted our second workshop for undergraduate students at UC Berkeley through Hackers @ Berkeley. Hackers @ Berkeley is a student organisation that aims to teach its members practical Computer Science skills through workshops and hackathons.

 

Not only did Apache Mesos, the open source cluster manager that underpins Mesosphere's DCOS, begin life as a graduate student project at UC Berkeley, but Mesosphere is also host to several Cal alumni - including one of our founders, Benjamin Hindman. So we jumped at the opportunity to introduce undergraduates to what we believe is the future of deploying and orchestrating services.

 

Microservices are an abstract concept, particularly if you're used to building monolithic applications to solve homework problems or for class projects. One of the goals of the workshops was to show how microservices work in reality and how you can easily package and deploy your very own microservice using Docker and DCOS.

 

Tyler telling us about containers.

 

Students used a 15 node DCOS Community Edition cluster running on Amazon Web Services and deployed their applications using the DCOS CLI.

 

Our goal was to show how you can do something useful with microservices. We initially came up with a basic frontend/backend exercise that provided built-in service discovery using Mesos-DNS. It was kind of cool, but we wanted something that connected with the real world in a tangible way.

 

In August, we announced Mesosphere Infinity, a new product that makes it easy to launch a data ingestion system on a DCOS cluster. This inspired our workshop activity and we ended up using a subset of Mesosphere Infinity to create a simple Internet of Things pipeline.

 

In our pipeline, we used 7 Raspberry Pis equipped with USB microphones, wi-fi, and a simple Python script to capture the local noise level. These sensors posted their data in real time to a DCOS cluster running in the cloud, on Amazon Web Services.

 

We then built a simple Python REST API called Perimeter that wrote the ingested data to a Cassandra ring. Our workshop participants would, as their final exercise, deploy a Javascript visualiser to the DCOS cluster.

 

Several students made it all the way through to the end and had their very own visualizer running!

 

While we hope the students learned something useful, the evening wasn't without its lessons for us, also. It helped us come up with good, simple examples that show how to deploy services on DCOS clusters.

 

The source code for this pipeline is available on GitHub. Huge thanks to Tyler Neely and Greg Mann for their help making the workshop possible, and to Christian Bogeberg, Gabriel Hartmann, Gilbert Song, John Garcia, Jonathan Manalus and Kim Garshol for their support during the workshop.

Ready to get started?