DCPython: Architecture at PBS

Slides from DCPython meetup on Jun 7, 2011

Edgar and I had the pleasure of presenting at the DCPython meetup last night about how PBS uses Python, Django, Celery, Solr and Amazon Web Services (autoscaling EC2, RDS) to power many of our sites and services. We focused primarily on the COVE (video) and Merlin (content) APIs since those probably have the most interesting ...

Read more

Recovering from Amazon cloud outage

What happens when the AWS cloud has a very, very bad day?

Amazon Web Services (AWS) have been integral to the successes of nearly all recent project launches at PBS. All of our core applications are deployed out on AWS EC2 servers and RDS database instances. While we have experienced an occasional component failure, these have been infrequent. When failures have occurred, we have typically been able to leverage the agility ...

Read more

AWS Identity and Access Management (IAM) with Python

Flexible access control to AWS cloud services using Amazon IAM, Python, and boto

With all the AWS services that are now available, our opportunities in the cloud are virtually unlimited. But using any of these services requires access to your AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY and unfortunately, these keys provides complete access to the kingdom. This may not be a problem for some, but for large enterprises, granular access control is a necessity.

Up until recently, we would have been out ...

Read more

pyawschart - v0.2 released

Amazon CloudWatch data visualization

I have just pushed the source code for pyawschart - v0.2 out to GitHub. This project was created a few months back and I have been using it for personal (Proboscis) and professional (PBS) projects since then. I've just decided to open ...

Read more

New PBS.org launched!

New Django-based PBS.org site and APIs

Today is a big day. Just after midnight we pulled the trigger and launched the new re-envisioned PBS.org website. This is a huge step for PBS on a number of fronts; mostly having to do bringing PBS to the forefront of new media.

Read more

CloudFront object invalidation in Python

Pythonically purge objects from CloudFront via RESTful API

Amazon Web Services enables the management of all AWS services through some pretty powerful REST APIs. CloudFront is Amazon's content delivery network offering which allows you to serve files out of S3 buckets with much better performance. S3 files are cached at edge servers so that users may download them more quickly. The service plays nice with ...

Read more

Private clouds for developers

A viable option?

At PBS we have been launching most new applications up in Amazon's cloud platform utilizing EC2 instances, EBS and S3 storage, etc. The flexibility and agility that this Infrastructure as a Service (IaaS) is truly game changing, if not frightening (to IT departments).

The ease with which I am able spin up a server or 30 still gives me the chills even though I've been doing this for years by now. In fact, it is so ...

Read more