This is #1 in a very long series of posts on Stack Overflow’s architecture. Welcome.Previous post (#0): Stack Overflow: A Technical Deconstruction Next post (#2): Stack Overflow: The Hardware - 2016 E
How to Monitor Kafka ByDavid Mytton, CEO & Founder of Server Density . Published on the 19th January, 2016. Share on Twitter Share on Reddit Share on Reddit Distributed systems and microservices are a
L IKE most of my generation, I was brought up on the saying “Satan finds some mischief still for idle hands to do.” Being a highly virtuous child, I believed all that I was told and acquired a conscie
December 8, 2015 Published by Lukáš Poláček Load Balancing Most Spotify clients connect to our back-end via accesspoint which forwards client requests to other servers. In the picture below, the acces
December 18, 2014 Published by Björn Hegerfors For my master’s thesis, I developed and benchmarked an Apache Cassandra compaction strategy optimized for time series. The result, the Date-Tiered Compac
Introduction The Go runtime, in addition to providing the usual services of garbage collection, goroutine scheduling, timers, network polling and so forth, contains facilities to enable extra debuggin
28 September 2015 For the past eleven months I’ve been the tech lead for Twitter’s Engineering Effectiveness group. Engineering Effectiveness is our name for what elsewhere might be called Developer T
Netflix Technology Blog Follow Nov 30, 2015 · 11 min read You log in to a Linux server with a performance issue: what do you check in the first minute? At Netflix we have a massive EC2 Linux cloud, an
Government Customer Portal Partners Events Contact Us Deutsch Español Français 日本語 한국어 Português 中文 Deutsch Español Français 日本語 한국어 Português 中文 All Products Products Database Performance Analyzer Cr
Controlling Queue Delay – Nichols & Van Jacobsen, 2012, and Fail at Scale – Maurer, 2015 Fail at Scale (Maurer) Ben Maurer recently wrote a great article for ACM Queue on how Facebook achieves reliabi
The May/June 2020 issue of acmqueue is out now Subscribers and ACM Professional members login here Web Services PDF October 27, 2015 Volume 13, issue 8 Fail at Scale Reliability in the face of rapid c
Productivity Will we ever decouple perceived effort and long hours with our rewards system? 0 As you sink into the couch, or slide onto the barstool, at the end of an exhausting workday, it’s hard not
Cassandra is an excellent fit for time series data, and it's widely used for storing many types of data that follow the time series pattern: performance metrics, fleet tracking, sensor data, logs, fin
A few hundred milliseconds latency is achievable for a complex fraud prevention system, but with very little wiggle room. In the past two years, we have selected a few design patterns that have helped
by Nate Berkopec ( @nateberkopec ) Vote on HN Summary: The total size of a webpage, measured in bytes, has little to do with its load time. Instead, increase network utilization: make your site preloader-friendly, minimize parser blocking, and start downloading resources ASAP with Resource Hints.…
tl;dr - Check out my result-monad gem. Monads are a familiar topic for many functional programmers. Rust uses monads very prolifically, passing Results(a.k.a the Either monad) at any point that a computation or operation could fail. This leads to very up front error handling, as well as very…
This is a post inspired by a thread that Nate Finch started on the Go Forum . This post focuses on Go, but if you can see your way past that, I think the ideas presented here are widely applicable. Wh
With millions of people now using Wanelo across various platforms, collecting and analyzing user actions and events becomes a pretty fun problem to solve. While in most services user actions generate
Blog Sometimes it’s helpful to look at an aggregated overview of many rows. With numeric columns, it’s easy to sum or average many values, but for string columns we need something different. We can co
Anuj Goyal Oct 14, 2015 · 6 min read Data is a big deal at IFTTT . Our business development and marketing teams rely on data to make critical business decisions. The product team relies on data to run
(*) with apologies to Moseley, Marks, and Westley. Something a little different to the regular paper reviews for the next three days. Inspired by yesterday’s ‘ Consistency without Borders ,’ and somew
One of the most common issues you face when using DynamoDB, or any similar “Big Data” type database, is that it doesn’t access your data in a very uniform pattern. It’s a kind of issue commonly known
We're building the world's first visual discovery engine. More than 400 million people around the world use Pinterest to dream about, plan and prepare for things they want to do in life. Our core valu
As a follow up to my post on writing the SignalFx metric proxy in Go , this blog post will look at how we go about optimizing Go code through a real life example with our production ingest service. This is a generalizable pattern that we follow to optimize various parts of our codebase. SignalFx is…
Ian Meyers is a Solutions Architecture Senior Manager with AWS Amazon DynamoDB is a fast, flexible, and fully managed NoSQL database service that supports both document and key-value store models that
Mike Deck is a Solutions Architect with AWS Amazon S3 is a simple key-based object store whose scalability and low cost make it ideal for storing large datasets. Its design enables S3 to provide excel
When the 2011 earthquake and tsunami struck Tohoku, Japan, Chris Goldfinger was two hundred miles away, in the city of Kashiwa, at an international meeting on seismology. As the shaking started, every
As Twitter has grown into a global platform for public self-expression and conversation, our storage requirements have grown too. Over the last few years, we found ourselves in need of a storage syste
About Projects w Opinion Talks September 9, 2015 Lost in Your Vision Dustin Curtis recently wrote about Fixing Twitter — most of which I can’t say I agree with — but he did touch on an idea I like to call being Lost in your Vision . This affliction affects employees and non-employees alike, and…
Infrastructure By Leigh Stewart Wednesday, 16 September 2015 At Twitter, we’ve used replicated logs to address a range of challenging problems in distributed systems. Today we’d like to tell you about
The topic of this article is actually quite specific. Recently, I faced a situation where I needed to preload a lot of images in parallel. With the given constraints, it ended up being more challengin
Or how I learned to stop worrying and love versionless package management If you spend any time on the golang-nuts mailing list you’ll learn that theonly thing more contentious than generics is packag
We recently hired someone to help us with some data analysis and reporting requirements. We're not really big enough to claim that what we needed was a Data Scientist, but that is effectively what we
While doing some work on our Pro dashboard, we noticed that search requests were taking around 300ms. We've got some people in the team who have used Elasticsearch for much larger datasets, and they w
When developing gems, often one of the difficult problems to solve is creatinga good ratio between simplicity , convenience and flexibility . A simple gem is easy to understand, both in public interfa
March 20, 2015 When the new Senior VP of Engineering took over at a major Silicon Valley tech company a few years back, the first thing he had to do was freeze hiring. The company had been growing rap
Photo Credit Getty Images Phys Ed Gretchen Reynolds on the science of fitness. Really, Really Short Workouts Think you’re too busy to work out? We have the workout for you. Learn more and try it yours
We recently hired someone to help us with some data analysis and reporting requirements. We're not really big enough to claim that what we needed was a Data Scientist, but that is effectively what we
john