article thumbnail

Percentiles don’t work: Analyzing the distribution of response times for web services

Adrian Cockcroft

The common way to deal with this is to measure percentiles, and track the 90%, 99% response times for example. For example lets say you have a 99% within 2 seconds SLA, and your current 99%ile measured over one minute is 1 second. However it’s very difficult to decide what the right SLA is, or to tell how close you are to exceeding it.

Lambda 98
article thumbnail

Radically speed up your code by fixing slow or frequent garbage collection

Dynatrace

As you can see in the example below, CPU usage rises just as CPU consumption by garbage collection rises. Somewhere within the lambda call, the code allocated about 80 GB and 1.27 In the example below, you can deduce that the biggest benefit would be from reducing the number of times we create a new DataInputStream. .

Speed 165
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Revisiting “Serverless Architectures”

The Symphonia

In the first example section I added a couple of paragraphs on “choreography over orchestration”. I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea.

article thumbnail

In-Stream Big Data Processing

Highly Scalable

Consider an example where relation R is joined with relation S on a numerical key k and a simple modulo-based hash function is used to produce the partitions (it is assumes that the data initially distributed among the processors based on some other policy): The divide and broadcast join algorithm is illustrated in the figure below.

Big Data 154
article thumbnail

Continuous Integration / Continuous Delivery on AWS

The Symphonia

You can use various different sizes of build host (small, medium, large); you can use one of the predefined images as your build environment, or you can define your own docker image to use; and you can, if you want, cache data across build runs. An example of using AWS CodePipeline CodePipeline is a CD pipeline orchestrator.

AWS 40
article thumbnail

Embrace event-driven computing: Amazon expands DynamoDB with streams, cross-region replication, and database triggers

All Things Distributed

Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it.

Database 167
article thumbnail

How to Reduce Your CDN Infrastructure Expenses

IO River

For example, if you’re deploying the infrastructure for an e-commerce website, security becomes a fundamental requirement. For example, the first 10TB to South America cost $0.11.Source: For example, Lambda@Edge request pricing is $0.6 However, if your traffic is dynamic, you'll need a CDN that can adapt.Â