High Scalability

DECEMBER 5, 2018

This article is written by Preetam Jinka , Senior Infrastructure Engineer at ShiftLeft. Originially published as Time Series at ShiftLeft. Time series are a major component of the ShiftLeft runtime experience. This is true for many other products and organizations too, but each case involves different characteristics and requirements. This post describes the requirements that we have to work with, how we use TimescaleDB to store and retrieve time series data, and the tooling we’ve develope

Infrastructure 193

Infrastructure Metrics Engineering Development 193

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. The AWS Europe (Stockholm) Region is our fifth European Region, joining Dublin, Frankfurt, London, and Paris.

AWS 121

AWS Cloud Games Serverless 121

Speed Curve

DECEMBER 10, 2018

JavaScript is the main cause for making websites slow. Ten years ago it was network bottlenecks, but the growth of JavaScript has outpaced network and CPU improvements on today's devices. In the chart below, based on an analysis from the HTTP Archive , we see the number of requests has increased for both first and third party JavaScript since 2011. The following chart shows the growth in the total size of JavaScript from 2011.

Website 111

Website Network Code Availability 111

O'Reilly Software

DECEMBER 4, 2018

A new report explores how far companies have come with microservices. Fads come and go in the technology world—anyone remember AJAX ? When new, shiny things appear, architects often struggle to determine whether this is merely the latest fad or a genuine future direction. Microservices are evolving from fad to trend. Several years ago, many companies experimented with microservices but had doubts about the operational complexity and engineering maturity required to achieve success.

Software Architecture 95

Software Architecture Best Practices Architecture Engineering 95

Edge Perspectives

DECEMBER 31, 2018

As we enter the New Year, it’s an opportunity to step back and reflect in an increasingly hectic world. In an earlier post , I suggested we need to find time to reflect in a world increasingly dominated by flows – it’s a healthy form of friction that can actually enhance our ability to generate more insight from flows. Embrace the New Year as an invitation to reflect.

Social Media 85

Social Media Media Engineering Performance 85

Uber Engineering

DECEMBER 10, 2018

Uber, like most large technology companies, relies extensively on metrics to effectively monitor its entire stack. From low-level system metrics, such as memory utilization of a host, to high-level business metrics, including the number of Uber Eats orders in a … The post The Billion Data Point Challenge: Building a Query Engine for High Cardinality Time Series Data appeared first on Uber Engineering Blog.

Engineering 75

Engineering Metrics Monitoring Technology 75

High Scalability

DECEMBER 7, 2018

Wake up! It's HighScalability time: This is your 1500ms latency in real life situations - pic.twitter.com/guot8khIPX. — Ivo Mägi (@ivomagi) November 27, 2018. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Know anyone looking for a simple book explaining the cloud? Then please recommend my well reviewed (31 reviews on Amazon and 72 on Goodreads!

Internet 163

Internet Internet Scalability Blockchain 163

Randon ASCII

DECEMBER 3, 2018

Subtitle: Making Windows Slower Part 3: Process Destruction. In the summer of 2017 I wrestled with a Windows performance problem. Process destruction was slow, serialized, and was blocking the system input queue, leading to repeated short mouse-movement hangs when building Chrome. The root cause was that Windows was wasting a lot of time looking up GDI objects during process destruction, and it did this while holding the system-global user32 critical section.

Programming 71

Programming Processing Testing Code 71

Tim Kadlec

DECEMBER 4, 2018

Last week I had the opportunity to present at a technical SEO conference about performance. At the speakers dinner, I was enjoying a really good conversation with a few folks I met. At one point, I brought up quokkas because they’re amazing and I desperately want to hang out with one. Or a few. Anyway. It turns out, the other folks at the table were not familar.

Google 70

Google Engineering Internet Internet 70

n0derunner

DECEMBER 17, 2018

How to reduce database restore time by 50%. During.Next 2018 in London, Nutanix announced performance improvements in the core-datapath said to give up to 2X performance improvements. Here’s a real-world example of that improvement in practice. I am using X-Ray to simulate a 1TB data restore into an existing database. Specifically the IO sizes are large, an even split of 64K,128K,256K, 1MB and the pattern is 100% random across the entire 1TB dataset. bssplit=64k/20:128k/20:256k/20:512k/2

Performance 64

Performance Benchmarking Storage Network 64

KeyCDN

DECEMBER 6, 2018

Git is the go-to version control tool for most software developers because it allows them to efficiently manage their source code and track file changes while working with a large team. In fact, Git has so many uses that memorizing its various commands can be a daunting task, which is why we’ve created this git cheat sheet. This guide includes an introduction to Git, a glossary of terms and lists of commonly used Git commands.

Best Practices 58

Best Practices Open Source Cache Systems 58

High Scalability

DECEMBER 14, 2018

Wake up! It's HighScalability time: We've come a long way in 50 years. Or have we? Alan Kay : I believe ARPA spent $ 175,000 of 1968 money for that one demo. That’s probably like a million bucks today. Bill English : What we did was lease two video circuits from the phone company. They set up a microwave link: two transmitters on the top of the building at SRI, receiver/ transmitters up on Skyline Boulevard on a truck, and two receivers at the Civic Center.

Internet 141

Internet Internet Scalability Serverless 141

Speed Curve

DECEMBER 3, 2018

The number of performance metrics is large and increases every year. It's important to understand what the different metrics represent and pick metrics that are important for your site. Our Evaluating rendering metrics post was a popular (and fun) way to compare and choose rendering metrics. Recently I created this timeline of performance metric medians from the HTTP Archive for the world's top ~1.3 million sites: Here's the same chart for mobile: People who have worked on web performance won't

Metrics 58

Metrics Mobile Tuning Network 58

TechBeacon Testing

DECEMBER 6, 2018

If you're a tester and you think you need to get up to speed on coding to become a test automation engineer, you're on the right track. But don't just learn to code. Instead, start by learning about source control, a methodology for tracking and managing changes to your code.

Testing 58

Testing Speed Code Engineering 58

Testlodge

DECEMBER 12, 2018

What is an API? API stands for Application Program Interface. An API is an intermediate layer in a software system that is responsible for the data communication between the data source and the Graphical User Interface (GUI) that user’s see. In other words, the API is the business layer of the software that creates a connection between the presentation layer and the data layer.

Testing 58

Testing Testing Tools Servers Code 58

Brendan Gregg

DECEMBER 31, 2018

At the Linux Plumber's conference there were at least 24 talks on eBPF. It has quickly become not just an invaluable technology, but also an in-demand skill. Perhaps you'd like a new year's resolution: learn eBPF! eBPF should stand for something meaningful, like Virtual Kernel Instruction Set (VKIS), but due to its origins it is extended Berkeley Packet Filter.

C++ 52

C++ Virtualization Programming Code 52

The Polyglot Developer

DECEMBER 24, 2018

The 2018 year is winding down so it is time to reflect on some of the things that have happened in terms of The Polyglot Developer and all of its channels. Let this be a statistics report for everything that has happened on the blog, YouTube channel, and podcast. If you’re interested in adventuring into the world of technical content production, this will give you some perspective into what to expect.

Development 52

Development 52

High Scalability

DECEMBER 21, 2018

Wake up! It's HighScalability time: Have a very scalable Xmas everyone! See you in the New Year. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Still looking for that perfect xmas gift? What could be better than a book on the cloud? Explain the Cloud Like I'm 10. And if you know someone with hearing problems they might find Live CC useful. 33.5 billion : Pornhub visits; 122 million : miles traveled by Santa; 32,342 : government requests to Apple for user

Internet 137

Internet Internet Scalability Serverless 137

Percona Community

DECEMBER 14, 2018

As mentioned in a previous post, I gave a talk at Percona Live Europe 2018 about system-versioned tables. This is a new MariaDB 10.3 feature, which consists of preserving old versions of a table rows. Each version has two timestamps that indicate the start (INSERT,UPDATE) of the validity of that version, and its end (DELETE, UPDATE). As a result, the user is able to query these tables as they appear at a point in the past, or how data evolved in a certain time range.

Systems 52

Systems 52

ACM Sigarch

DECEMBER 6, 2018

The tremendous growth in visual computing is fueled by the rapid increase in deployment of visual sensing (e.g. cameras) in many usages ranging from digital security/surveillance and automated retail (e.g. smart cameras & analytics) to interactive/immersive environments and autonomous driving (e.g. interactive AR/VR, gaming and critical decision making).

Wireless 54

Wireless IoT Architecture Analytics 54

Randon ASCII

DECEMBER 9, 2018

Last week I wrote about the performance consequences of inadvertently loading gdi32.dll into processes that are created and destroyed at very high rates. This week I want to share some techniques for digging deeper into this behavior, and the odd things that I found when trying to use them. When I first wrote UIforETW I noticed that an inordinate amount of the size of the traces it recorded was coming from the Microsoft-Windows-Win32k provider.

Processing 53

Processing Traffic Testing Systems 53

Speed Curve

DECEMBER 19, 2018

This blog post has a simple conclusion: Load script asynchronously! Simple, and yet the reality is that most scripts are still loaded synchronously. Understanding the importance of loading scripts asynchronously might help increase adoption of this critical performance improvement, so we're going to walk through the evolution of async script loading starting way back in 2007.

Internet 53

Internet Internet Website Traffic 53

Edge Perspectives

DECEMBER 25, 2018

The spine beckons Teasing us with so little, But pulling us To pull it off the shelf And explore what’s inside. We’re drawn page by page, Exploring new terrain, Seeking insight and inspiration, Drawn by the promise of something Much bigger than the pages in our hand. The trees that gave their lives Are grateful for our attention And hoping that they can Make our lives much richer and more satisfying Here’s hoping that your tree On Christmas morning Will add some more spines To nourish your days

52

52

High Scalability

DECEMBER 11, 2018

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Advertise your event here! Cool Products and Services. InMemory.Net provides a Dot Net native in memory database for analysing large amounts of data.

Java 125

Java Metrics Software Engineering DevOps 125

Particular Software

DECEMBER 18, 2018

The wait is over! Today we’re releasing the new Azure Service Bus transport, which is fully compatible with NServiceBus 7 and.NET Core. You will now be able to run NServiceBus endpoints using Azure Service Bus anywhere. With the release of the new NServiceBus Azure Service Bus transport, we are now able to take full advantage of.NET Core and Azure. Getting up and running was simple and we don't have to worry about managing and maintaining queue databases anymore.

Transportation 49

Transportation Azure Benchmarking Availability 49

Professor Beekums

DECEMBER 4, 2018

I recently came across the need for a date/time parser that used natural language processing. Maleega’s date picker is extremely barebones and needed replacing. I left it barebones because I wanted time to figure out how to build a good date/time picker. Every one that I’ve used has felt clunky. This is probably because of the inherent challenges with date and time.

Processing 49

Processing 49

ACM Sigarch

DECEMBER 17, 2018

“A lot of people have gone further than they thought they could because someone else thought they could” — Zig Ziglar, renowned motivational speaker. Good mentoring can have an outsized impact on the careers of students, especially during early stages of their career. Countless stories that credit the right advice at the right time for launching outstanding career trajectories are commonplace.

Architecture 49

Architecture Network Strategy Systems 49

KeyCDN

DECEMBER 12, 2018

Icons are some of the most-used graphics in web and application design. They’re so commonplace, in fact, that most non-designers take them for granted. For designers, though, icons are more than just graphical afterthoughts. They’re guideposts that lead web visitors and app users through a complex set of interactions with their favorite sites and tools.

Website 49

Website Design Google Availability 49

QAMentor

DECEMBER 25, 2018

Any software needs to go through various types of tests to assure that it has the required competitive edge. Today, when the protection of information resources is a necessary requirement of business service, penetration test allows obtaining an objective assessment of how easy it is to make unauthorized access to corporate network resources and site … The post Step-wise Guide to Perform Penetration Testing appeared first on QA Mentor Blog.

Testing 45

Testing Performance Network Software 45

High Scalability

DECEMBER 18, 2018

Who's Hiring? pMD is a fast­ growing , highly rated health care technology company that has been recognized as a Best Place to Work by SF Business Times, Modern Healthcare, and Inc. Senior DevOps Engineer : Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast.

Healthcare 122

Healthcare Best Practices DevOps Cache 122

Website Optimization

DECEMBER 19, 2018

Personal consumer data has become the oil of the 21st century. American companies are expected to spend close to $20 billion on consumer data in 2018 (New York Times 2018). Data trackers are the main way advertisers gather this valuable consumer data.

Speed 45

Speed Website 45

The Polyglot Developer

DECEMBER 17, 2018

A long time ago when I had been exploring session management in Node.js, I had written a tutorial titled, Session Management in Your Express.js Web Application. This was a basic tutorial that is still very functional today, however little things have changed since then when it comes to how the web works. For example, in 2015 HTTPS was never a requirement and we weren’t exposed to all the frontend web frameworks that exist today.

Development 45

Development 45

Speed Curve

DECEMBER 17, 2018

The Internet really is a complicated series of tubes. As a result, any time-based metrics we capture can have variations as those tubes wobble a bit as we shove data down them. To help reduce that variation, when we do synthetic tests, we always load a page at least three times and take the median result. But even then you'll find that, over time, your charts will still show plenty of variation.

Metrics 45

Metrics Traffic Internet Internet 45

TechBeacon Testing

DECEMBER 26, 2018

With more organizations implementing automated testing practices these days, developer and QA focus has shifted from "Do we need test automation?" to "How do with get the most out it?" The use of AI and machine learning in test automaton received a lot of attention this year, as did other core topics such as training testers to become automation engineers and developers to become better testers.

Testing 42

Testing Engineering Development 42

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. The closing of a year lends itself to looking back. And making lists. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 41

Database Tuning Performance AWS 41

High Scalability

DECEMBER 4, 2018

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Advertise your event here! Cool Products and Services. InMemory.Net provides a Dot Net native in memory database for analysing large amounts of data.

Java 120

Java Metrics Software Engineering DevOps 120

Website Optimization

DECEMBER 7, 2018

With Google's new expanded text ads (90 characters vs. 45) there is more room to make your case to potential buyers. One of the best ways to optimize a PPC account is to improve the ad text. This article shows how you can use local landmarks to boost click-through rates and conversions.

Google 45

Google 45