The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. By integrating with studio content systems, we enabled the pipeline to leverage rich metadata from the creative side and create more engaging member experiences like interactive storytelling.

Processing 238

Processing Media Latency Innovation 238

The Netflix TechBlog

MARCH 1, 2021

Background The Media Cloud Engineering and Encoding Technologies teams at Netflix jointly operate a system to process incoming media files from our partners and studios to make them playable on all devices. The first generation of this system went live with the streaming launch in 2007. Delivery?—?A

Serverless 235

Serverless Media Latency Social Media 235

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. We’ve had nearly 4 million visits to the blog in 2018: thank you! As 2018 moves into 2019, let’s take a quick look back at some of the most popular posts on the blog this year. Linux OS Tuning for MySQL Database Performance.

Database 51

Database Tuning Performance AWS 51

Percona

MAY 1, 2023

This blog was originally published in August 2018 and was updated in May 2023. Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload.

Tuning 52

Tuning Database Efficiency Performance 52

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. We want to support these systems as a source so that they can provide their data for further consumption. Some of DBLog’s features are: Processes captured log events in-order.

Database 221

Database Traffic Transportation Open Source 221

Brendan Gregg

APRIL 30, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. The CFP for LISA18 is open now, and we’d love for you to submit talks and tutorials ideas by May 24th, 2018. We hope you'll consider submitting a talk or tutorial, and plan to attend LISA 2018. Join us for 3 days in Nashville at LISA'18.

DevOps 41

DevOps Network Best Practices Programming 41

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. We want to support these systems as a source so that they can provide their data for further consumption. Some of DBLog’s features are: Processes captured log events in-order.

Database 206

Database Traffic Transportation Open Source 206

Brendan Gregg

APRIL 29, 2018

USENIX’s LISA conference is the premier event for topics in production system engineering. The CFP for LISA18 is open now, and we’d love for you to submit talks and tutorials ideas by May 24th, 2018. We hope you'll consider submitting a talk or tutorial, and plan to attend LISA 2018. Join us for 3 days in Nashville at LISA'18.

DevOps 40

DevOps Network Best Practices Programming 40

Smashing Magazine

DECEMBER 2, 2021

Stay tuned for lots of articles on metaprogramming, applications, useful Raku modules, programming techniques, guides on how to work with Raku inside containers, and even how to migrate from good ol’ Perl. Tune in each day for an article that explores the wide range of topics in system administration. SysAdvent on Twitter.

Design 120

Design Development Programming Website 120

Tasktop

MAY 24, 2021

Citing the Navy’s “leadership factory”, he encouraged attendees to focus on tuning a system for building leaders, to give them the responsibility and ownership to hone their skills and come back “stronger” from missions. OKRs (objectives and key results) are a popular management system for setting and reaching aspirational goals.

DevOps 91

DevOps Metrics Healthcare Innovation 91

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF (extended Berkeley Packet Filter) is in the Linux kernel and is the new hotness in systems engineering. Here's key differences as of August 2018: Type DTrace bpftrace.

C++ 40

C++ Virtualization Programming Latency 40

The Netflix TechBlog

JULY 1, 2019

Surface Cache Surface cache is a reserved pool in main memory (or separate graphics memory on a minority of systems) that the Netflix app uses for storing textures (decoded images and cached resources). when we rolled them out globally at the end of 2018. both the full and fallback experiences?—?when

Cache 167

Cache Design Testing Development 167

Percona

SEPTEMBER 13, 2018

2018-09-03.09 > mysql-slowquery.log.2018-09-03.09 2018-09-03.09 2018-09-03.09 system time, 43.80M rss, 141.48M vsz # Current date: Tue Sep 4 15:54:21 2018 # Hostname: aahmed-GL503VD # Files: mysql-slowquery.log.2018-09-03.09 2018-09-03.09 Run pt-query-digest on the log file. . $ user time, 2.5s

C++ 62

C++ AWS Open Source Testing 62

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. Users also need to know how to create a prompt for an AI system that will generate a useful answer.

Open Source 135

Open Source Google Artificial Intelligence Infrastructure 135

Smashing Magazine

JUNE 3, 2022

These compiled systems for letters and symbols, which are representations of sounds and information, get a lot of use and are a large part of graphic communication. Fast forward to the early 1960s, phototypesetting systems appeared. Instead, we need to address multiple factors within the design system. Stay tuned!

Performance 123

Performance Design Best Practices Testing 123

Brendan Gregg

FEBRUARY 9, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Also microbenchmarks, which often stress-test the system, will suffer the largest losses. This shows the system-wide syscall rate. Much of my testing was on Linux 4.14.11

Performance 72

Performance Benchmarking Cache Tuning 72

Percona

APRIL 12, 2023

Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2018: MongoDB announces that it is moving from GNU AGPLv3 licensing to the Service Side Public License (SSPL).

Open Source 98

Open Source Programming Database Servers 98

Percona

JULY 30, 2018

Please join Percona’s CEO, Peter Zaitsev as he presents Using MySQL for Distributed Database Architectures on Tuesday, July 31st, 2018 at 7:00 AM PDT (UTC-7) / 10:00 AM EDT (UTC-4). In this presentation, we will look at how we can use MySQL to engineer distributed multi-node systems. Register Now. Register for the webinar.

Architecture 59

Architecture Database Open Source Internet 59

HammerDB

MAY 5, 2019

However as noted many factors affect spin-locks including how much time you actually spend in locks in the first place and therefore the best way to really determine how much time you have to spend in fine-tuning spin-locks in the real world can be done through testing. Copyright (C) 2003-2018 Steve Shaw. In the recent MySQL 8.0.16

Testing 49

Testing Tuning Storage Latency 49

KeyCDN

SEPTEMBER 20, 2018

Let’s take a look at some of the best error monitoring tools and strategies for 2018. Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app. That being said, here are some of the best tools for tracking web application errors in 2018 Automated Testing 1.

Monitoring 67

Monitoring Strategy Website Google 67

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB.

Best Practices 40

Best Practices Scalability Performance C++ 40

Rigor

SEPTEMBER 3, 2019

In one high-profile example, Amazon dealt with significant outages on Prime Day 2018 , which may have cost them as much as $99 million in sales. JCrew’s site went down on Black Friday 2018 for five hours , costing the company more than $700,000 in sales and impacting approximately 323,000 shoppers. Case studies abound.

Website 74

Website Cache Traffic Ecommerce 74

Smashing Magazine

SEPTEMBER 6, 2021

As discussed in part 2 , in HTTP/2, this multiplexing is steered using its prioritization system. As we also saw, however, this system was very complex , causing it to often be badly used and implemented in practice (see the image below). Nevertheless, the fundamental concepts of prioritization won’t change. What Does It All Mean?

Network 120

Network Servers Cache Traffic 120

HammerDB

NOVEMBER 5, 2018

SQL> alter system flush buffer_cache; System altered. However what if in a test environment you cannot upgrade the log I/O but want to move beyond the log bottleneck to be able to test other system components more fully. SQL> alter system set commit_wait='NOWAIT' scope=spfile; System altered. commit_wait.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JULY 2, 2023

This blog was originally written in September 2018 and was updated in June 2023. In setting up our demonstration system, we use pg_basebackup and continuous archiving. In this post, we cover the methods used to achieve an enterprise-grade backup strategy for the PostgreSQL cluster.

Strategy 52

Strategy Database Storage Open Source 52

Apica

MAY 10, 2019

million Netflix users as of Q3 2018. Apica provides load tests with 10 million+ simulated VUs for Hollywood at 800 GB/sec to measure the behavior of their systems, analyze any bottlenecks from the spike of simulated traffic, and assess any risks to the stability and availability of their streaming services before actual primetime.

Testing 40

Testing Performance Social Media Wireless 40

Smashing Magazine

MARCH 2, 2020

The Face demonstrates how a system for design is the structure on which you start building a design. In 2018, Brody stepped down from his position as Dean of the School of Communication at the Royal College of Art. By fine-tuning my alpha channel values and colour stop points, I can create the perfect look to fit my design.

Design 117

Design Media Testing Entertainment 117

Brendan Gregg

FEBRUARY 8, 2018

In this post I'll look at the Linux kernel page table isolation (KPTI) patches that workaround Meltdown: what overheads to expect, and ways to tune them. Also microbenchmarks, which often stress-test the system, will suffer the largest losses. This shows the system-wide syscall rate. Much of my testing was on Linux 4.14.11

Performance 40

Performance Benchmarking Cache Tuning 40

Adrian Cockcroft

AUGUST 23, 2018

Allez will be with me and Laurel in the Monterey area at the end of August 2018. I first became aware of Citroen’s as a child when my father pointed out a Citroen DS and told me about it’s advanced aerodynamics and technology, including the hydropneumatic suspension system. I don’t have an asking price, and I’m not in a hurry.

Speed 40

Speed Engineering Automotive Systems 40

The Netflix TechBlog

NOVEMBER 9, 2020

some teams used a pattern of building a materialized view of another service’s data for their specific system needs. Inconsistent data across different Studio applications was the top support issue in Studio Engineering in 2018. Materialized views had performance benefits, but data consistency lagged by varying degrees.

Architecture 360

Architecture Engineering Scalability Open Source 360

Percona

AUGUST 10, 2018

In fact, you should not set it to OFF in a production system unless you are 100% sure about what you are doing and its implications. This may help tune your table level autovacuum settings appropriately. Tuning Autovacuum in PostgreSQL. How do we identify the tables that need their autovacuum settings tuned ? .

Tuning 69

Tuning Cache Database Storage 69

Rigor

SEPTEMBER 11, 2019

Rachel is also one of the people behind Perch , a PHP content management system (CMS). She works directly with organizations to build clear and coherent products and design systems. He has a keen interest in web technologies, performance tuning, security, and the practical use of technology. Doug Sillars. Doug Sillars.

Performance 89

Performance Education Google Website 89

John McCalpin

JANUARY 22, 2018

Dr. Damon McDougall gave a short presentation on this study at the IXPUG 2018 Fall Conference ( pdf ) — I originally wrote these notes to help organize my thoughts as we were preparing the IXPUG presentation, and later decided that the extra details contained here are interesting enough for me to post it. not FMAs). FMAs/cycle.

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

Dr. Damon McDougall gave a short presentation on this study at the IXPUG 2018 Fall Conference ( pdf ) — I originally wrote these notes to help organize my thoughts as we were preparing the IXPUG presentation, and later decided that the extra details contained here are interesting enough for me to post it. not FMAs). FMAs/cycle. .

Latency 40

Latency Hardware Code Testing 40

Percona

JANUARY 14, 2019

2018-05-31 ? In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. toDate(min(created_utc))???toDate(max(created_utc))??????count()?? toDate(max(created_utc))??????count()?? count()?? ? 2006-01-01 ?

Database 48

Database Analytics Blockchain Healthcare 48