Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. In contrast, Alluxio a middleware for data access - think Alluxio storage layer as fast cache.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. We want to support these systems as a source so that they can provide their data for further consumption. Some of DBLog’s features are: Processes captured log events in-order.

Database 221

Database Traffic Transportation Open Source 221

ACM Sigarch

MARCH 18, 2019

Computer systems, from the Internet-of-Things devices to datacenters, are complex and optimizing them can enhance capability and save money. Developing simulators, however, is time-consuming and requires a great deal of infrastructure development regarding a prospective system. Answered in Part 2.). Lazowska, et al.

Systems 61

Systems Latency Performance Analytics 61

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. We want to support these systems as a source so that they can provide their data for further consumption. Some of DBLog’s features are: Processes captured log events in-order.

Database 206

Database Traffic Transportation Open Source 206

All Things Distributed

JUNE 20, 2017

The new AWS Asia Pacific (Hong Kong) Region will have three Availability Zones and be ready for customers for use in 2018. Beyond running their web properties and applications, Next Digital also uses Amazon RDS (database), Amazon ElastiCache (caching), and Amazon Redshift (data warehousing).

AWS 126

AWS Logistics Cloud Social Media 126

ACM Sigarch

MARCH 25, 2019

The M/M/1 queue also assumes that the arrival rate is not affected by the unbounded number of tasks in the queue (called an “open system”). For the previous cache miss buffer example, the 32-buffer answer is minimal for 100-ns average miss latency. Figure 2 plots the M/M/1 queue’s latency-throughput trade-off.

Systems 54

Systems Latency Performance C++ 54

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Pointer Lock. Media Recorder.

Media 145

Media Games Education Engineering 145

MachMetrics

DECEMBER 14, 2019

Similar to our article Average Page Load Times for 2018 , we’ll go over the averages for metrics and help you determine if your site is faster or slower than average. It is typically reduced via server-side optimizations, such as enabling caching and database indexes. Source: ThinkWithGoogle. seconds on desktop and 2.59

Best Practices 105

Best Practices Speed Mobile Google 105

KeyCDN

SEPTEMBER 12, 2019

This can be a problem in a lot of content management systems such as WordPress or Magento, because theme developers tend to scale images down in responsive themes using CSS. KeyCDN’s Cache Enabler plugin is fully compatible the HTML attributes that make images responsive. It is usually recommended that you upload images at scale.

Social Media 106

Social Media Media Google Website 106

The Morning Paper

JUNE 20, 2019

In total, there were 112 such incidents over the period March – September 2018 (not all of them affecting external customers). TLA+ is used to model concurrent and distributed system protocols helping to eliminate high level design and semantic bugs. I’d expect this class of bugs to also surface in microservices systems.

Cloud 81

Cloud Azure Cache C++ 81

Speed Curve

FEBRUARY 5, 2024

Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Caching the base page/HTML is common, and it should have a positive impact on backend times. Key things to understand from your CDN Cache Hit/Cache Miss – Was the resource served from the edge, or did the request have to go to origin?

Servers 64

Servers Cache Retail Benchmarking 64

Randon ASCII

FEBRUARY 25, 2018

See the end of the post for an October 2018 bug fix update, or read the whole story: Flaky failures are the worst. This was starting to look like a Windows file cache bug. Maybe something to do with multi-socket coherency of the disk and cache or ??? Update, October 2018.

Programming 79

Programming Hardware Cache Code 79

Rigor

SEPTEMBER 3, 2019

In one high-profile example, Amazon dealt with significant outages on Prime Day 2018 , which may have cost them as much as $99 million in sales. JCrew’s site went down on Black Friday 2018 for five hours , costing the company more than $700,000 in sales and impacting approximately 323,000 shoppers. Case studies abound.

Website 74

Website Cache Traffic Ecommerce 74

Brendan Gregg

FEBRUARY 9, 2018

This overhead can be reduced by A) pcid, fully available in Linux 4.14, and B) Huge pages. - **Cache access pattern**: the overheads are exacerbated by certain access patterns that switch from caching well to caching a little less well. Also microbenchmarks, which often stress-test the system, will suffer the largest losses.

Performance 72

Performance Benchmarking Cache Tuning 72

Nick Desaulniers

JUNE 2, 2018

ccache , the compiler cache, is a fantastic way to speed up build times for C and C++ code that I previously recommended. Usually when this happens with ccache, there’s something non-deterministic about the builds that prevents cache hits. . $ Sat Mar 17 03:04:59 UTC 2018. Cold Cache. kB max cache size 5.0

Speed 46

Speed Cache C++ Systems 46

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

AUGUST 18, 2019

BPF has been extended (aka eBPF) in recent years for providing a safe way to extend kernel functionality, and has become a hot topic in systems engineering, with at least 24 talks on BPF at the last Linux Plumber's conference. system(".") 6 * 7 * Copyright 2018 Netflix, Inc. Builtin variables include: Variable Description.

Latency 57

Latency C++ Cache Programming 57

SQL Server According to Bob

FEBRUARY 5, 2018

system but not on my Centos 7 system joined to the same domain (realm.) I followed the common guidance for using Active Directory with SQL Server on Linux – no luck. Default DNS naming was incorrectly set causing the system to appear at RDORRLinux.DOMAINNAME.guest.microsoft.com instead of RDORRLinux.DOMAINNAME. conf files.

Servers 40

Servers Code Cache Traffic 40

Smashing Magazine

SEPTEMBER 6, 2021

This approach was touted to be better for fine-grained caching because each subresource could be cached individually and the full bundle didn’t need to be redownloaded if one of them changed. As discussed in part 2 , in HTTP/2, this multiplexing is steered using its prioritization system.

Network 120

Network Servers Cache Traffic 120

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 avg-cpu: %user %nice %system %iowait %steal %idle 14.81 avg-cpu: %user %nice %system %iowait %steal %idle 14.86 avg-cpu: %user %nice %system %iowait %steal %idle 14.95 Output every 1 seconds. 17 48011 [.]

Cache 40

Cache C++ AWS Systems 40

Percona

MAY 1, 2023

This blog was originally published in August 2018 and was updated in May 2023. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Out of the box, the default PostgreSQL configuration is not tuned for any particular workload.

Tuning 52

Tuning Database Efficiency Performance 52

Smashing Magazine

JUNE 30, 2021

iOS empowers developers to easily parallelize code using Grand Central Dispatch , Android does this via their new, unified task scheduler WorkManager and game engines like Unity have job systems. On design systems, CSS/JS and UX. Paul Lewis and I once explored actor-centric app architecture at Chrome Dev Summit 2018.

Games 145

Games Architecture Code C++ 145

Smashing Magazine

OCTOBER 31, 2023

The truth is that the two tools were fairly distinct until PSI was updated in 2018 to use Lighthouse reporting. If throttling is applied at the operating system level , then the metrics match what a real user with those network conditions would experience. The accuracy of observed data depends on how the test environment is set up.

Speed 117

Speed Google Website Metrics 117

Alex Russell

OCTOBER 22, 2017

Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. Given the conflicted data we see across our other systems, this seems about right as a baseline. Think back: your framework of choice might be 40K, but what about that data system?

Performance 74

Performance Network Benchmarking Mobile 74

Sutter's Mill

JANUARY 25, 2021

Not only is the integer comparison operation cheap, but min and max are already being accessed by this function and so they’re already “hot” in registers or cache. If you develop your own assertion system for in-house use, support enabling/disabling at least these kinds of assertions independently. [1] Dos Reis, J. Meredith, N.

C++ 63

C++ Programming Cache Testing 63

HammerDB

NOVEMBER 5, 2018

To illustrate the data reads on Oracle we can flush the buffer cache. SQL> alter system flush buffer_cache; System altered. However what if in a test environment you cannot upgrade the log I/O but want to move beyond the log bottleneck to be able to test other system components more fully. so what are your options?

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Brendan Gregg

FEBRUARY 8, 2018

This overhead can be reduced by A) pcid, fully available in Linux 4.14, and B) Huge pages. - **Cache access pattern**: the overheads are exacerbated by certain access patterns that switch from caching well to caching a little less well. Also microbenchmarks, which often stress-test the system, will suffer the largest losses.

Performance 40

Performance Benchmarking Cache Tuning 40

Randon ASCII

AUGUST 16, 2018

As usual I had UIforETW running in the background, tracing to circular buffers, so I just had to type Ctrl+Win+R and the buffers, representing the last thirty seconds or so of system activity, were saved to disk. The CFG memory block is best thought of a cache with bounded size. But it’s not. Well, that’s not quite true.

Programming 75

Programming Virtualization Code Processing 75

Enprowess

MARCH 10, 2022

It has used Angular to create the PayPal checkout system that contains essential features such as a payment review page and adding MasterCard pages. It depends on you how skillfully you utilize the combination of JSON and client-side caching to boost the server-side performance. It has a Dependency injection system built in JSON.

Development 52

Development Google Servers Code 52

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” That means multiple data indirections mean multiple cache misses. tef : You can use a message broker to glue systems together, but never use one to cut systems apart. They are very expensive. This is where your performance goes.

Internet 121

Internet Internet Scalability Automotive 121

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

Jos

JUNE 2, 2018

presented in Google IO 2018 ( source ) These tools make it easier to determine where we need to put emphasis to improve our sites. How would you architecture a non-trivial size web project (client, server, databases, caching layer)? They can be run as a one-off or integrated in our development and deployment pipelines.

Performance 237

Performance Speed Google Media 237

Smashing Magazine

JANUARY 21, 2021

We never used CSS-in-JS or styled-components, but instead a good ol’ component-based system of Sass-modules which would be compiled into CSS. Plus a service worker that caches all static assets and serves them for repeat views, along with cached versions of articles that a reader has already visited. KB, Brotlified).

Performance 111

Performance Cache Mobile Network 111

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. India became a 4G-centric market sometime in 2018. The Moto G4 , for example. 2] Getting accurate global information that isn't artificially reduced to averages remains an ongoing challenge.

Performance 127

Performance Network Mobile Metrics 127

Percona

AUGUST 10, 2018

In fact, you should not set it to OFF in a production system unless you are 100% sure about what you are doing and its implications. sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 You May Also Like.

Tuning 68

Tuning Cache Database Storage 68

Jos

JUNE 2, 2018

presented in Google IO 2018 ( source ). Security : Hopefully there’s a team or individual with deep knowledge about security that help us reviewing system designs, implementations, and informs us about reports or and security patches. How would you architecture a non-trivial size web project (client, server, databases, caching layer)?

Performance 100

Performance Speed Google Media 100

Smashing Magazine

JANUARY 15, 2019

The Mozilla Internet Health Report 2018 states that — especially as the Internet expands into new territory — “sustainability should be a bigger priority.” For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu.

Website Performance 78

Website Performance Website Energy Performance 78