Dynatrace

OCTOBER 15, 2021

The data is incredibly plentiful and difficult to store over long periods due to capacity limitations — a reason why private and public cloud storage services have been a boon to DevOps teams. This information is gathered from remote, often inaccessible points within your ecosystem and processed by some sort of tool or equipment.

Open Source 246

Open Source Metrics Cloud Transportation 246

All Things Distributed

DECEMBER 8, 2016

It relies on the scale and power of Amazon Simple Storage Service (Amazon S3) to deliver in-region storage options to businesses and organizations across the world in Canada, Japan, Singapore, Australia, Ireland, Germany, and the U.S., Par Werner Vogels, le 8 décembre 2016. as part of its Box Zones ecosystem.

AWS 128

AWS Cloud Lambda Innovation 128

Brendan Gregg

APRIL 14, 2022

The Netflix stack is more diverse than I was expecting, and is explained in detail in the [Netflix tech blog]: The production cloud is AWS EC2, Ubuntu Linux, Intel x86, mostly Java with some Node.js (and other languages), microservices, Cassandra (storage), EVCache (caching), Spinnaker (deployment), Titus (containers), Apache Spark (analytics), Atlas (..)

Java 142

Java Cloud Cache AWS 142

All Things Distributed

OCTOBER 17, 2016

In the remainder of 2016 and inq 2017, we will launch another four AWS regions in Canada, China, the United Kingdom, and France, adding another nine AZs to our global infrastructure footprint. It brings the worldwide total of AWS Availability Zones (AZs) to 38, and the number of regions globally to 14.

AWS 107

AWS Cloud Infrastructure Storage 107

SQL Server According to Bob

JUNE 3, 2016

SQL Server 2016 changes the internal design to (CheckScanner), applying no lock semantics and a design similar to those used with In-Memory Optimized (Hekaton) objects, allowing DBCC operations to scale far better than previous releases. On the same hardware/machine repeat steps 1 thru 3 using an instance of SQL Server 2016 CTP 3.0

Hardware 40

Hardware Servers Cache Software Engineering 40

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated. Want to dive deeper?

Availability 40

Availability Servers Hardware Benchmarking 40

All Things Distributed

MAY 19, 2017

That database engine is now known as Amazon Aurora and launched in 2014 for MySQL and in 2016 for PostgreSQL. We believe the central constraint in high throughput data processing has moved from compute and storage to the network.

Database 88

Database Design Cloud Storage 88

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 110

Virtualization AWS Hardware Storage 110

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 103

Performance Latency Cache Virtualization 103

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage.

Performance 127

Performance Network Mobile Metrics 127

Percona

JANUARY 17, 2019

now has a version which will support parallelism for SELECT queries (utilizing the read capacity of storage nodes underneath the Aurora cluster). Aurora PQ works by doing a full table scan (parallel reads are done on the storage level). SSD) we can’t utilize the full potential of IOPS with just one thread. Documentation: [link].

Cache 72

Cache C++ AWS Airlines 72

Percona

JANUARY 24, 2023

Some of the built-in features ( wal_compression ) have been there since 2016, and almost all backup tools do the WAL compression before taking it to the backup repository. Attempts to compress PostgreSQL WAL at different levels have always been around since the beginning. The actual benefit of compression depends on many factors.

Database 142

Database Benchmarking Open Source Latency 142

All Things Distributed

DECEMBER 12, 2018

The second platform is a managed IoT cloud with customer-facing applications and data management, which went live in 2016. We are excited to offer a comprehensive portfolio of services, from foundational technologies such as compute, storage, and networking to more advanced services such as containers and serverless computing.

AWS 119

AWS Cloud Games Serverless 119

Percona

SEPTEMBER 19, 2023

This issue most often occurs when there is significant MySQL server activity during the backup operation, and the redo log file storage media operates faster than the backup storage media. Copyright (c) 2016, 2023, Oracle and/or its affiliates. root@ip-xxx-xx-xx-xx ~]# mysqlsh -uroot -p MySQL Shell 8.0.33 Type 'help' or '?'

C++ 124

C++ Servers Storage Speed 124

Tim Kadlec

JANUARY 9, 2019

Cennydd also makes the case that performance also has an impact on energy consumption: In 2016, video, tracking scripts and sharing buttons caused the average website to swell to the same size as the original version of Doom. Ballooning bandwidth and storage have fostered complacency that we can do without. Performance is conservation.

Performance 111

Performance Energy Internet Internet 111

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. SQL 2016 – It Just Runs Faster: Indirect Checkpoint Default.

C++ 58

C++ Database Servers Storage 58

SQL Server According to Bob

NOVEMBER 8, 2016

SQL Server 2016 Service Pack 1 (all SKUs) , in combination with Windows Server 2016 (All SKUs) or Windows 10 Client introduces non-volatile memory support for the tail of the log file (LDF) which can significantly increase transaction throughput. Block storage is what you think of today as disk access. Tail Of Log Caching.

Cache 40

Cache Servers Media Storage 40

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Percona

AUGUST 18, 2023

And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. That said, other performance motivations mentioned above did play into it, especially before the days of multi-threaded replication. 10-Linux.x86_64.ssl101.tar.gz

Programming 98

Programming Servers Database Open Source 98

SQL Performance

SEPTEMBER 5, 2019

You will need SQL Server 2016 (or later) and Developer Edition (or equivalent) to reproduce the results shown here. This table uses columnstore for its primary storage to produce batch mode execution later on. You might call this arrangement "off-row" or "out-of-batch" storage. DROP TABLE IF EXISTS #T ; GO. c1 = @Start + N.

Performance 81

Performance C++ Storage Servers 81

SQL Performance

MAY 29, 2019

From SQL Server 2016 onward, FastLoadContext is enabled by default ; the trace flag is not required. For more background, see the Data Performance Loading Guide and the Tiger Team notes on the behaviour changes for SQL Server 2016. FastLoadContext can be disabled on SQL Server 2016 using documented trace flag 692. I >= 100.

Cache 64

Cache Testing Servers Code 64

Scalegrid

JANUARY 19, 2024

Data-bearing members face a higher risk of encountering issues caused by rollbacks, compared to others who utilize different storage methods. The files look something like this: <dbname> <collectionname> 2016-02-08T19-34-44.0.bson

Database 130

Database Network Servers Monitoring 130

Smashing Magazine

FEBRUARY 8, 2022

In 2016, I released the first version of the tool, then called not Statoscope, but Webpack Runtime Analyzer. We can import information from our metric storage into data. For example, we can record the daily average bundle build time, send it to storage with the metrics and then embed it into the custom report. Sergey Melukov.

Storage 89

Storage Code Metrics C++ 89

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

SEPTEMBER 5, 2017

LTS (April 2016). I wrote about it in a previous post, [DTrace for Linux 2016]. I wrote a page on it: [perf]. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks. The hardest part on Linux is now done: kernel support. It's the official profiler.

Virtualization 75

Virtualization AWS Engineering Hardware 75

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The slightly newer Intel Xeon E5-26xx v4 (Broadwell) series which was introduced in Q1 of 2016, increased that to 2400MHz. They also only have 40 PCIe 3.0 lanes per processor. Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

SQL Performance

AUGUST 23, 2019

SQL Server 2016 introduced the ability to create a bitmap for general predicates on dictionary-encoded segment data. This 2016 optimization can be applied to any predicate pushed into a columnstore scan, including a bitmap 'predicate' created by an upstream hash join.

Servers 75

Servers Engineering Efficiency Retail 75

SQL Performance

APRIL 23, 2019

SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column. Test 1: Pushdown, 9-bit Impure Keys.

Servers 67

Servers Testing Metrics Storage 67

SQL Performance

MAY 1, 2019

The summary rows for heap tables without indexes are the same in both documents (no changes for SQL Server 2016): An explicit TABLOCK hint is not the only way to meet the requirement for table-level locking. This is reflected in the summary tables included in the Data Loading Performance Guide and the Tiger Team post.

Servers 47

Servers Database Testing Performance 47

VoltDB

AUGUST 27, 2024

Volt Active Data (Volt) is a sophisticated real-time data platform intricately designed with multiple critical components, including high-speed data processing, in-memory storage, and ACID-compliant transactions. Why Jepsen Testing? A major customer found an atomicity bug in our export system last year.

Testing 52

Testing Database Network Systems 52

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. GA 23 February 2016 5.7.10-3 MariaDB Server includes many storage engines beyond the default InnoDB.

Open Source 52

Open Source Servers Storage Scalability 52

SQL Performance

MAY 16, 2019

The calculated row size (61 bytes) differs from the true row storage size (60 bytes) by the extra one byte of internal metadata present in the insert stream. These correspond directly to the new facilities added under trace flag 610 to SQL Server 2008, then changed to be on by default from SQL Server 2016 onward.

Cache 67

Cache Servers Testing Storage 67

Alex Russell

OCTOBER 22, 2017

The true median device from 2016 sold at about ~$200 unlocked. — Monica Dinculescu (@notwaldorf) September 20, 2016. Time required to read bytes from disk (it’s not zero, even on flash-based storage!). This year’s median device is even cheaper , but their performance is roughly equivalent.

Performance 74

Performance Network Benchmarking Mobile 74

Smashing Magazine

JANUARY 15, 2019

An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. In 2016, O’Reilly published “ Designing For Sustainability ” by Tim Frick. These include data transfer (i.e. Data transfer is one thing that we can measure quite easily.

Website Performance 78

Website Performance Website Energy Performance 78

Alex Russell

APRIL 29, 2021

At the time of the last Confluence run, the gap had stretched to nearly 1000 APIs, doubling since 2016. Chrome has missed several APIs for 3+ years: Storage Access API. From this data we see that iOS is the least complete and competitive implementation of the web platform, and the gap is growing. Some relatively minor additions (e.g.

Media 145

Media Games Education Engineering 145

Particular Software

OCTOBER 3, 2017

This article was originally published on the NDC 2016 Blog. Once you've shoveled enough data from the monolith database to different storages, you can activate your new feature and remove those redundant parts of the code. Have you ever had to deal with a function that had hundreds and hundreds of lines?

Architecture 49

Architecture Database Code Systems 49