The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. For example, when running tests, the state of the device will change from “available for testing” to “in test.” In this blog post, we will focus on the latter feature set.

Latency 216

Latency Traffic Transportation Cloud 216

Dynatrace

OCTOBER 28, 2021

The crisis could be technical, natural, or malicious events, for example an earthquake affecting data center availability, or a cyberattack infecting applications and websites. It created more uncertainty than the load balancing issues the entertainment firm saw in its data centers.

Engineering 220

Engineering Entertainment Cloud Infrastructure 220

Percona

DECEMBER 27, 2023

In our conversations with developers and engineers during the conference, we confirmed the CNCF GItOps Microsurvey data – 91% are already using GitOps. All of the database automation for running a highly available, resilient, and secure database is built into the operator to simplify the operation and management of your clusters.

Cloud 83

Cloud Open Source Strategy Best Practices 83

Abhishek Tiwari

JULY 12, 2018

Building data pipelines can offer strategic advantages to the business. Often companies underestimate the necessary effort and cost involved to build and maintain data pipelines. Data pipeline initiatives are generally unfinished projects. In this post, we will discuss why you should avoid building data pipelines in first place.

Latency 63

Latency Analytics Scalability Engineering 63

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

JANUARY 19, 2023

With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance. For instance, in Percona Managed Services , we have many clients with TBs worth of data that are well performant. There are many compression tools and algorithms for data out there.

Open Source 93

Open Source Storage Database Big Data 93

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. It has 32GB RAM, with 24GB available to the SQL Server 2019 instance. Each test result represents the best of ten runs, with all required data and index pages in memory. Remember this is the best time over ten runs with all the data in memory.

Servers 86

Servers Tuning Database Efficiency 86

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Typically a good value is 70%-80% of available memory. If you see concurrency issues, you can tune this variable.

Performance 130

Performance Hardware Tuning Storage 130

Percona

JANUARY 4, 2024

They provide flexibility in data organization and performance optimization compared to the default setup. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning. sec) root@mysql8:/etc/mysql/mysql.conf.d#

Storage 92

Storage Engineering Database Open Source 92

VoltDB

MAY 2, 2017

Be sure to configure both clusters with sufficient capacity for the expected volume of data. This allows the customer to use the existing five servers in a new configuration that trades off some level of high availability redundancy for disaster recovery and geographic redundancy. One consideration is availability vs. completeness.

Hardware 40

Hardware Database Servers Tuning 40

KeyCDN

SEPTEMBER 20, 2018

Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app. The Google DevTools console can give you real-time feedback to help you trace the source of errors, and you can set handlers to automate exception data collection.

Monitoring 67

Monitoring Strategy Website Google 67

Sutter's Mill

MAY 28, 2012

Mainstream hardware – many kinds of parallelism: What’s the relationship among multi-core CPUs, hardware threads , SIMD vector units (Intel SSE and AVX , ARM Neon ), and GPGPU (general-purpose computation on GPUs, which I covered at C++ and Beyond 2011 )? Stay tuned, and fasten your seat belts.

C++ 40

C++ Hardware Best Practices Tuning 40

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. An interruption in data flow due to limited capacity is called a bottleneck. Test and collect data: Let your testing software do all the hard work, then assess the results.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

OCTOBER 18, 2023

Advantages of migrating to open source For many reasons mentioned earlier, organizations are increasingly shifting towards open source databases for their data management needs. This compatibility simplifies the migration of data from other environments, whether they are proprietary or another open source option.

Open Source 97

Open Source Database Strategy Hardware 97

Percona

AUGUST 29, 2018

In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned. Ensure that $PGDATA environment variable is set to PostgreSQL’s data directory. #!/bin/bash Let’s now try to add some data into the database. SHMMAX / SHMALL. Until version 9.2,

Tuning 58

Tuning Database Servers Processing 58

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. Every time the trigger executes, the function runs on an available resource. How does serverless computing tackle inefficiencies?

Serverless 242

Serverless Efficiency Lambda Azure 242

Dynatrace

APRIL 21, 2023

The Office of the CTO wanted to ensure a positive citizen experience by identifying the 200+ critical applications available within their 21 executive agencies and offering application performance monitoring (APM) as a service to those agencies. Zbojniewicz wanted to drive APM and simultaneously decommission the legacy toolset successfully.

Government 158

Government Infrastructure Innovation Monitoring 158

O'Reilly

NOVEMBER 28, 2023

AI users say that AI programming (66%) and data analysis (59%) are the most needed skills. A year after the first web servers became available, how many companies had websites or were experimenting with building them? That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 111

Open Source Google Artificial Intelligence Infrastructure 111

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. The time and effort saved with testing and deployment are a game-changer for DevOps.

Open Source 296

Open Source Traffic DevOps Cloud 296

Dynatrace

MAY 1, 2020

The Linux ARM platform —the Linux kernel ported to ARM processor–based machines—is becoming a tempting, cost-effective solution for building microservice-oriented data centers. Other distributions like Debian and Fedora are available as well, in addition to other software like VMware, NGINX, Docker, and, of course, Java.

Java 132

Java Hardware Tuning Metrics 132

Scalegrid

AUGUST 30, 2024

to prevent unauthorized access and ensure data protection. Encryption at both the transport level (using SSL/TLS) and message level is crucial for safeguarding data in transit and at rest, ensuring confidentiality and integrity within RabbitMQ deployments. 509 certificates, and OAuth 2.0, Read Also : What is RabbitMQ Used For?

Transportation 130

Transportation Virtualization Strategy Storage 130

Percona

AUGUST 29, 2023

Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables. Data redundancy, a database version of a RAID Pondering the case of high availability and redundancy, one replicates data by creating a replica via streaming replication. 1 citus | 11.1-1

C++ 84

C++ Database Storage Testing 84

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006. The Top Queries That Weren't.

Tuning 115

Tuning Servers Monitoring Hardware 115

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log files contain much of the data that makes a system observable: for example, records of all events that occur throughout the operating system, network devices, pieces of software, or even communication between users and application systems.

Analytics 204

Analytics Monitoring Artificial Intelligence DevOps 204

Dynatrace

NOVEMBER 20, 2019

Having released this functionality in an Early Adopter Release with OneAgent version 1.173 and Dynatrace version 1.174 back in August 2019, we’re now happy to announce the General Availability of OneAgent full-stack monitoring for Linux on the IBM Z platform, sometimes informally referred to as Z/Linux. Host-performance measures.

Availability 30

Availability Hardware Java Tuning 30

Percona

AUGUST 27, 2018

Resource groups permit assigning threads running within MySQL to particular groups so that threads execute according to the resources available to this group. assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth.

Tuning 46

Tuning Virtualization Testing Servers 46

Dynatrace

AUGUST 12, 2020

Dynatrace is thrilled to announce the General Availability of support for both the 2.x With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. So stay tuned! What’s next.

Serverless 233

Serverless Azure Monitoring Lambda 233

All Things Distributed

OCTOBER 8, 2014

We designed DynamoDB to operate with at least 99.999% availability. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying. These databases trade off complex querying capabilities and consistency for scale and availability.

Availability 141

Availability Performance Scalability AWS 141

All Things Distributed

MARCH 19, 2018

For example, training on more data means more accurate models. Machine learning is one such transformational technology that is top of mind not only for CIOs and CEOs, but also developers and data scientists. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS.

Scalability 153

Scalability Hardware AWS Tuning 153

Dynatrace

AUGUST 8, 2019

We’re happy to announce the Early Adopter Release of OneAgent full-stack monitoring for Linux on the IBM Z platform, sometimes informally referred to as Z/Linux (available with OneAgent version 1.173 and Dynatrace version 1.174). For details on available metrics, see our help page on host performance monitoring.

Availability 25

Availability Hardware Java Tuning 25

Dynatrace

AUGUST 12, 2020

Dynatrace is thrilled to announce the General Availability of support for both the 2.x With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. So stay tuned! What’s next.

Serverless 140

Serverless Azure Monitoring Lambda 140

O'Reilly Software

APRIL 4, 2018

Considerations for setting the architectural foundations for a fast data platform. Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. Back in the days of Web 1.0,

Architecture 80

Architecture Scalability Google Operating System 80

SQL Performance

APRIL 27, 2020

Many of the newer features we have in SQL Server were initially launched in Azure SQL Database, including (but not limited to) Always Encrypted, Dynamic Data Masking, Row Level Security, and Query Store. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. DTU Pricing Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

The Morning Paper

JUNE 27, 2019

The thrust of the argument is that there’s a chain of inter-linked assumptions / dependencies from the hardware all the way to the programming model, and any time you step outside of the mainstream it’s sufficiently hard to get acceptable performance that researchers are discouraged from doing so. Challenges optimising whole programs.

Systems 87

Systems Tuning Programming Innovation 87

The Morning Paper

MAY 21, 2019

Google’s “far” memory it turns out is exactly the same memory, but with compressed data stored in it! Zswap is readily available and runs as a swap device in the Linux kernel. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory. ML-based auto-tuning.

Software 78

Software Software Google Hardware 78