Smashing Magazine

NOVEMBER 11, 2021

From Good To Great In Dashboard Design: Research, Decluttering And Data Viz. From Good To Great In Dashboard Design: Research, Decluttering And Data Viz. Tossing out suboptimal parts of our design can be a daunting task, especially after you’ve invested hours of work into it. Definition. Design Validation.

Design 97

Design Best Practices Efficiency Testing 97

DZone

DECEMBER 28, 2020

The system could work efficiently with a specific number of concurrent users; however, it may get dysfunctional with extra loads during peak traffic. For example, the gaming app has to present definite actions to bring the right experience. Confirming scalability, dependability, stability, and speed of the app is crucial.

Performance Testing 230

Performance Testing Testing Tools Testing Performance 230

Dynatrace

JULY 11, 2023

By leveraging the Dynatrace Operator and Dynatrace capabilities on Red Hat OpenShift on IBM Power, customers can accelerate their modernization to hybrid cloud and increase operational efficiencies with greater visibility across the full stack from hardware through application processes.

Architecture 178

Architecture Availability Infrastructure Monitoring 178

The Netflix TechBlog

OCTOBER 18, 2022

We want users to rely on shared templates and reuse their workflow definitions across their team, saving time and effort on creating the same functionality. Maestro high level architecture In Maestro, a workflow is a DAG (Directed acyclic graph) of individual units of job definition called Steps. But sometimes, it is not efficient.

Java 208

Java Scalability Traffic Architecture 208

The Netflix TechBlog

MARCH 4, 2024

We have deployed Auto Remediation in production for handling memory configuration errors and unclassified errors of Spark jobs and observed its efficiency and effectiveness (e.g., For efficient error handling, Netflix developed an error classification service, called Pensive, which leverages a rule-based classifier for error classification.

Tuning 214

Tuning Efficiency Big Data Engineering 214

DZone

FEBRUARY 27, 2021

This begins not only in designing the algorithm or coming out with efficient and robust architecture but right onto the choice of programming language. But these are definitely ruled out for enterprise applications due to the complexity in development, maintainability, need for object orientation, and interoperability.

Java 214

Java C++ Benchmarking Programming 214

The Netflix TechBlog

AUGUST 1, 2022

Data Mesh Overview A New Definition Of Data Mesh Previously, we defined Data Mesh as a fully managed, streaming data pipeline product used for enabling Change Data Capture (CDC) use cases. This design enables us to reuse and share data as much as possible. This article gives an overview of the system.

Processing 273

Processing Transportation Entertainment Tuning 273

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. This data lands in its original, raw form without requiring schema definition.

Artificial Intelligence 221

Artificial Intelligence Storage Analytics Government 221

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. This starts with a highly efficient ingestion pipeline that supports adding hundreds of petabytes daily. A schema is a fixed definition to organize data in certain fields. Thus, it can scale massively.

Artificial Intelligence 277

Artificial Intelligence Analytics Storage Architecture 277

Scalegrid

APRIL 5, 2024

This method involves splitting data over various nodes to improve the database’s efficiency. Similar to how each lane on the highway handles certain vehicles for more efficient travel, in Redis sharding, different nodes manage various pieces of data through consistent hashing. Visualize it as a relay race.

Scalability 130

Scalability Java Efficiency Database 130

Dynatrace

NOVEMBER 14, 2023

The panelists speculated that AI will likely improve quality of life for SRE teams through its ability to efficiently execute tasks. We’ll see lots of different types of impact versus one definitive impact [from generative AI],” she said. SRE is about designing, building, and operating reliable services at scale,” said Townshend.

Best Practices 204

Best Practices Engineering DevOps Software Engineering 204

Dynatrace

JUNE 14, 2023

“The historical definition of observability is transforming,” Clayton said. These areas together underpin the new Dynatrace Value Incentive Partner Program (VIPP), which we designed to provide more opportunities, more services, and more benefits to our partners.

Programming 192

Programming Best Practices Innovation Analytics 192

Percona

APRIL 11, 2023

The unique quiz Consider the following MySQL table definition. These can occur accidentally due to poor database design or through the use of database management tools that automatically create indexes without checking for duplicates. Toward the end, we will identify what the pt-duplicate-key-checker doesn’t.

Database 95

Database Testing Open Source Design 95

The Netflix TechBlog

DECEMBER 21, 2020

We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 209

Storage Latency Efficiency Data Engineering 209

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can push or pull.

Infrastructure 223

Infrastructure Big Data Transportation Architecture 223

Percona

JULY 25, 2023

So, given a table_id, how do you get the table schema/definition? After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Old design (until Percona XtraBackup 8.0.33-27): New design (from Percona XtraBackup 8.0.33-28) ibd > t1.sdi

Cache 89

Cache Servers Benchmarking Design 89

DZone

NOVEMBER 9, 2021

If you start catching bugs early, it will save you tons of time fixing them later.nn> Design reviewnnIt’s a very powerful tool when used in a good way. I really like what one of the smartest people with whom I worked said: “A good design is a design where you can see the code”. You may think that you know how the system works.

Software 245

Software Software Code Design 245

Dynatrace

JUNE 6, 2023

Thair elaborated on the concept of “designing for operations” with a car analogy. That’s not good design for Ops,” he said. One of the main roadblocks that arises with a broader definition for DevOps is responsibility. How do [developers] make the things that are most likely to break, easily accessible?”

DevOps 171

DevOps Engineering Innovation Best Practices 171

The Netflix TechBlog

FEBRUARY 16, 2021

However, with our rapid product innovation speed, the whole approach experienced significant challenges: Business Complexity: The existing SKU management solution was designed years ago when the engagement rules were simple?—?three Rule owners are responsible for making sure the requirements match the rule definition and request context.

Mobile 215

Mobile Engineering Infrastructure Scalability 215

O'Reilly

JULY 11, 2023

If 20% of your time is spent coding, and AI-based code generation makes you 50% more efficient, then you’re really only getting about 10% of your time back. Design—of the software itself, the user interfaces, and the data representation—is certainly not going away, and isn’t something the current generation of AI is very good at.

Programming 100

Programming Code Design Software 100

Dynatrace

SEPTEMBER 28, 2021

While DevOps is often referred to as “agile operations,” the widely quoted definition from Jez Humble, co-author of The DevOps Handbook, calls it “a cross-disciplinary community of practice dedicated to the study of building, evolving, and operating rapidly-changing resilient systems at scale.” App availability.

DevOps 213

DevOps Metrics Traffic Efficiency 213

The Netflix TechBlog

JANUARY 10, 2024

Since then, the video pipeline has undergone substantial improvements and broad expansions: Starting with Standard Dynamic Range (SDR) at Standard-Definitions , we expanded the encoding pipeline to 4K and High Dynamic Range (HDR) which enabled support for our premium offering.

Processing 234

Processing Media Latency Innovation 234

The Morning Paper

JULY 2, 2019

One SQL to rule them all: an efficient and syntactically idiomatic approach to management of streams and tables Begoli et al., The TVR, by definition, supports the entire suite of relational operators, even in scenarios involving time-varying relational data. SIGMOD’19. So the first part of the proposal is essentially a no-op!

Efficiency 65

Efficiency Processing Benchmarking Open Source 65

Percona

MARCH 20, 2023

When designing an architecture, many components need to be considered before deciding on the best solution. In this scenario, it is also crucial to be efficient in resource utilization and scaling with frugality. This is due to the multiplexing and the very efficient way ProxySQL uses to deal with high load.

Games 125

Games Latency Traffic Cache 125

Dynatrace

JULY 16, 2020

To do that, we need an easy and efficient API access to all of our Dynatrace Environments, without having to create and maintain API access tokens of individual tenants. It would definitely make my life easier! I wanted a rather lightweight design that is yet versatile. Consolidating the APIs. Concurrency, fan-out, fan-in.

Cache 236

Cache Serverless Efficiency Tuning 236

The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience.

Traffic 282

Traffic Metrics Systems Strategy 282

Strategic Tech

NOVEMBER 25, 2018

If you’re among the thousands of organisations building a platform-powered digital ecosystem, you face serious organisation design challenges. Without an explicit organisation design strategy, you will over-commit resources to low priority initiatives and starve your big bets?—?the This is a concept we can apply in organisation design.

Design 40

Design Speed Innovation Strategy 40

ACM Sigarch

AUGUST 3, 2023

(Editor’s Note: This post was submitted as a rebuttal to Andrew Chien’s July 24 SIGARCH Blog Post ) The recent post “ Why Embodied Carbon is a poor Architecture Design metric, and Operational Carbon remains an important Problem ” by Prof. Throughout, we adopt the Greenhouse Gas Protocol scope definition as used in Prof.

Energy 98

Energy Architecture Hardware Metrics 98

Dynatrace

NOVEMBER 8, 2021

G2 Research includes a clear definition of APM in its Grid Report for Application Performance Monitoring for Spring 2021. ” APM vendors originally designed their solutions to quickly identify application performance issues in monolithic on-premises apps. ” — Christopher C, Platform Manager at an enterprise.

Artificial Intelligence 239

Artificial Intelligence Monitoring Infrastructure Cloud 239

The Netflix TechBlog

MARCH 2, 2021

Working on my PhD, I was using optimization techniques to design radiotherapy fractionation schemes to improve the results of clinical practices. My academic credentials definitely helped on the technical side. How do you, as a data scientist, fill in the pieces between product, engineering, and design?

Analytics 213

Analytics C++ Innovation Engineering 213

Percona

SEPTEMBER 1, 2023

Additionally, they enable the implementation of sophisticated business logic within the database, streamlining repetitive tasks and enhancing overall efficiency. However, they can also introduce performance bottlenecks, especially if poorly designed. Well-designed indexes can significantly improve query performance within triggers.

Cache 64

Cache Database Games Healthcare 64

The Netflix TechBlog

OCTOBER 14, 2024

To efficiently utilize our compute resources, Titus employs a CPU oversubscription feature , meaning the combined virtual CPUs allocated to containers exceed the number of available physical CPUs on a Titus agent. Specifically, pystan uses asyncio. Blame Noisy Neighbors The Workbench instance runs as a Titus container.

Latency 211

Latency Virtualization Traffic Processing 211

VoltDB

FEBRUARY 29, 2024

In this fast-paced ecosystem, two vital elements determine the efficiency of this traffic: latency and throughput. On the other hand, high throughput is crucial for tasks like downloading large files or streaming high-definition videos, where the volume of data transferred matters.

Latency 52

Latency Games Traffic Network 52

The Netflix TechBlog

OCTOBER 7, 2021

The main goal of A/B testing is to design a robust experiment that is going to yield repeatable results and enable us to make sound decisions about whether or not to launch a product feature (read more about A/B tests at Netflix here ). Additionally, this gets us closer to consistent metric definitions in both realtime and offline systems.

Metrics 203

Metrics Mobile Testing Strategy 203

Percona

SEPTEMBER 27, 2023

DEFAULT ‘on’::text Because we specified ‘2’ for premake in the create_parent function, you can observe that two partitions ahead have been created, as shown in the table definition below. schema.tablename p_control text You should partition the column, either integer or time-based.

Storage 105

Storage Open Source Database Efficiency 105

High Scalability

OCTOBER 24, 2022

Each cloud-native evolution is about using the hardware more efficiently. There's a huge short-term and long-term efficiency of services that depends on the successful coordination of cloud services and infrastructure. Does anyone really want to go back to the VM-centric days when we rolled everything ourselves?

Cloud 187

Cloud Hardware Infrastructure Innovation 187