Dynatrace

JANUARY 26, 2021

This allows teams to sidestep much of the cost and time associated with managing hardware, platforms, and operating systems on-premises, while also gaining the flexibility to scale rapidly and efficiently. REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms.

Serverless 240

Serverless Efficiency Lambda Azure 240

Percona

JANUARY 19, 2023

In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. Redundant indexes: It is known that accessing rows by fetching an index is more efficient than through a table scan in most cases. 1 mysql mysql 592K Dec 30 02:48 tb1.ibd ibd -rw-r --. 1 mysql mysql 464K Dec 30 02:48 tb2.ibd

Open Source 89

Open Source Storage Database Big Data 89

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The Sort only has 19 rows to process, so it consumes only 1ms or so. This is very efficient, as confirmed by the elapsed time of 13ms (all of which is CPU time). Test Environment. All the operators in this plan use row mode execution.

Servers 86

Servers Tuning Database Efficiency 86

The Agile Manager

JUNE 30, 2015

A producer does this with a combination of efficiency (squeeze every penny from raw materials sourcing to distribution) and by appealing to or outright fueling user vanity (engender customer identity in every facet of its business). But skills, capabilities, processes and culture all wilt in the face of an overbearing capital structure.

Software 40

Software Software Innovation Hardware 40

Abhishek Tiwari

JULY 12, 2018

These data pipelines can process data at petabytes scale and to some extent, their success can be attributed to an army of engineers devoted to build and maintain internal data pipelines. Depending on frameworks, data processing units (a.k.a A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

KeyCDN

SEPTEMBER 20, 2018

Error tracking is the process of proactively identifying issues and fixing them as quickly as possible. Error monitoring can get increasingly complicated as you deal with bugs reported by users and your production team, which is why having an efficient error tracking workflow from the beginning is so important.

Monitoring 67

Monitoring Strategy Website Google 67

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Measurements refer to specific data points, such as the number of seconds it takes to process a request. Memory utilization: The amount of memory required to process a request.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

OCTOBER 18, 2023

It’s a complex process involving various factors and meticulous planning. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier. Evaluating your hardware requirements is another vital aspect of resource allocation.

Open Source 93

Open Source Database Strategy Hardware 93

DZone

AUGUST 16, 2019

Application scalability is the potential of an application to grow in time, being able to efficiently handle more and more requests per minute (RPM). It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system.

Scalability 145

Scalability Efficiency Hardware Software 145

Scalegrid

AUGUST 30, 2024

RabbitMQ augments its users’ security and experience by simplifying the processes involved in granting authorizations. This process follows authentication and determines the permissible actions for a user. By adopting OAuth 2.0, This streamlines managing access rights for users within the service.

Transportation 130

Transportation Virtualization Strategy Storage 130

Abhishek Tiwari

SEPTEMBER 15, 2024

It's not the trendiest language out there, but it's known for its efficiency and low-level control. This allows NASA's engineers to fine-tune every aspect of the rover's behavior, optimizing for reliability rather than rapid development or ease of use. NASA's testing processes are where the real magic happens.

Engineering 52

Engineering Social Media Hardware C++ 52

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log monitoring is a process by which developers and administrators continuously observe logs as they’re being recorded. Log analytics is the process of evaluating and interpreting log data so teams can quickly detect and resolve issues.

Analytics 199

Analytics Monitoring Artificial Intelligence DevOps 199

O'Reilly

NOVEMBER 28, 2023

Users and Nonusers AI adoption is in the process of becoming widespread, but it’s still not universal. Until AI reaches 100%, it’s still in the process of adoption. Automating the process of building complex prompts has become common, with patterns like retrieval-augmented generation (RAG) and tools like LangChain.

Open Source 111

Open Source Google Artificial Intelligence Infrastructure 111

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. Key features Multi-table storage : Unlike file-per-table tablespaces, which store each table in a separate file, general tablespaces can house numerous tables, enhancing storage efficiency.

Storage 89

Storage Engineering Database Open Source 89

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Good examples are: ETL processes for data archiving, reporting, data consolidation and so on. Currently, CPU affinity (i.e., Another cool useless feature???

Tuning 45

Tuning Virtualization Testing Servers 45

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 101

Hardware Storage Big Data Blockchain 101

All Things Distributed

MARCH 19, 2018

Bill Simmons, CTO of Dataxu, states, "We process 3 million ad requests a second - 100,000 features per request. In other words, processing the 10th gigabyte and 1000th gigabyte is conceptually the same. To seamlessly switch between CPU and GPU machines, we use Apache MXNet to interface with the underlying hardware.

Scalability 153

Scalability Hardware AWS Tuning 153

The Morning Paper

NOVEMBER 10, 2019

Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. Rather than reimplement TCP/IP or refactor an existing transport, we started Pony Express from scratch to innovate on more efficient interfaces, architecture, and protocol.

Network 92

Network Transportation Latency Entertainment 92

Percona

AUGUST 5, 2023

Various partition types, like RANGE, LIST, HASH, and KEY, are used for specific needs, from range-based data to custom criteria, to ensure efficient data handling and the optimization of queries. ensures that only relevant partitions are accessed, further enhancing query efficiency. Partition pruning, a feature in MySQL 5.7,

Strategy 40

Strategy Storage Database Best Practices 40

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

O'Reilly

OCTOBER 11, 2022

There seems to be broad agreement that hyperautomation is the combination of Robotic Process Automation with AI. We’ll see it in the processing of the thousands of documents businesses handle every day. We can certainly apply the slogan to many, if not all, clerical tasks–and even to the automation process itself.

Games 118

Games Healthcare Processing Retail 118

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. The key to an efficient system is the identification of cold pages: the cold age threshold determines how many seconds we can go without a page being accessed before it is declared cold. ML-based auto-tuning.

Software 78

Software Software Google Hardware 78

HammerDB

FEBRUARY 25, 2021

Top 10 Processes. However, having the application logic in the client is even worse because you are sacrificing key database efficiencies of prepared statements. For all the databases supported we are using a compiled C interface on the client to use the lowest level of most efficient form of access possible. Glue language.

Programming 67

Programming Benchmarking Virtualization C++ 67

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. For specific information on I/O tuning and balancing, you will find more details in the following document.

Servers 40

Servers Cache Media Hardware 40

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

SEPTEMBER 5, 2017

There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). I wrote a page on it: [perf]. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

AUGUST 22, 2021

This is a bit more difficult to explain, because it depends on the physical properties of the medium (for example, the used frequency of radio waves), the number of users on the network, and also the devices that interconnect different subnetworks (because they typically can only process a certain number of packets per second).

Performance 107

Performance Network Latency Servers 107

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. This uses hardware, typically a crystal oscillator, that produces ticks at a very high constant rate regardless of processor speed, power settings, or anything of that nature. SQL Server uses the high-precision QueryPerformanceCounter API to capture timing data.

Servers 95

Servers Tuning Architecture Performance 95

SQL Server According to Bob

JANUARY 11, 2020

DBCC Page Auditing DBCC page auditing is the process of executing common DBCC consistency checks as pages are read from disk. KB ​​ boundaries efficiently. ​​ Obtain assistance from your I/O vendor ​​ if you ​​ encounter retries. ​​ This creates 8?KB

Servers 40

Servers Cache Database Media 40

High Scalability

NOVEMBER 25, 2019

Your Laptop has a filesystem used by hundreds of processes. It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. On prem data processing. Locks used for strong consistency across processes. Document store.

Architecture 52

Architecture Cache Azure Storage 52