Percona

OCTOBER 18, 2023

Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you. Evaluating your hardware requirements is another vital aspect of resource allocation. Look closely at your current infrastructure (hardware, storage, networks, etc.)

Open Source 111

Open Source Database Hardware Strategy 111

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. When a new hardware device is connected, the Local Registry detects and collects a set of information about it, such as networking information and ESN.

Latency 222

Latency Traffic Transportation Cloud 222

O'Reilly

MARCH 11, 2025

These smaller distilled models can run on off-the-shelf hardware without expensive GPUs. And they can do useful work, particularly if fine-tuned for a specific application domain. Spending a little money on high-end hardware will bring response times down to the point where building and hosting custom models becomes a realistic option.

Artificial Intelligence 63

Artificial Intelligence Infrastructure Government Open Source 63

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 137

Open Source Google Artificial Intelligence Infrastructure 137

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. A single document may represent thousands of features. Google goes a step further in offering compute instances with its specialized TPU hardware. Millions of tests, across as many parameters as will fit on the hardware.

Hardware 135

Hardware Storage Big Data Blockchain 135

Scalegrid

AUGUST 30, 2024

This fine-tunes operational access inside RabbitMQ and facilitates complex naming conventions for resources and sophisticated rules regarding access. When persistent messages in RabbitMQ are encrypted, it ensures that even in the event of unsanctioned access to storage hardware, confidential information stays protected and secure.

Transportation 130

Transportation Virtualization Strategy Storage 130

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). There's a lot about Linux containers that isn't well documented yet, especially since it's a moving target.

Virtualization 75

Virtualization AWS Engineering Hardware 75

Adrian Cockcroft

JUNE 2, 2023

FSD has a sense of purpose, a planning capability, has real time agency and responds to its environment via an ego model, predicting the behavior of pedestrians and other road users, and is being tuned to drive in a very human way, so that other road users interact with it as a predicable normal driver.

Social Media 95

Social Media Innovation Open Source Entertainment 95

Percona

JANUARY 19, 2023

You can refer to the documentation for further details. There is a cool blog post from Vadim covering big data sets in MyRocks: MyRocks Use Case: Big Dataset Query tuning: It is common to find applications that at the beginning perform very well, but as data grows the performance starts to decrease.

Open Source 111

Open Source Storage Database Big Data 111

HammerDB

APRIL 19, 2023

There are several ways to find out this information with the easiest way being by referring to the documentation. Instead, readers should refer to the HammerDB documentation. For the experiments in this blog, we did not tune the system. on identical hardware, with identical settings, but at different load levels.

Performance 55

Performance Benchmarking Cache Storage 55

Abhishek Tiwari

SEPTEMBER 15, 2024

This allows NASA's engineers to fine-tune every aspect of the rover's behavior, optimizing for reliability rather than rapid development or ease of use. This isn't just brainstorming – it's a formal, documented process that leaves no stone unturned. The choice of C as the programming language is telling.

Engineering 52

Engineering Social Media Hardware C++ 52

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

O'Reilly

OCTOBER 11, 2022

We’ll see it in the processing of the thousands of documents businesses handle every day. Andrew Ng , Christopher Ré , and others have pointed out that in the past decade, we’ve made a lot of progress with algorithms and hardware for running AI. Is special-purpose training to fine-tune a model’s behavior an option?

Games 141

Games Healthcare Processing Systems 141

SQL Performance

JUNE 21, 2019

Some retired documentation from Microsoft stated that index fragmentation can have a negative impact from 13-460% depending on the size of the environment and the level of fragmentation. If you have big physical hardware with defaults, then you should look at optimizing MAXDOP. All the figures above are guidelines, not hard truths.

Servers 49

Servers Azure Hardware Database 49

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. If tuned for performance, there is a good change reliability is compromised - and vice versa. A data pipeline can process data in a different order than they were received.

Latency 63

Latency Analytics Scalability Engineering 63

Dotcom-Montior

OCTOBER 12, 2017

Used this documentation for the setup: [link]. Detailed documentation: [link]. Verify hardware sizing. Make application tuning much easier. They simulate actual and future growth pattern on pre-production stages, identify and fix hotspots and deploy those tuned application into production. 34.251.255.57.

AWS 40

AWS Monitoring Tuning Servers 40

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. This uses hardware, typically a crystal oscillator, that produces ticks at a very high constant rate regardless of processor speed, power settings, or anything of that nature. SQL Server uses the high-precision QueryPerformanceCounter API to capture timing data.

Servers 95

Servers Tuning Architecture Performance 95

John McCalpin

JANUARY 22, 2018

Hardware performance counter results for a simple benchmark code calling Intel’s optimized DGEMM implementation for this processor (from the Intel MKL library) show that about 20% of the dynamic instruction count consists of instructions that are not packed SIMD operations (i.e.,

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

Hardware performance counter results for a simple benchmark code calling Intel’s optimized DGEMM implementation for this processor (from the Intel MKL library) show that about 20% of the dynamic instruction count consists of instructions that are not packed SIMD operations (i.e., addl $1, %eax vfmadd213pd %zmm16, %zmm17, %zmm29.

Latency 40

Latency Hardware Code Testing 40

VoltDB

MAY 2, 2017

Here’s how we explain it in our Documentation: Support for different cluster sizes in passive Database Replication (DR). because they want to use a lower k- factor (even 0) on the replica cluster to lower hardware costs. Stay tuned for more support Q&As – and don’t forget to download our newest version , v7.2.

Database 40

Database Hardware Servers Tuning 40

SQL Server According to Bob

JANUARY 11, 2020

Copyright The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. Microsoft may have patents, patent applications, trademarks, copyrights, or other intellectual property rights covering subject matter in this document.

Servers 40

Servers Cache Media Hardware 40

HammerDB

FEBRUARY 25, 2021

This is possible because the Tcl interpreter is exceptionally compact and lightweight (Also for this reason Tcl is often used as an embedded language in hardware such as Cisco Routers). But let’s quantify fast by running the same calculation in SQL Server (see the HammerDB documentation for the Oracle example).

Programming 68

Programming Benchmarking Virtualization C++ 68

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

Percona

AUGUST 5, 2023

This means that multiple partitions can be processed simultaneously, making better use of available hardware resources and further enhancing query performance. This helps identify potential issues and fine-tune the partitioning strategy. Documentation : Always be documenting!

Strategy 40

Strategy Storage Database Best Practices 40

Percona

JANUARY 17, 2019

On multi-core machines – which is the majority of the hardware nowadays – and in the cloud, we have multiple cores available for use. Documentation: [link]. In all versions of MySQL – at least at the time of writing – when you run a single query it will run in one thread, effectively utilizing one CPU core only. With faster disks (i.e.

Cache 72

Cache C++ AWS Airlines 72

Smashing Magazine

AUGUST 22, 2021

As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. Some options for doing this are described in the IETF’s proposed document. Many network interface controllers (NICs) even have built-in hardware-offload features for TCP. Finally convinced?

Performance 109

Performance Network Latency Servers 109

SQL Server According to Bob

JANUARY 11, 2020

Copyright The information ​​ that is contained ​​ in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. After reading ​​ this document you will better understand SQL Server I/O needs and capabilities.

Servers 40

Servers Cache Database Media 40

High Scalability

NOVEMBER 25, 2019

Document store. Egnyte Connect as the content collaboration and data management platform is used by thousands of customers as the single Secure Content Platform for all of their document management needs. We use Mashery as a gateway, the API is documented at [link]. How are software and hardware upgrades rolled out?

Architecture 52

Architecture Cache Azure Storage 52

Adrian Cockcroft

NOVEMBER 18, 2024

Discover how their solution saves customers hours of manual effort by automating the analysis of tens of thousands of documents to better manage investor events, report internally to executive teams, and find new investors to target. Raman Pujani, Solutions Architect, AWS NOTE: This is an interesting new topic.

AWS 98

AWS Energy Lambda Government 98